-- Logs begin at Thu 2022-05-12 16:49:16 UTC, end at Thu 2022-05-12 17:59:13 UTC. -- May 12 17:27:35.286382 dv-cinder-839793-10-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 12 17:27:35.294262 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 17:27:35 2022] *** May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: nodename: dv-cinder-839793-10-iscsi May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: machine: x86_64 May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: clock source: unix May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: pcre jit disabled May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: detected number of CPU cores: 4 May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: current working directory: / May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: detected binary path: /usr/bin/uwsgi-core May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: your processes number limit is 47680 May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: your memory page size is 4096 bytes May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: detected max file descriptor number: 2048 May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: lock engine: pthread robust mutexes May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: thunder lock: enabled May 12 17:27:35.297712 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 12 17:27:35.298555 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 17:27:35.348193 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: Python main interpreter initialized at 0x559a98c1f9c0 May 12 17:27:35.348193 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: python threads support enabled May 12 17:27:35.348193 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: your server socket listen backlog is limited to 100 connections May 12 17:27:35.348193 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: your mercy for graceful operations on workers is 90 seconds May 12 17:27:35.349057 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: mapped 403077 bytes (393 KB) for 2 cores May 12 17:27:35.349188 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: *** Operational MODE: preforking *** May 12 17:27:35.349488 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: *** uWSGI is running in multiple interpreter mode *** May 12 17:27:35.349488 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: spawned uWSGI master process (pid: 80124) May 12 17:27:35.353896 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: spawned uWSGI worker 1 (pid: 80137, cores: 1) May 12 17:27:35.353896 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: spawned uWSGI worker 2 (pid: 80138, cores: 1) May 12 17:27:35.353896 dv-cinder-839793-10-iscsi devstack@keystone.service[80124]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 17:27:35.349703 dv-cinder-839793-10-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 12 17:27:41.200791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:27:41.200791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: from cryptography.utils import int_from_bytes May 12 17:27:41.202121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:27:41.202121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: from cryptography.utils import int_from_bytes May 12 17:27:41.203676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:27:41.203676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: from cryptography.utils import int_from_bytes May 12 17:27:41.204994 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 17:27:41.204994 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: from cryptography.utils import int_from_bytes May 12 17:27:41.251544 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 17:27:41.251722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 17:27:41.251912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] command line args: [] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 17:27:41.252181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 17:27:41.252355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ================================================================================ {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 17:27:41.252609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] admin_token = **** {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.252855 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] config_dir = [] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.253041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.253124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 17:27:41.253272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] config_source = [] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.253354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 17:27:41.253421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] debug = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.253481 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] command line args: [] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 17:27:41.253628 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.256593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 17:27:41.256593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ================================================================================ {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 17:27:41.256725 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.256725 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.256725 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.257149 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] admin_token = **** {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.257223 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.257283 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] config_dir = [] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.257345 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] list_limit = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.257407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.257470 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] log_config_append = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.257533 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] config_source = [] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.257601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.257665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] debug = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.257729 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] log_dir = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.257729 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] log_file = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.257842 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.257935 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.258001 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.258001 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.258114 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.258172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.258239 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.258303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.258366 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.258427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] list_limit = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.258484 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.258541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] log_config_append = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.258607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.259175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.259397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.259568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] log_dir = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.259568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] log_file = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.259947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.260194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.260397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.260397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.260737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.260934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.261178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.261381 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.261579 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.261579 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.261932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.262159 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.262364 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.262580 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.262823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.262995 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.262995 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.263373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.263617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.263785 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] publish_errors = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.264012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.264184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.264362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.264534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.264677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.264813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.264980 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.265114 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.265256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.265389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.265389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] standard_threads = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.265389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.265806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.265806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] publish_errors = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.266133 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.266268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.266399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.266399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] use_journal = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.266653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.266818 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] use_json = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.266991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.267154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] use_stderr = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.267289 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.267430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] use_syslog = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.267568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.267710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.267846 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] standard_threads = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.267977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.268107 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.268245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.268376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.268512 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.268662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.268662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] use_journal = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.269056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.269245 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] use_json = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.269467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.269735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] use_stderr = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.269952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.270116 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] use_syslog = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.270116 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 17:27:41.270460 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.270614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.270834 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.270970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.271101 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.271240 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.271440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.271576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.271713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.271844 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.271974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.272122 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.272255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.272386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.272516 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.272648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.272779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.272922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.273061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.273192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.273322 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.273459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.273590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.273730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.273869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.274009 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.274140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.274270 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.274401 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.274543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.274705 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.274853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.274987 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.275123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.275254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.275392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.275523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.275653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.275794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.275794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.275794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.276170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.276301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.276431 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.276559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.276694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.276826 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.276967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.277098 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.277228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.277357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.277502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.277633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.277827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.278043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.278207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.278340 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.278470 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.278600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.278778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.278919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.279050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.279180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.279316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.279446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.279599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.279731 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.279861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.280037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.280173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.280303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.280445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.280577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.280706 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.280835 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.280965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.281106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.281243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.282468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.282643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.282866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.283200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.283412 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.283578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.283773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.283966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.284161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.284356 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.284590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.284756 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.285481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.285704 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.285919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.286089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.286330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.286497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.286791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.286997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.292061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.292261 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.292420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.292561 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.292696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.292837 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.293005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.293194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.293338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.293478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.293611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.293742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.293873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.294013 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.294157 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.294299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.294432 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.294571 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.294722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.294860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.294992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.295143 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.295284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.295418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.295549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.295681 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.295813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.295952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.296084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.296216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.296347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.296490 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.296623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.296755 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.296904 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.297037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.297174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.297306 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.297306 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.297554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.297693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.297827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.297958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.298088 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.298219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.298350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.298489 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.298622 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.298813 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.298948 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.299079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.299210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.299412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.299547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.299678 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.299808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.299940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.300071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.300211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.300343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.300483 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.300689 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.301325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.301464 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.301606 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.301739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.301970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.302120 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.302254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.302395 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.302529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.302660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.302660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.302967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.303108 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.303108 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.303387 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.303387 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.303658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.303790 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.303920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.304053 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.304190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.304331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.304463 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.304594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.304732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.304864 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.304994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.305144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.305283 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.305415 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.305415 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.305663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.305794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.305933 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.306065 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.306198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] auth.external = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.306329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.306460 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.306632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.306802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.306955 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.307088 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.307220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.307351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] auth.password = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.307481 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.307627 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] auth.token = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.307760 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.307922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.308068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.308202 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.308335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] auth.external = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.308474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.308607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.308756 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.308756 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.309026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.309026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.309277 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.309409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] auth.password = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.309549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.309683 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] auth.token = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.309815 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] credential.caching = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.309948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.310081 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.310224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.310358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.310491 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.310633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.310933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.311071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.311216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.311352 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.311493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.311633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.311765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.311897 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.312046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] credential.caching = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.312179 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.312311 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.312444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.312583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.312732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.312878 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.313012 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.313151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.313284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.313416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.313549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.313690 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.313824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.313956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.314088 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.314220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.314352 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] federation.caching = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.314493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.314641 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.314798 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.314932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.315064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.315205 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.315347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.315480 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.315621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.315754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.315887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.316018 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.316348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.316495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.316648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] federation.caching = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.316781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.316978 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.317120 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.317275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.317409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.317541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.317674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.317807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.317940 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity.caching = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.318080 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.318215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.318347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.318479 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.318622 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.318817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.318967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.319108 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.319242 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.319375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.319507 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.319639 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.319780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.319913 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.320045 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity.caching = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.320177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.320308 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.320450 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.320591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.320724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.320858 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.320989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.320989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.321238 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.321379 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.321519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.321651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.321783 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.321916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.322056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.322190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.322332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.322473 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.322605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.322763 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.322912 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.323047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.323179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.323311 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.323442 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.323574 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.323714 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.323847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.323980 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.324125 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.324258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.324389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.324529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.324663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.324796 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.324928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.325060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.325192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.325335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.325468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.325600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.325731 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.325863 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.326004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.326145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.326277 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.326409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.326540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.326697 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.326838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.326982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.327117 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.327248 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.327380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.327511 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.327643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.327792 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.327926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.328058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.328191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.328323 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.328455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.328594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.328727 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.328858 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.328990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.329121 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.329254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.329394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.329526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.329674 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.329807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.329939 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.330071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.330211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.330345 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.330477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.330608 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.330762 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.330895 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.331038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.331172 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.331304 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.331436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.331578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.331710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.331885 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.332025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.332182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.332182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.332496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.332496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.332765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.332899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.333031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.333031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.333279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.333423 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.333564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.333697 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.333829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.333960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.334092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.334224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.334367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.334367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.334620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.334620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.334920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.334920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.335180 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.335325 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.335458 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.335590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.335723 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.335723 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.335980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.336149 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.336288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.336421 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.336554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.336695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.336828 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.336959 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.337105 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.337237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.337369 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.337513 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.337648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.337780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.337912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.338044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.338175 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.338315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.338448 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.338448 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.338448 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.338839 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.338982 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.339127 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.339260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.339392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.339522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.339653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.339785 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.339929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.340061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.340193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.340323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.340454 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.340585 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.340724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.340868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.341000 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.341132 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.341262 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.341393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.341536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.341668 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] resource.caching = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.341810 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.341941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.342073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.342204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.342412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.342547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.342738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.342889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.343023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.343155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.343299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.343432 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.343564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.343695 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.343827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.343958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.344099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.344233 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.344364 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] resource.caching = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.344497 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] role.caching = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.344647 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.344779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] role.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.344919 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.345053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.345185 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.345316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.345449 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.345580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.345722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.345855 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.345987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.346119 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.346250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.346383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.346533 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.346683 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.346825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.346957 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.347091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] role.caching = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.347222 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.347365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] role.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.348063 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.348267 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.348472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.348616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.348748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.348890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.349035 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.349169 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.349302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.349434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.349434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.349695 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.349827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.349958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.350129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.350268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.350410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.350551 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.350715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.350865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.350998 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.351129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.351273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.351407 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.351539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.351671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.351803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.351935 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.352075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.352208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.352341 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.352472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.352604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.352747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.352747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.353012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.353152 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.353285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.353285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.353534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.353674 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.353807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.353939 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.354070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.354070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.354318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.354468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.354602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.354758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] token.caching = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.354892 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.354892 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.355141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.355284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.355420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.355551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.355683 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.355815 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.355948 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.356089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.356232 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.356365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.356497 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.356629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.356760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.356950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.357088 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.357088 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.357088 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.357088 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.357580 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] token.caching = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.357713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.357845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.357977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.358119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.358251 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.358390 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.358523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.358656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.358847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.358980 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.359111 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.359254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.359388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.connection = **** {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.359529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.359670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.359803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.359934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.360076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.360208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.360349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.360483 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.360615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.360748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.360880 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.361011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.361151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.361284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.361416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.361549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.361682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.361814 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.361968 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.362101 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.362233 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.362365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.362496 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.connection = **** {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.362638 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.362808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.362951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.363119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.363781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.363921 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.364053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.364186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.364337 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.364471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.364603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.364735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.364868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.365001 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.365322 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 17:27:41.365467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.365467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.365467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.365467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.365467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.365467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.365467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.365467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.365467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.366747 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.366747 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 17:27:41.366747 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 17:27:41.370939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.371173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.371399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.375837 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.376073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.376297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.380175 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.385617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.413614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.413614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.420780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.421010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.474696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.475973 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.530632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.530984 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.531171 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.531328 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.597224 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.597510 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.597690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.597848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.598122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.598810 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.598965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.599121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.599271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.599434 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.599584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.599584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.623020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.623258 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.623419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.623570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.623713 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.623863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.624028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.624179 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.624340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.624482 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.624629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.624783 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.624927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.625075 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.636198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.636374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.651539 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.651791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.651951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.652101 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.652245 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.652392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.652547 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.652697 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.652845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.652994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.653141 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.653296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80138) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.653438 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.653438 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80137) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 17:27:41.670877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.671079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 17:27:41.671349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.671503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.671652 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 17:27:41.671800 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 17:27:41.671947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.672095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.672095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 17:27:41.672383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.672542 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.672683 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.672830 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.672980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.673127 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.673127 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.683683 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.683958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.684224 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.684493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.684645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.684796 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.685018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.685296 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.692893 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.693967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.696211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.696494 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.696777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.697170 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.697328 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.697477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.697631 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.697779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.697927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.698078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.698219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.698368 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.698515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.698689 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.698854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.699004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.699152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.699304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.699447 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.699447 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.699731 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.699946 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.727300 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.728459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.728902 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.729181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.730073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.730349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.734530 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.734837 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.735117 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.735619 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.735891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.736167 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.742594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.742900 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.743985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.744261 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.747543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.747830 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.748111 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.748389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.748661 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.748866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.749017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.749159 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.749312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.749455 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.749603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.749763 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.749933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.750202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.750473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.750758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.768422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.768707 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.771123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.771405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.773825 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.775913 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.777463 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.777754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.779525 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.779818 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.782754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.784784 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.787548 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.789484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.791307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.791605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.791890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.792174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.792448 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.792724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.793200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.793494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.793774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.794053 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.794328 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.794601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.813914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.813914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.813914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.813914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.814219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.814476 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.814733 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.814988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.820855 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.822583 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.822873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.823403 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.825112 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.825383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.825924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.826202 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.826488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.826795 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.827081 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.828441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.828716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.828993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.829268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.829549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.841092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.841371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.841645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.841931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.842207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.842484 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.842782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.843933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.844206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.844479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.844763 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.845039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.845316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.845594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.861921 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.865259 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.865355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.868561 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.868675 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.870230 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.871876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.871965 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.872141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.872438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.873470 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.875101 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.875377 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.875668 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.880434 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.882298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.884376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.885560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.885848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.886012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.886166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.886396 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.889202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.889489 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.889768 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.890038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.896341 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.896630 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.896911 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.904574 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.904852 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80138) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.904966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.905155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.905315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.905464 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.905665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.905934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.906222 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.906494 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.906793 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.907065 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.907330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.907595 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.907870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.908141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.908399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80138) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.913176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80137) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 17:27:41.913441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.913723 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.913997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.914266 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.914548 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.914865 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.915142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.915410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.915674 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.915940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.916217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.916481 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.916737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80137) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 17:27:41.948438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a98c1f9c0 pid: 80138 (default app) May 12 17:27:41.951812 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c174c98-6b88-4537-b8ed-af4c6d5b797b None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:41.952105 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c174c98-6b88-4537-b8ed-af4c6d5b797b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:41.952390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c174c98-6b88-4537-b8ed-af4c6d5b797b None None] PATH_INFO: `/v3` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:41.956222 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a98c1f9c0 pid: 80137 (default app) May 12 17:27:41.956585 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 791 bytes} [Thu May 12 17:27:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:27:49.961614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f1b4a-4926-4845-80f9-4444b84dec9f None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:49.962166 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f1b4a-4926-4845-80f9-4444b84dec9f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:49.962166 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f1b4a-4926-4845-80f9-4444b84dec9f None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:49.966457 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1/2] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:27:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:27:49.971605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb968d1-a859-416c-bbc9-df5c2bb43419 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:49.971990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb968d1-a859-416c-bbc9-df5c2bb43419 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:49.972177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb968d1-a859-416c-bbc9-df5c2bb43419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:50.002689 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb968d1-a859-416c-bbc9-df5c2bb43419 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80138) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:27:50.185639 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG passlib.handlers.bcrypt [None req-dcb968d1-a859-416c-bbc9-df5c2bb43419 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80138) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 17:27:50.186058 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG passlib.handlers.bcrypt [None req-dcb968d1-a859-416c-bbc9-df5c2bb43419 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80138) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 17:27:50.242510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-dcb968d1-a859-416c-bbc9-df5c2bb43419 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:27:50.244243 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-dcb968d1-a859-416c-bbc9-df5c2bb43419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:27:50.367749 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 2/3] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:27:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 17:27:50.520715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f1b4a-4926-4845-80f9-4444b84dec9f None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:50.554837 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG oslo_db.sqlalchemy.engines [None req-9a4f1b4a-4926-4845-80f9-4444b84dec9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 17:27:50.681842 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f1b4a-4926-4845-80f9-4444b84dec9f None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:50.686070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39440b0-2118-4c47-b127-6acd46ec6364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:50.686751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39440b0-2118-4c47-b127-6acd46ec6364 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:50.687036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39440b0-2118-4c47-b127-6acd46ec6364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:50.687310 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39440b0-2118-4c47-b127-6acd46ec6364 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:50.695539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39440b0-2118-4c47-b127-6acd46ec6364 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:27:50.747175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c39440b0-2118-4c47-b127-6acd46ec6364 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 17:27:50.747512 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39440b0-2118-4c47-b127-6acd46ec6364 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:27:50.757508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 2/4] 10.222.0.76 () {58 vars in 1324 bytes} [Thu May 12 17:27:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:27:50.763649 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb968d1-a859-416c-bbc9-df5c2bb43419 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:50.778366 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb968d1-a859-416c-bbc9-df5c2bb43419 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:50.782771 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d4091-1aa0-4ecf-bfe7-ba3ab38571b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:50.783966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d4091-1aa0-4ecf-bfe7-ba3ab38571b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:50.784317 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d4091-1aa0-4ecf-bfe7-ba3ab38571b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:50.784660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d4091-1aa0-4ecf-bfe7-ba3ab38571b4 admin admin] PATH_INFO: `/v3/projects/9ec5d27c457b4e7d87f61efe4927f51d` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:50.786907 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d4091-1aa0-4ecf-bfe7-ba3ab38571b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=9ec5d27c457b4e7d87f61efe4927f51d)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:27:50.837721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a47d4091-1aa0-4ecf-bfe7-ba3ab38571b4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 17:27:50.838065 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d4091-1aa0-4ecf-bfe7-ba3ab38571b4 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:27:50.842728 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 3/5] 10.222.0.76 () {56 vars in 1207 bytes} [Thu May 12 17:27:50 2022] GET /identity/v3/projects/9ec5d27c457b4e7d87f61efe4927f51d => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:27:53.075978 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ba8d6-7815-4995-9590-295209c9bd51 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:53.076501 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ba8d6-7815-4995-9590-295209c9bd51 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:53.076588 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ba8d6-7815-4995-9590-295209c9bd51 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:53.080672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 3/6] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:27:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:27:53.086243 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457d57-9541-4518-b0dd-2018a9a8dc9c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:53.086704 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457d57-9541-4518-b0dd-2018a9a8dc9c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:53.086845 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457d57-9541-4518-b0dd-2018a9a8dc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:53.106872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-8f457d57-9541-4518-b0dd-2018a9a8dc9c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:27:53.108402 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8f457d57-9541-4518-b0dd-2018a9a8dc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:27:53.116771 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 4/7] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:27:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 17:27:53.140321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ba8d6-7815-4995-9590-295209c9bd51 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:53.152519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ba8d6-7815-4995-9590-295209c9bd51 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:53.156710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92593b21-f02f-4c7d-bb7e-a2883f15824b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:53.157345 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92593b21-f02f-4c7d-bb7e-a2883f15824b admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:53.157625 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92593b21-f02f-4c7d-bb7e-a2883f15824b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:53.157896 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92593b21-f02f-4c7d-bb7e-a2883f15824b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:53.166356 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92593b21-f02f-4c7d-bb7e-a2883f15824b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:27:53.168176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92593b21-f02f-4c7d-bb7e-a2883f15824b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:27:53.177386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 4/8] 10.222.0.76 () {58 vars in 1324 bytes} [Thu May 12 17:27:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 17:27:53.183259 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f457d57-9541-4518-b0dd-2018a9a8dc9c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:53.192412 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f457d57-9541-4518-b0dd-2018a9a8dc9c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:53.196878 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec0ae8-866f-4d87-849d-f27f93945b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:53.197820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec0ae8-866f-4d87-849d-f27f93945b9e admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:53.198171 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec0ae8-866f-4d87-849d-f27f93945b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:53.198515 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec0ae8-866f-4d87-849d-f27f93945b9e admin admin] PATH_INFO: `/v3/users/fcec6386453a4aeb83b0960ebf40f96e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:53.200026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec0ae8-866f-4d87-849d-f27f93945b9e admin admin] RBAC: Authorizing `identity:get_user(user_id=fcec6386453a4aeb83b0960ebf40f96e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:27:53.201943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec0ae8-866f-4d87-849d-f27f93945b9e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:27:53.203813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 5/9] 10.222.0.76 () {56 vars in 1198 bytes} [Thu May 12 17:27:53 2022] GET /identity/v3/users/fcec6386453a4aeb83b0960ebf40f96e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:27:55.515746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f72c6d-038c-4cb3-8fb2-39cb95a2a403 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:55.516241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f72c6d-038c-4cb3-8fb2-39cb95a2a403 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:55.516241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f72c6d-038c-4cb3-8fb2-39cb95a2a403 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:55.517561 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 5/10] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:27:55.523163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945ae4-555c-460c-aab6-482487640b48 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:55.523585 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945ae4-555c-460c-aab6-482487640b48 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:55.523707 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945ae4-555c-460c-aab6-482487640b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:55.553266 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc2216-1447-4d91-99e9-cf266ea69352 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:55.553580 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc2216-1447-4d91-99e9-cf266ea69352 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:55.553811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc2216-1447-4d91-99e9-cf266ea69352 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:55.555714 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 6/11] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:27:55.561649 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad3fc-1877-44de-aa1b-97a6d67f0e14 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:55.561930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad3fc-1877-44de-aa1b-97a6d67f0e14 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:55.562368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad3fc-1877-44de-aa1b-97a6d67f0e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:55.604108 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG passlib.handlers.bcrypt [None req-359ad3fc-1877-44de-aa1b-97a6d67f0e14 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80137) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 17:27:55.604531 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG passlib.handlers.bcrypt [None req-359ad3fc-1877-44de-aa1b-97a6d67f0e14 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80137) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 17:27:55.649820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-3e945ae4-555c-460c-aab6-482487640b48 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:27:55.651126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3e945ae4-555c-460c-aab6-482487640b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:27:55.652351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-359ad3fc-1877-44de-aa1b-97a6d67f0e14 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:27:55.653926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-359ad3fc-1877-44de-aa1b-97a6d67f0e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:27:55.730708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 6/12] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:27:55.753092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e945ae4-555c-460c-aab6-482487640b48 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:55.755710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 7/13] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:27:55.778515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ad3fc-1877-44de-aa1b-97a6d67f0e14 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:55.853753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e945ae4-555c-460c-aab6-482487640b48 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:55.876074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ad3fc-1877-44de-aa1b-97a6d67f0e14 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:55.887991 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc6b89-4a97-4c2b-9e6a-6d19f65fc8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:55.888977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6b89-4a97-4c2b-9e6a-6d19f65fc8aa None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:55.889413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6b89-4a97-4c2b-9e6a-6d19f65fc8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:55.889822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6b89-4a97-4c2b-9e6a-6d19f65fc8aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:55.901035 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc6b89-4a97-4c2b-9e6a-6d19f65fc8aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:27:55.909361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53037-bdc5-43ae-b067-170d71d0b3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:55.910557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53037-bdc5-43ae-b067-170d71d0b3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:55.910874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53037-bdc5-43ae-b067-170d71d0b3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:55.911157 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53037-bdc5-43ae-b067-170d71d0b3e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-99cc6b89-4a97-4c2b-9e6a-6d19f65fc8aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:27:55.912245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:27:55.913084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:27:55.913859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:27:55.913859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:27:55.913859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:27:55.913859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:27:55.913859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:27:55.913859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:27:55.913859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:27:55.913859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:27:55.913859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:27:55.913859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:27:55.913859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:27:55.913859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:27:55.918855 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 7/14] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:27:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:27:55.920135 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc6b89-4a97-4c2b-9e6a-6d19f65fc8aa None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:55.983149 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e53037-bdc5-43ae-b067-170d71d0b3e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:27:55.984724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e53037-bdc5-43ae-b067-170d71d0b3e4 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:27:56.028187 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc6b89-4a97-4c2b-9e6a-6d19f65fc8aa None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:56.064332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a50fd0-da1a-4b52-938d-14713fec8d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:56.064931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a50fd0-da1a-4b52-938d-14713fec8d5a None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:56.065213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a50fd0-da1a-4b52-938d-14713fec8d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:56.065488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a50fd0-da1a-4b52-938d-14713fec8d5a None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:56.066489 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a50fd0-da1a-4b52-938d-14713fec8d5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:27:56.066832 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a50fd0-da1a-4b52-938d-14713fec8d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:27:56.068249 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a50fd0-da1a-4b52-938d-14713fec8d5a None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:27:56.081100 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 8/15] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:27:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:27:56.087429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a50fd0-da1a-4b52-938d-14713fec8d5a None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:56.096193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 8/16] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:27:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 17:27:56.100527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53037-bdc5-43ae-b067-170d71d0b3e4 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:56.184071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a50fd0-da1a-4b52-938d-14713fec8d5a None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:56.195465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53037-bdc5-43ae-b067-170d71d0b3e4 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:56.218071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16b816-9806-40d8-8b81-ba8bc3e252ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:56.218972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16b816-9806-40d8-8b81-ba8bc3e252ba None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:56.219257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16b816-9806-40d8-8b81-ba8bc3e252ba None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:56.219529 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16b816-9806-40d8-8b81-ba8bc3e252ba None admin] PATH_INFO: `/v3/users/fcec6386453a4aeb83b0960ebf40f96e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:56.220720 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16b816-9806-40d8-8b81-ba8bc3e252ba None admin] RBAC: Authorizing `identity:get_user(user_id=fcec6386453a4aeb83b0960ebf40f96e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:27:56.222168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16b816-9806-40d8-8b81-ba8bc3e252ba None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:27:56.223838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 9/17] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:27:56 2022] GET /identity/v3/users/fcec6386453a4aeb83b0960ebf40f96e => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:27:56.227210 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e25b8a-84d9-40dc-aff7-014e6015d685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:56.227999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e25b8a-84d9-40dc-aff7-014e6015d685 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:56.228278 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e25b8a-84d9-40dc-aff7-014e6015d685 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:56.228551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e25b8a-84d9-40dc-aff7-014e6015d685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:56.229282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16b816-9806-40d8-8b81-ba8bc3e252ba None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:56.331475 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16b816-9806-40d8-8b81-ba8bc3e252ba None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:56.355966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e25b8a-84d9-40dc-aff7-014e6015d685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:27:56.357422 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e25b8a-84d9-40dc-aff7-014e6015d685 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:27:56.365273 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914b717-ba79-4fd8-accd-6017c020dd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:56.366060 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914b717-ba79-4fd8-accd-6017c020dd5b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:56.366339 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914b717-ba79-4fd8-accd-6017c020dd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:56.366606 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914b717-ba79-4fd8-accd-6017c020dd5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:56.367803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914b717-ba79-4fd8-accd-6017c020dd5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:27:56.369241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914b717-ba79-4fd8-accd-6017c020dd5b None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:27:56.370861 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 10/18] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:27:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:27:56.376601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914b717-ba79-4fd8-accd-6017c020dd5b None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-63e25b8a-84d9-40dc-aff7-014e6015d685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:27:56.378145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:27:56.379965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:27:56.380971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:27:56.380971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:27:56.380971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:27:56.380971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:27:56.380971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 9/19] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:27:56.387563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e25b8a-84d9-40dc-aff7-014e6015d685 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:56.474390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914b717-ba79-4fd8-accd-6017c020dd5b None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:56.483261 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e25b8a-84d9-40dc-aff7-014e6015d685 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:56.506815 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af74153-42c0-4e5d-b60d-8ce2bb36dc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:56.507716 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af74153-42c0-4e5d-b60d-8ce2bb36dc3e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:56.507994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af74153-42c0-4e5d-b60d-8ce2bb36dc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:56.508263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af74153-42c0-4e5d-b60d-8ce2bb36dc3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:56.509086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af74153-42c0-4e5d-b60d-8ce2bb36dc3e None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.domain.id=default, user.id=fcec6386453a4aeb83b0960ebf40f96e) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:27:56.509388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af74153-42c0-4e5d-b60d-8ce2bb36dc3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:27:56.510839 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af74153-42c0-4e5d-b60d-8ce2bb36dc3e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:27:56.517285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 11/20] 10.222.0.76 () {56 vars in 1322 bytes} [Thu May 12 17:27:56 2022] GET /identity/v3/role_assignments?user.id=fcec6386453a4aeb83b0960ebf40f96e&scope.domain.id=default&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 233 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:27:56.517756 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8fc61-4244-438d-98ab-17bf7d47e6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:56.518421 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8fc61-4244-438d-98ab-17bf7d47e6bb None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:56.518733 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8fc61-4244-438d-98ab-17bf7d47e6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:56.519092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8fc61-4244-438d-98ab-17bf7d47e6bb None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:56.520728 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8fc61-4244-438d-98ab-17bf7d47e6bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:27:56.521043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8fc61-4244-438d-98ab-17bf7d47e6bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:27:56.522472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8fc61-4244-438d-98ab-17bf7d47e6bb None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:27:56.542048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 10/21] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:27:59.015883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4d45d-44b8-44ee-925a-4cc23ceed440 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:59.016787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4d45d-44b8-44ee-925a-4cc23ceed440 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:59.017238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4d45d-44b8-44ee-925a-4cc23ceed440 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:59.018827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 12/22] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:27:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:27:59.035643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aee568-69a1-41b9-b3f8-ff44c2c5b8a9 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:59.036123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aee568-69a1-41b9-b3f8-ff44c2c5b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:59.036195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aee568-69a1-41b9-b3f8-ff44c2c5b8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:59.059669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-25aee568-69a1-41b9-b3f8-ff44c2c5b8a9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:27:59.061138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-25aee568-69a1-41b9-b3f8-ff44c2c5b8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:27:59.141349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 11/23] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:27:59.177767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4d45d-44b8-44ee-925a-4cc23ceed440 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:59.321156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4d45d-44b8-44ee-925a-4cc23ceed440 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:59.357254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ad1e-b790-408b-8130-db550663b64e None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:59.357867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ad1e-b790-408b-8130-db550663b64e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:59.358338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07ad1e-b790-408b-8130-db550663b64e None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:59.359943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 12/24] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:27:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:27:59.365720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1822d92-36ce-4b5e-af64-71346a10431b None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:59.366311 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1822d92-36ce-4b5e-af64-71346a10431b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:59.366620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b79848-3140-419a-85b1-8cd0089e6d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:59.367075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1822d92-36ce-4b5e-af64-71346a10431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:59.367429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b79848-3140-419a-85b1-8cd0089e6d1c None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:59.367711 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b79848-3140-419a-85b1-8cd0089e6d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:59.367987 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b79848-3140-419a-85b1-8cd0089e6d1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:59.384266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b79848-3140-419a-85b1-8cd0089e6d1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:27:59.385992 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-b1822d92-36ce-4b5e-af64-71346a10431b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:27:59.387424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b1822d92-36ce-4b5e-af64-71346a10431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-40b79848-3140-419a-85b1-8cd0089e6d1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:27:59.391899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:27:59.392748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:27:59.393518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:27:59.393518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:27:59.393518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:27:59.393518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:27:59.393518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:27:59.393518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:27:59.393518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:27:59.393518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:27:59.393518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:27:59.393518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:27:59.393518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:27:59.393518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:27:59.393518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 13/25] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:27:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:27:59.401682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b79848-3140-419a-85b1-8cd0089e6d1c None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:59.485090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 13/26] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:27:59.513473 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b79848-3140-419a-85b1-8cd0089e6d1c None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:59.532662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1822d92-36ce-4b5e-af64-71346a10431b None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:59.560392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad7d8c-6776-4221-b2fa-90305e8c62fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:59.561063 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7d8c-6776-4221-b2fa-90305e8c62fa None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:59.561342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7d8c-6776-4221-b2fa-90305e8c62fa None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:59.561613 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7d8c-6776-4221-b2fa-90305e8c62fa None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:59.562366 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad7d8c-6776-4221-b2fa-90305e8c62fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:27:59.562685 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad7d8c-6776-4221-b2fa-90305e8c62fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:27:59.564236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad7d8c-6776-4221-b2fa-90305e8c62fa None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:27:59.578138 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 14/27] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:27:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:27:59.584176 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad7d8c-6776-4221-b2fa-90305e8c62fa None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:59.702173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1822d92-36ce-4b5e-af64-71346a10431b None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:59.755056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb2cf1-daae-4139-80c2-a360704b7d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:59.755856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb2cf1-daae-4139-80c2-a360704b7d85 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:59.756139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb2cf1-daae-4139-80c2-a360704b7d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:59.756413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb2cf1-daae-4139-80c2-a360704b7d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:59.775468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb2cf1-daae-4139-80c2-a360704b7d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:27:59.776969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb2cf1-daae-4139-80c2-a360704b7d85 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:27:59.801401 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad7d8c-6776-4221-b2fa-90305e8c62fa None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-1abb2cf1-daae-4139-80c2-a360704b7d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:27:59.807991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:27:59.808867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:27:59.810207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:27:59.810207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:27:59.810207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:27:59.810207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:27:59.810207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 14/28] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:27:59.815517 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb2cf1-daae-4139-80c2-a360704b7d85 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:27:59.893649 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef81083-25c2-4422-877e-f0332ade37d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:27:59.895099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef81083-25c2-4422-877e-f0332ade37d6 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:27:59.895586 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef81083-25c2-4422-877e-f0332ade37d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:27:59.896059 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef81083-25c2-4422-877e-f0332ade37d6 None admin] PATH_INFO: `/v3/users/fcec6386453a4aeb83b0960ebf40f96e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:27:59.903504 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef81083-25c2-4422-877e-f0332ade37d6 None admin] RBAC: Authorizing `identity:get_user(user_id=fcec6386453a4aeb83b0960ebf40f96e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:27:59.905011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef81083-25c2-4422-877e-f0332ade37d6 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:27:59.906770 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 15/29] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:27:59 2022] GET /identity/v3/users/fcec6386453a4aeb83b0960ebf40f96e => generated 247 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:27:59.912724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef81083-25c2-4422-877e-f0332ade37d6 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:00.005531 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb2cf1-daae-4139-80c2-a360704b7d85 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:00.069370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a75df-ce56-4e99-b54e-4948537f441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:00.070050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a75df-ce56-4e99-b54e-4948537f441f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:00.070494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a75df-ce56-4e99-b54e-4948537f441f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:00.070953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a75df-ce56-4e99-b54e-4948537f441f None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:00.071833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a75df-ce56-4e99-b54e-4948537f441f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:00.072325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a75df-ce56-4e99-b54e-4948537f441f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:00.073927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a75df-ce56-4e99-b54e-4948537f441f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:00.096977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 15/30] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:00.103362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a75df-ce56-4e99-b54e-4948537f441f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:00.108547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef81083-25c2-4422-877e-f0332ade37d6 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:00.157733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f6edd-1911-4d12-adeb-cb97993fb14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:00.158449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f6edd-1911-4d12-adeb-cb97993fb14f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:00.158760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f6edd-1911-4d12-adeb-cb97993fb14f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:00.159045 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f6edd-1911-4d12-adeb-cb97993fb14f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:00.160911 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f6edd-1911-4d12-adeb-cb97993fb14f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:00.162506 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f6edd-1911-4d12-adeb-cb97993fb14f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:00.164695 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 16/31] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:27:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:00.166131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43376534-fb3d-44c8-913c-4b16c2f0e0c1 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:00.166554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43376534-fb3d-44c8-913c-4b16c2f0e0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:00.166986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43376534-fb3d-44c8-913c-4b16c2f0e0c1 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:00.168349 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 17/32] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:00.169636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940013a4-72eb-4aee-a58b-22649430c133 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:00.170075 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940013a4-72eb-4aee-a58b-22649430c133 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:00.170496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940013a4-72eb-4aee-a58b-22649430c133 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:00.172208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 18/33] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:00.173570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772cf15-dda4-4bcc-8945-24541cccfe82 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:00.174067 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772cf15-dda4-4bcc-8945-24541cccfe82 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:00.174613 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772cf15-dda4-4bcc-8945-24541cccfe82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:00.194496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-d772cf15-dda4-4bcc-8945-24541cccfe82 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:00.196145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d772cf15-dda4-4bcc-8945-24541cccfe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:00.241590 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a75df-ce56-4e99-b54e-4948537f441f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:00.273433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 19/34] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:00.274721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772cf15-dda4-4bcc-8945-24541cccfe82 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:00.278697 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad78ad-85a5-49cc-9b66-63e56f1c0e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:00.279592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad78ad-85a5-49cc-9b66-63e56f1c0e0b None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:00.280041 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad78ad-85a5-49cc-9b66-63e56f1c0e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:00.280478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad78ad-85a5-49cc-9b66-63e56f1c0e0b None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:00.281630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad78ad-85a5-49cc-9b66-63e56f1c0e0b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:00.283526 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad78ad-85a5-49cc-9b66-63e56f1c0e0b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:00.381372 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772cf15-dda4-4bcc-8945-24541cccfe82 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:00.416250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1b3d7-0d52-4459-9a9b-118c95d1ef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:00.417103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1b3d7-0d52-4459-9a9b-118c95d1ef2d None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:00.417383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1b3d7-0d52-4459-9a9b-118c95d1ef2d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:00.417714 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1b3d7-0d52-4459-9a9b-118c95d1ef2d None admin] PATH_INFO: `/v3/domains/default/users/fcec6386453a4aeb83b0960ebf40f96e/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:00.419877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1b3d7-0d52-4459-9a9b-118c95d1ef2d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fcec6386453a4aeb83b0960ebf40f96e, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:00.421332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1b3d7-0d52-4459-9a9b-118c95d1ef2d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:00.433161 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 16/35] 10.222.0.76 () {60 vars in 1141 bytes} [Thu May 12 17:28:00 2022] POST /identity/v3/projects => generated 301 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:00.434653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ab71-1873-49d5-934d-52fac5d09e0d None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:00.435043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ab71-1873-49d5-934d-52fac5d09e0d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:00.435329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ab71-1873-49d5-934d-52fac5d09e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:00.454475 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ca14ab71-1873-49d5-934d-52fac5d09e0d None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:00.456099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ca14ab71-1873-49d5-934d-52fac5d09e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:00.539868 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 17/36] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:00.540482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14ab71-1873-49d5-934d-52fac5d09e0d None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:00.559106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 20/37] 10.222.0.76 () {58 vars in 1361 bytes} [Thu May 12 17:28:00 2022] PUT /identity/v3/domains/default/users/fcec6386453a4aeb83b0960ebf40f96e/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:28:00.561445 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10248a17-8db8-4b86-ad04-22e8b05505e7 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:00.562003 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10248a17-8db8-4b86-ad04-22e8b05505e7 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:00.562512 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10248a17-8db8-4b86-ad04-22e8b05505e7 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:00.568493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 21/38] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:00.576312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c3e58-9aee-42c2-8356-4c0ab5fb7c1c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:00.577134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c3e58-9aee-42c2-8356-4c0ab5fb7c1c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:00.577134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c3e58-9aee-42c2-8356-4c0ab5fb7c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:00.613653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-df2c3e58-9aee-42c2-8356-4c0ab5fb7c1c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:00.615310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-df2c3e58-9aee-42c2-8356-4c0ab5fb7c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:00.718293 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14ab71-1873-49d5-934d-52fac5d09e0d None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:00.730861 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 22/39] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:00.732163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c3e58-9aee-42c2-8356-4c0ab5fb7c1c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:00.782587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72690e-7e43-4331-aa42-a9242aee4433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:00.784317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72690e-7e43-4331-aa42-a9242aee4433 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:00.785528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72690e-7e43-4331-aa42-a9242aee4433 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:00.786209 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72690e-7e43-4331-aa42-a9242aee4433 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:00.787655 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72690e-7e43-4331-aa42-a9242aee4433 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:00.789799 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72690e-7e43-4331-aa42-a9242aee4433 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:00.813380 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 18/40] 10.222.0.76 () {60 vars in 1131 bytes} [Thu May 12 17:28:00 2022] POST /identity/v3/roles => generated 219 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:00.814763 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72690e-7e43-4331-aa42-a9242aee4433 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:00.889050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c3e58-9aee-42c2-8356-4c0ab5fb7c1c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:00.932397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72690e-7e43-4331-aa42-a9242aee4433 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:00.936428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23eeccf-277a-4d16-b6a9-07d968bc53de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:00.937217 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eeccf-277a-4d16-b6a9-07d968bc53de None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:00.937504 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eeccf-277a-4d16-b6a9-07d968bc53de None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:00.937777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eeccf-277a-4d16-b6a9-07d968bc53de None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:00.938539 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23eeccf-277a-4d16-b6a9-07d968bc53de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:00.940637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23eeccf-277a-4d16-b6a9-07d968bc53de None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:00.967721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 23/41] 10.222.0.76 () {60 vars in 1131 bytes} [Thu May 12 17:28:00 2022] POST /identity/v3/roles => generated 225 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:00.998412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b68dae-a454-48ae-bd1c-e306623750d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:00.999232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68dae-a454-48ae-bd1c-e306623750d0 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:00.999520 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68dae-a454-48ae-bd1c-e306623750d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:00.999800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68dae-a454-48ae-bd1c-e306623750d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:01.000595 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b68dae-a454-48ae-bd1c-e306623750d0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:01.002069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b68dae-a454-48ae-bd1c-e306623750d0 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:01.012491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f7f7b-d768-4572-b44d-75e75c62f532 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:01.012830 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f7f7b-d768-4572-b44d-75e75c62f532 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:01.013067 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f7f7b-d768-4572-b44d-75e75c62f532 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:01.014602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 24/42] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:28:01.024329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf6f53-e6c2-41ef-a6fc-752374473e72 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:01.024648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf6f53-e6c2-41ef-a6fc-752374473e72 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:01.024937 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf6f53-e6c2-41ef-a6fc-752374473e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:01.026852 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 19/43] 10.222.0.76 () {60 vars in 1131 bytes} [Thu May 12 17:28:00 2022] POST /identity/v3/roles => generated 223 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:01.060869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-2aaf6f53-e6c2-41ef-a6fc-752374473e72 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:01.062460 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-2aaf6f53-e6c2-41ef-a6fc-752374473e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:01.158418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 25/44] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:01.186587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b68dae-a454-48ae-bd1c-e306623750d0 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:01.300869 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b68dae-a454-48ae-bd1c-e306623750d0 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:01.340054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a287a-d681-483d-92a1-77aeaad443ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:01.340865 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a287a-d681-483d-92a1-77aeaad443ce None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:01.341145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a287a-d681-483d-92a1-77aeaad443ce None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:01.341419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a287a-d681-483d-92a1-77aeaad443ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:01.342607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a287a-d681-483d-92a1-77aeaad443ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:01.344189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a287a-d681-483d-92a1-77aeaad443ce None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:01.345828 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 20/45] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:28:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:01.351449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf6f53-e6c2-41ef-a6fc-752374473e72 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:01.445812 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf6f53-e6c2-41ef-a6fc-752374473e72 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:01.477704 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b1cd5-5988-4be9-99da-059df2d60f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:01.478356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b1cd5-5988-4be9-99da-059df2d60f71 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:01.478643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b1cd5-5988-4be9-99da-059df2d60f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:01.478951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b1cd5-5988-4be9-99da-059df2d60f71 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:01.479671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b1cd5-5988-4be9-99da-059df2d60f71 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:01.481134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b1cd5-5988-4be9-99da-059df2d60f71 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:01.507737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 26/46] 10.222.0.76 () {60 vars in 1141 bytes} [Thu May 12 17:28:01 2022] POST /identity/v3/projects => generated 312 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:03.083905 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9729b-614b-428f-817d-8ba26141e75b None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:03.084468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9729b-614b-428f-817d-8ba26141e75b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:03.084468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9729b-614b-428f-817d-8ba26141e75b None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:03.085807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 21/47] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:28:03.091147 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952c036-dfd4-454c-9967-0e513976383f None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:03.091545 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952c036-dfd4-454c-9967-0e513976383f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:03.091814 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952c036-dfd4-454c-9967-0e513976383f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:03.108104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-6952c036-dfd4-454c-9967-0e513976383f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:03.109290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6952c036-dfd4-454c-9967-0e513976383f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:03.172779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 27/48] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:03.196612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9729b-614b-428f-817d-8ba26141e75b None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:03.295589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9729b-614b-428f-817d-8ba26141e75b None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:03.328471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4c521-d850-4c8c-9147-452a302edc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:03.329257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4c521-d850-4c8c-9147-452a302edc03 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:03.329542 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4c521-d850-4c8c-9147-452a302edc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:03.329822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4c521-d850-4c8c-9147-452a302edc03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:03.341514 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4c521-d850-4c8c-9147-452a302edc03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-2da4c521-d850-4c8c-9147-452a302edc03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:03.350509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:03.351581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:03.352340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:03.352340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:03.352340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:03.352340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:03.352340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:03.352340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:03.352340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:03.352340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:03.352340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:03.352340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:03.352340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:03.352340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:03.352340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 22/49] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:28:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:03.357626 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952c036-dfd4-454c-9967-0e513976383f None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:03.450992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952c036-dfd4-454c-9967-0e513976383f None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:03.482612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92651a-7c9e-44dd-a22f-c3cc077edcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:03.483307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92651a-7c9e-44dd-a22f-c3cc077edcdd None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:03.483592 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92651a-7c9e-44dd-a22f-c3cc077edcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:03.483872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92651a-7c9e-44dd-a22f-c3cc077edcdd None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:03.484624 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92651a-7c9e-44dd-a22f-c3cc077edcdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:03.484933 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92651a-7c9e-44dd-a22f-c3cc077edcdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:03.486326 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92651a-7c9e-44dd-a22f-c3cc077edcdd None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:03.494907 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 28/50] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:03.500332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4c521-d850-4c8c-9147-452a302edc03 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:03.603129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4c521-d850-4c8c-9147-452a302edc03 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:03.635843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0771de-0d57-48f0-b32a-6afac6e9c7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:03.636720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0771de-0d57-48f0-b32a-6afac6e9c7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:03.637007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0771de-0d57-48f0-b32a-6afac6e9c7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:03.637285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0771de-0d57-48f0-b32a-6afac6e9c7e6 None admin] PATH_INFO: `/v3/users/fcec6386453a4aeb83b0960ebf40f96e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:03.638785 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0771de-0d57-48f0-b32a-6afac6e9c7e6 None admin] RBAC: Authorizing `identity:get_user(user_id=fcec6386453a4aeb83b0960ebf40f96e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:03.640251 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0771de-0d57-48f0-b32a-6afac6e9c7e6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:03.641873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 23/51] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:03 2022] GET /identity/v3/users/fcec6386453a4aeb83b0960ebf40f96e => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:03.648080 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92651a-7c9e-44dd-a22f-c3cc077edcdd None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:03.746833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92651a-7c9e-44dd-a22f-c3cc077edcdd None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:03.748157 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c7c26-2554-497d-aab7-8f1c91fed108 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:03.748456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c7c26-2554-497d-aab7-8f1c91fed108 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:03.748741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c7c26-2554-497d-aab7-8f1c91fed108 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:03.750118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 24/52] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:28:03.755877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ed131-10fa-4edf-9281-470dc8c1ee60 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:03.756178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ed131-10fa-4edf-9281-470dc8c1ee60 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:03.756455 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ed131-10fa-4edf-9281-470dc8c1ee60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:03.773009 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-1b9ed131-10fa-4edf-9281-470dc8c1ee60 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:03.774314 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1b9ed131-10fa-4edf-9281-470dc8c1ee60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:03.779430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5ccb8-5dd9-4417-bebc-e7fd2b213d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:03.780219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5ccb8-5dd9-4417-bebc-e7fd2b213d46 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:03.780502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5ccb8-5dd9-4417-bebc-e7fd2b213d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:03.780779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5ccb8-5dd9-4417-bebc-e7fd2b213d46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:03.781940 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5ccb8-5dd9-4417-bebc-e7fd2b213d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:03.783433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5ccb8-5dd9-4417-bebc-e7fd2b213d46 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:03.790157 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 29/53] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:28:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:03.791216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5ccb8-5dd9-4417-bebc-e7fd2b213d46 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:03.838120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 25/54] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:03.861631 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ed131-10fa-4edf-9281-470dc8c1ee60 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:03.886398 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5ccb8-5dd9-4417-bebc-e7fd2b213d46 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:03.917986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55456b-49ba-4974-9111-5e326f9da0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:03.918635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55456b-49ba-4974-9111-5e326f9da0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:03.918945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55456b-49ba-4974-9111-5e326f9da0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:03.919219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55456b-49ba-4974-9111-5e326f9da0f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:03.920039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55456b-49ba-4974-9111-5e326f9da0f2 None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.domain.id=default, user.id=fcec6386453a4aeb83b0960ebf40f96e) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:03.920347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55456b-49ba-4974-9111-5e326f9da0f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:03.921773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55456b-49ba-4974-9111-5e326f9da0f2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:03.928227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 30/55] 10.222.0.76 () {56 vars in 1322 bytes} [Thu May 12 17:28:03 2022] GET /identity/v3/role_assignments?user.id=fcec6386453a4aeb83b0960ebf40f96e&scope.domain.id=default&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 530 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:03.957303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ed131-10fa-4edf-9281-470dc8c1ee60 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:03.993759 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5a5fa-bbf0-4dea-b018-e4e37eb9bf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:03.994580 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a5fa-bbf0-4dea-b018-e4e37eb9bf77 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:03.994895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a5fa-bbf0-4dea-b018-e4e37eb9bf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:03.995176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a5fa-bbf0-4dea-b018-e4e37eb9bf77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:03.996459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5a5fa-bbf0-4dea-b018-e4e37eb9bf77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:03.997926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5a5fa-bbf0-4dea-b018-e4e37eb9bf77 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:03.999654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 26/56] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:28:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:04.005887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55456b-49ba-4974-9111-5e326f9da0f2 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:04.108049 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55456b-49ba-4974-9111-5e326f9da0f2 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:04.146595 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95440a-508c-4a6c-a330-64370b208635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:04.147219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95440a-508c-4a6c-a330-64370b208635 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:04.147505 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95440a-508c-4a6c-a330-64370b208635 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:04.147786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95440a-508c-4a6c-a330-64370b208635 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:04.148513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95440a-508c-4a6c-a330-64370b208635 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:04.149979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95440a-508c-4a6c-a330-64370b208635 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:04.175695 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 31/57] 10.222.0.76 () {60 vars in 1140 bytes} [Thu May 12 17:28:04 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:06.417982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dd4c5-86c4-49e7-b6b6-792eec725a37 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:06.418527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dd4c5-86c4-49e7-b6b6-792eec725a37 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:06.418527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dd4c5-86c4-49e7-b6b6-792eec725a37 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:06.419922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 27/58] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:06.425805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda574e-e604-48ef-9127-39352337b03a None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:06.426411 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda574e-e604-48ef-9127-39352337b03a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:06.426411 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda574e-e604-48ef-9127-39352337b03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:06.442903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-6eda574e-e604-48ef-9127-39352337b03a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:06.444095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6eda574e-e604-48ef-9127-39352337b03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:06.506143 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 32/59] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:06.530560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dd4c5-86c4-49e7-b6b6-792eec725a37 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:06.625990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dd4c5-86c4-49e7-b6b6-792eec725a37 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:06.658459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498799b3-3935-41a3-b72e-b42e8dca32eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:06.659265 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498799b3-3935-41a3-b72e-b42e8dca32eb None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:06.660077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498799b3-3935-41a3-b72e-b42e8dca32eb None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:06.660359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498799b3-3935-41a3-b72e-b42e8dca32eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:06.661523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498799b3-3935-41a3-b72e-b42e8dca32eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:06.663002 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498799b3-3935-41a3-b72e-b42e8dca32eb None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:06.664608 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 28/60] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:28:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:06.670141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda574e-e604-48ef-9127-39352337b03a None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:06.763823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda574e-e604-48ef-9127-39352337b03a None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:06.795439 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde6d63-c50f-403b-b970-b70b6907f98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:06.796091 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde6d63-c50f-403b-b970-b70b6907f98f None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:06.796368 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde6d63-c50f-403b-b970-b70b6907f98f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:06.796641 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde6d63-c50f-403b-b970-b70b6907f98f None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:06.797332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde6d63-c50f-403b-b970-b70b6907f98f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:06.798800 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde6d63-c50f-403b-b970-b70b6907f98f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:06.823537 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 33/61] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:28:06 2022] POST /identity/v3/users => generated 275 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:10.375875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08d00d-e232-46aa-b474-b2a313109ada None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:10.376886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08d00d-e232-46aa-b474-b2a313109ada None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:10.377375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08d00d-e232-46aa-b474-b2a313109ada None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:10.379630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 29/62] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:10.385449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca6c0f-9209-4c27-94ab-c4e1ee352b25 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:10.385882 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca6c0f-9209-4c27-94ab-c4e1ee352b25 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:10.385986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca6c0f-9209-4c27-94ab-c4e1ee352b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:10.407835 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-b9ca6c0f-9209-4c27-94ab-c4e1ee352b25 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:10.409047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b9ca6c0f-9209-4c27-94ab-c4e1ee352b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:10.476496 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe76bb-eadf-4edf-9a75-df291951b1b7 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:10.477180 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe76bb-eadf-4edf-9a75-df291951b1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:10.477696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe76bb-eadf-4edf-9a75-df291951b1b7 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:10.479713 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 30/63] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:10.484920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc4906-0f84-4f3d-aede-05c5d7a13d9a None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:10.485427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc4906-0f84-4f3d-aede-05c5d7a13d9a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:10.485903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc4906-0f84-4f3d-aede-05c5d7a13d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:10.495962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 34/64] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:10.506568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9a063-1163-4f7b-b654-1f97701ec627 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:10.506886 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9a063-1163-4f7b-b654-1f97701ec627 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:10.507154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9a063-1163-4f7b-b654-1f97701ec627 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:10.509014 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 35/65] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:10.514859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38077-6501-4c64-a0f6-423db5b4d138 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:10.515439 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38077-6501-4c64-a0f6-423db5b4d138 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:10.515921 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38077-6501-4c64-a0f6-423db5b4d138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:10.520156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-3dbc4906-0f84-4f3d-aede-05c5d7a13d9a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:10.521298 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3dbc4906-0f84-4f3d-aede-05c5d7a13d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:10.535512 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-72b38077-6501-4c64-a0f6-423db5b4d138 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:10.536752 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-72b38077-6501-4c64-a0f6-423db5b4d138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:10.606807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 31/66] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:10.607727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc4906-0f84-4f3d-aede-05c5d7a13d9a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:10.622371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 36/67] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:10.635226 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38077-6501-4c64-a0f6-423db5b4d138 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:10.745742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc4906-0f84-4f3d-aede-05c5d7a13d9a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:10.745926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38077-6501-4c64-a0f6-423db5b4d138 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:10.780817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545698b-d410-4d1e-8c91-68f961ef05b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:10.781531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545698b-d410-4d1e-8c91-68f961ef05b3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:10.781813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545698b-d410-4d1e-8c91-68f961ef05b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:10.782092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545698b-d410-4d1e-8c91-68f961ef05b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:10.786974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3f304-ee23-45d6-8af0-beeeadfdf355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:10.787738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3f304-ee23-45d6-8af0-beeeadfdf355 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:10.788033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3f304-ee23-45d6-8af0-beeeadfdf355 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:10.788313 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3f304-ee23-45d6-8af0-beeeadfdf355 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:10.793131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545698b-d410-4d1e-8c91-68f961ef05b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:10.798471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3f304-ee23-45d6-8af0-beeeadfdf355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-5545698b-d410-4d1e-8c91-68f961ef05b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:10.801333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:10.802160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:10.803291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:10.803291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:10.803291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:10.803291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:10.803291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:10.803291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:10.803291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:10.803291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:10.803291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:10.803291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:10.803291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:10.803291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:10.803291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 37/68] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:28:10.803915 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545698b-d410-4d1e-8c91-68f961ef05b3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-48a3f304-ee23-45d6-8af0-beeeadfdf355 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:10.812187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:10.813232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:10.814174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:10.814174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:10.814174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:10.814174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:10.814174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:10.814174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:10.814174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:10.814174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:10.814174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:10.814174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:10.814174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:10.814174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:10.814174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 32/69] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:28:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:10.814964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff52b2-bedf-4f85-a3db-aa7afbdb7563 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:10.814964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff52b2-bedf-4f85-a3db-aa7afbdb7563 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:10.815185 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff52b2-bedf-4f85-a3db-aa7afbdb7563 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:10.820800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 33/70] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:10.822183 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff52b2-bedf-4f85-a3db-aa7afbdb7563 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:10.902758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545698b-d410-4d1e-8c91-68f961ef05b3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:10.919745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff52b2-bedf-4f85-a3db-aa7afbdb7563 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:10.934391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a050a-0897-462a-840d-89bfbb772db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:10.935332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a050a-0897-462a-840d-89bfbb772db2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:10.935614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a050a-0897-462a-840d-89bfbb772db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:10.935897 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a050a-0897-462a-840d-89bfbb772db2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:10.946262 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a050a-0897-462a-840d-89bfbb772db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:10.952214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa4b5f-df97-41ce-8b86-d654b5f2171b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:10.952872 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa4b5f-df97-41ce-8b86-d654b5f2171b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:10.953179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa4b5f-df97-41ce-8b86-d654b5f2171b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:10.953457 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa4b5f-df97-41ce-8b86-d654b5f2171b None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-3f2a050a-0897-462a-840d-89bfbb772db2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:10.953794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:10.954822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:10.955790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:10.955790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:10.955790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:10.955790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:10.955790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:10.955790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:10.955790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:10.955790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:10.955790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:10.955790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:10.955790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:10.955790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:10.956631 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa4b5f-df97-41ce-8b86-d654b5f2171b None admin] RBAC: Adding query filter params (name=member) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:10.956631 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa4b5f-df97-41ce-8b86-d654b5f2171b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:10.956757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 38/71] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:28:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:10.956822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa4b5f-df97-41ce-8b86-d654b5f2171b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:10.956885 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a050a-0897-462a-840d-89bfbb772db2 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:10.967685 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 34/72] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:10.968956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4539fda-7a74-45c4-aa63-881d9f12b1cd None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:10.969248 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4539fda-7a74-45c4-aa63-881d9f12b1cd None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:10.969528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4539fda-7a74-45c4-aa63-881d9f12b1cd None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:10.970908 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 35/73] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:10.971842 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f956c6-a81e-4b30-b6ad-986f91c07fe5 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:10.972177 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f956c6-a81e-4b30-b6ad-986f91c07fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:10.972773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f956c6-a81e-4b30-b6ad-986f91c07fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:10.989580 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-14f956c6-a81e-4b30-b6ad-986f91c07fe5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:10.990794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-14f956c6-a81e-4b30-b6ad-986f91c07fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:11.053845 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a050a-0897-462a-840d-89bfbb772db2 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:11.054004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 36/74] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:11.054844 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f956c6-a81e-4b30-b6ad-986f91c07fe5 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:11.087310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c417763-8b92-4081-bc7a-c146bee581c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:11.087977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c417763-8b92-4081-bc7a-c146bee581c4 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:11.088263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c417763-8b92-4081-bc7a-c146bee581c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:11.088542 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c417763-8b92-4081-bc7a-c146bee581c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:11.089291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c417763-8b92-4081-bc7a-c146bee581c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:11.089597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c417763-8b92-4081-bc7a-c146bee581c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:11.091024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c417763-8b92-4081-bc7a-c146bee581c4 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:11.099070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 39/75] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:28:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:11.099859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c417763-8b92-4081-bc7a-c146bee581c4 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:11.153905 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f956c6-a81e-4b30-b6ad-986f91c07fe5 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:11.187062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621f3ed-2a7d-414f-ba62-44e1e3c09315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:11.187752 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f3ed-2a7d-414f-ba62-44e1e3c09315 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:11.188027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f3ed-2a7d-414f-ba62-44e1e3c09315 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:11.188300 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f3ed-2a7d-414f-ba62-44e1e3c09315 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:11.189039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621f3ed-2a7d-414f-ba62-44e1e3c09315 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:11.189339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621f3ed-2a7d-414f-ba62-44e1e3c09315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:11.190809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621f3ed-2a7d-414f-ba62-44e1e3c09315 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:11.193109 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c417763-8b92-4081-bc7a-c146bee581c4 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:11.198855 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 37/76] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:11.203534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e4ba4-8e39-498f-a190-529e7512ca24 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:11.203534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e4ba4-8e39-498f-a190-529e7512ca24 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:11.203534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e4ba4-8e39-498f-a190-529e7512ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:11.216889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-516e4ba4-8e39-498f-a190-529e7512ca24 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:11.218074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-516e4ba4-8e39-498f-a190-529e7512ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:11.233469 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067d787-5d56-4754-b868-ee6e1776a186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:11.234349 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067d787-5d56-4754-b868-ee6e1776a186 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:11.234635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067d787-5d56-4754-b868-ee6e1776a186 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:11.234945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067d787-5d56-4754-b868-ee6e1776a186 None admin] PATH_INFO: `/v3/users/19d06ea71ae34908aab1148a210d4a1c` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:11.248732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067d787-5d56-4754-b868-ee6e1776a186 None admin] RBAC: Authorizing `identity:get_user(user_id=19d06ea71ae34908aab1148a210d4a1c)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:11.250201 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067d787-5d56-4754-b868-ee6e1776a186 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:11.251926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 40/77] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:11 2022] GET /identity/v3/users/19d06ea71ae34908aab1148a210d4a1c => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:11.252688 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067d787-5d56-4754-b868-ee6e1776a186 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:11.283795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 38/78] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:11.295686 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e4ba4-8e39-498f-a190-529e7512ca24 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:11.351539 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067d787-5d56-4754-b868-ee6e1776a186 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:11.383585 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21dae6-a5ee-4bab-b869-9257fe151513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:11.384371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21dae6-a5ee-4bab-b869-9257fe151513 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:11.384663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21dae6-a5ee-4bab-b869-9257fe151513 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:11.384937 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21dae6-a5ee-4bab-b869-9257fe151513 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:11.389047 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e4ba4-8e39-498f-a190-529e7512ca24 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:11.395297 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21dae6-a5ee-4bab-b869-9257fe151513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-eb21dae6-a5ee-4bab-b869-9257fe151513 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:11.402898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:11.404009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:11.404962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:11.404962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:11.404962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:11.404962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:11.404962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:11.404962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:11.404962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:11.404962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:11.404962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:11.404962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:11.404962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:11.404962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:11.406970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 41/79] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:11.407757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21dae6-a5ee-4bab-b869-9257fe151513 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:11.421844 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a9ce7-a97b-495e-bb05-c4a30e0e10b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:11.422743 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a9ce7-a97b-495e-bb05-c4a30e0e10b5 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:11.423029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a9ce7-a97b-495e-bb05-c4a30e0e10b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:11.423302 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a9ce7-a97b-495e-bb05-c4a30e0e10b5 None admin] PATH_INFO: `/v3/users/19d06ea71ae34908aab1148a210d4a1c` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:11.424503 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a9ce7-a97b-495e-bb05-c4a30e0e10b5 None admin] RBAC: Authorizing `identity:get_user(user_id=19d06ea71ae34908aab1148a210d4a1c)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:11.426233 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a9ce7-a97b-495e-bb05-c4a30e0e10b5 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:11.427899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 39/80] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:11 2022] GET /identity/v3/users/19d06ea71ae34908aab1148a210d4a1c => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:11.429693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a9ce7-a97b-495e-bb05-c4a30e0e10b5 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:11.505653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21dae6-a5ee-4bab-b869-9257fe151513 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:11.523561 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a9ce7-a97b-495e-bb05-c4a30e0e10b5 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:11.538873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51df45-12cf-4e29-a17d-cf42f0ea5ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:11.539749 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51df45-12cf-4e29-a17d-cf42f0ea5ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:11.540033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51df45-12cf-4e29-a17d-cf42f0ea5ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:11.540312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51df45-12cf-4e29-a17d-cf42f0ea5ec9 None admin] PATH_INFO: `/v3/users/fcec6386453a4aeb83b0960ebf40f96e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:11.541497 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51df45-12cf-4e29-a17d-cf42f0ea5ec9 None admin] RBAC: Authorizing `identity:get_user(user_id=fcec6386453a4aeb83b0960ebf40f96e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:11.542987 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51df45-12cf-4e29-a17d-cf42f0ea5ec9 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:11.544620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 42/81] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:11 2022] GET /identity/v3/users/fcec6386453a4aeb83b0960ebf40f96e => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:11.545377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51df45-12cf-4e29-a17d-cf42f0ea5ec9 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:11.556897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ef00a-3140-48d3-81af-8b00b73b9389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:11.557549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ef00a-3140-48d3-81af-8b00b73b9389 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:11.557833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ef00a-3140-48d3-81af-8b00b73b9389 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:11.558109 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ef00a-3140-48d3-81af-8b00b73b9389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:11.621625 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ef00a-3140-48d3-81af-8b00b73b9389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:11.623070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ef00a-3140-48d3-81af-8b00b73b9389 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:11.646534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51df45-12cf-4e29-a17d-cf42f0ea5ec9 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:11.678140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef1ae3-f491-4b2a-adb8-6f2b91a9de59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:11.678946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef1ae3-f491-4b2a-adb8-6f2b91a9de59 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:11.679268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef1ae3-f491-4b2a-adb8-6f2b91a9de59 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:11.679538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef1ae3-f491-4b2a-adb8-6f2b91a9de59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:11.680704 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef1ae3-f491-4b2a-adb8-6f2b91a9de59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:11.682140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef1ae3-f491-4b2a-adb8-6f2b91a9de59 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:11.683787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 43/82] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:28:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:11.688589 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef1ae3-f491-4b2a-adb8-6f2b91a9de59 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:11.719646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 40/83] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:11.722564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ef00a-3140-48d3-81af-8b00b73b9389 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:11.778452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef1ae3-f491-4b2a-adb8-6f2b91a9de59 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:11.811095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbf463-2876-4f52-bf4a-05838f43b429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:11.811760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbf463-2876-4f52-bf4a-05838f43b429 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:11.812044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbf463-2876-4f52-bf4a-05838f43b429 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:11.812324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbf463-2876-4f52-bf4a-05838f43b429 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:11.813070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbf463-2876-4f52-bf4a-05838f43b429 None admin] RBAC: Adding query filter params (name=member) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:11.813380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbf463-2876-4f52-bf4a-05838f43b429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:11.814832 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbf463-2876-4f52-bf4a-05838f43b429 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:11.815247 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ef00a-3140-48d3-81af-8b00b73b9389 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:11.822903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 44/84] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:11.827459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbf463-2876-4f52-bf4a-05838f43b429 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:11.848517 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ff48f-3420-4366-a2c1-378ad9226024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:11.849169 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff48f-3420-4366-a2c1-378ad9226024 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:11.849450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff48f-3420-4366-a2c1-378ad9226024 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:11.849725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff48f-3420-4366-a2c1-378ad9226024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:11.913790 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ff48f-3420-4366-a2c1-378ad9226024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:11.915218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ff48f-3420-4366-a2c1-378ad9226024 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:11.924605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbf463-2876-4f52-bf4a-05838f43b429 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:11.957673 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a8a80-0f69-4051-9ad0-e2d6aa9c76ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:11.958456 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a8a80-0f69-4051-9ad0-e2d6aa9c76ce None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:11.958777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a8a80-0f69-4051-9ad0-e2d6aa9c76ce None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:11.959053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a8a80-0f69-4051-9ad0-e2d6aa9c76ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:12.007711 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 41/85] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:12.008526 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ff48f-3420-4366-a2c1-378ad9226024 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:12.024066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a8a80-0f69-4051-9ad0-e2d6aa9c76ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:12.025564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a8a80-0f69-4051-9ad0-e2d6aa9c76ce None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:12.099756 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ff48f-3420-4366-a2c1-378ad9226024 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:12.118237 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 45/86] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:12.119005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a8a80-0f69-4051-9ad0-e2d6aa9c76ce None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:12.138405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450bfe6-ad45-4e4a-8c56-fb1128776926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:12.139119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450bfe6-ad45-4e4a-8c56-fb1128776926 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:12.139404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450bfe6-ad45-4e4a-8c56-fb1128776926 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:12.139677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450bfe6-ad45-4e4a-8c56-fb1128776926 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:12.140394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450bfe6-ad45-4e4a-8c56-fb1128776926 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:12.141860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450bfe6-ad45-4e4a-8c56-fb1128776926 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:12.175490 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 42/87] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:28:12 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:12.175490 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450bfe6-ad45-4e4a-8c56-fb1128776926 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:12.233424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a8a80-0f69-4051-9ad0-e2d6aa9c76ce None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:12.272819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713b73a-219a-48f1-b846-38bbac75c826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:12.273775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713b73a-219a-48f1-b846-38bbac75c826 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:12.273962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713b73a-219a-48f1-b846-38bbac75c826 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:12.274237 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713b73a-219a-48f1-b846-38bbac75c826 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:12.275504 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713b73a-219a-48f1-b846-38bbac75c826 None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:12.276990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713b73a-219a-48f1-b846-38bbac75c826 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:12.283901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 46/88] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:12 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:12.284107 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450bfe6-ad45-4e4a-8c56-fb1128776926 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:12.284241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713b73a-219a-48f1-b846-38bbac75c826 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:12.315923 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ff609-3d20-479f-bbde-442d48cf9b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:12.317197 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ff609-3d20-479f-bbde-442d48cf9b5b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:12.317695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ff609-3d20-479f-bbde-442d48cf9b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:12.318194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ff609-3d20-479f-bbde-442d48cf9b5b None admin] PATH_INFO: `/v3/users/19d06ea71ae34908aab1148a210d4a1c` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:12.319803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ff609-3d20-479f-bbde-442d48cf9b5b None admin] RBAC: Authorizing `identity:get_user(user_id=19d06ea71ae34908aab1148a210d4a1c)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:12.321558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ff609-3d20-479f-bbde-442d48cf9b5b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:12.323608 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 43/89] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:12 2022] GET /identity/v3/users/19d06ea71ae34908aab1148a210d4a1c => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:12.324653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ff609-3d20-479f-bbde-442d48cf9b5b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:12.391470 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713b73a-219a-48f1-b846-38bbac75c826 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:12.426862 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ff609-3d20-479f-bbde-442d48cf9b5b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:12.428299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e46fa0-64d2-4ca3-b9d5-d9b1d0ecab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:12.428299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e46fa0-64d2-4ca3-b9d5-d9b1d0ecab54 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:12.428763 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e46fa0-64d2-4ca3-b9d5-d9b1d0ecab54 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:12.428921 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e46fa0-64d2-4ca3-b9d5-d9b1d0ecab54 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:12.431803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e46fa0-64d2-4ca3-b9d5-d9b1d0ecab54 None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:12.433103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e46fa0-64d2-4ca3-b9d5-d9b1d0ecab54 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:12.436617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 47/90] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:12 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:12.437440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e46fa0-64d2-4ca3-b9d5-d9b1d0ecab54 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:12.463523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65067c0c-b2d7-4ff0-8d69-2a4b0e6bcd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:12.464401 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65067c0c-b2d7-4ff0-8d69-2a4b0e6bcd37 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:12.464687 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65067c0c-b2d7-4ff0-8d69-2a4b0e6bcd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:12.464967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65067c0c-b2d7-4ff0-8d69-2a4b0e6bcd37 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:12.468199 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65067c0c-b2d7-4ff0-8d69-2a4b0e6bcd37 None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:12.469667 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65067c0c-b2d7-4ff0-8d69-2a4b0e6bcd37 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:12.471860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 44/91] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:12 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:12.472904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65067c0c-b2d7-4ff0-8d69-2a4b0e6bcd37 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:12.555781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e46fa0-64d2-4ca3-b9d5-d9b1d0ecab54 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:12.591764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65067c0c-b2d7-4ff0-8d69-2a4b0e6bcd37 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:12.595747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7800b53-a90a-402c-95f1-efd2c858966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:12.599469 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7800b53-a90a-402c-95f1-efd2c858966f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:12.599835 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7800b53-a90a-402c-95f1-efd2c858966f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:12.600220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7800b53-a90a-402c-95f1-efd2c858966f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:12.601138 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7800b53-a90a-402c-95f1-efd2c858966f None admin] RBAC: Adding query filter params (role.id=aac74c237ff74c5199b863b81ced5058, scope.project.id=8cac096f50b74f85bd46506ce124b834, user.id=19d06ea71ae34908aab1148a210d4a1c) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:12.601519 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7800b53-a90a-402c-95f1-efd2c858966f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:12.603552 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7800b53-a90a-402c-95f1-efd2c858966f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:12.611318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 48/92] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:12 2022] GET /identity/v3/role_assignments?user.id=19d06ea71ae34908aab1148a210d4a1c&scope.project.id=8cac096f50b74f85bd46506ce124b834&role.id=aac74c237ff74c5199b863b81ced5058 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:12.612141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7800b53-a90a-402c-95f1-efd2c858966f None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:12.632563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8d0c8-dc9f-4b96-abcd-3cc40d5abbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:12.633543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8d0c8-dc9f-4b96-abcd-3cc40d5abbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:12.634053 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8d0c8-dc9f-4b96-abcd-3cc40d5abbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:12.634551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8d0c8-dc9f-4b96-abcd-3cc40d5abbd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:12.708922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8d0c8-dc9f-4b96-abcd-3cc40d5abbd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:12.710811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8d0c8-dc9f-4b96-abcd-3cc40d5abbd7 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:12.728991 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7800b53-a90a-402c-95f1-efd2c858966f None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:12.765355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ec168-0359-4cfa-b15d-ee5c893f03e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:12.766015 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ec168-0359-4cfa-b15d-ee5c893f03e5 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:12.766294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ec168-0359-4cfa-b15d-ee5c893f03e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:12.766570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ec168-0359-4cfa-b15d-ee5c893f03e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:12.767444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ec168-0359-4cfa-b15d-ee5c893f03e5 None admin] RBAC: Adding query filter params (role.id=b63d5637c42b47588880ae919eb7f448, scope.project.id=8cac096f50b74f85bd46506ce124b834, user.id=19d06ea71ae34908aab1148a210d4a1c) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:12.767938 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ec168-0359-4cfa-b15d-ee5c893f03e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:12.770906 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ec168-0359-4cfa-b15d-ee5c893f03e5 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:12.777338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 49/93] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:12 2022] GET /identity/v3/role_assignments?user.id=19d06ea71ae34908aab1148a210d4a1c&scope.project.id=8cac096f50b74f85bd46506ce124b834&role.id=b63d5637c42b47588880ae919eb7f448 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:12.778033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ec168-0359-4cfa-b15d-ee5c893f03e5 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:12.826103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 45/94] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:12.835823 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8d0c8-dc9f-4b96-abcd-3cc40d5abbd7 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:12.893847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ec168-0359-4cfa-b15d-ee5c893f03e5 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:12.933398 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2e835-51b2-400f-830b-6da1f1a3d502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:12.934023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2e835-51b2-400f-830b-6da1f1a3d502 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:12.934306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2e835-51b2-400f-830b-6da1f1a3d502 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:12.934578 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2e835-51b2-400f-830b-6da1f1a3d502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:12.935458 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2e835-51b2-400f-830b-6da1f1a3d502 None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=8cac096f50b74f85bd46506ce124b834, user.id=fcec6386453a4aeb83b0960ebf40f96e) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:12.935767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2e835-51b2-400f-830b-6da1f1a3d502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:12.937238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2e835-51b2-400f-830b-6da1f1a3d502 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:12.944290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 50/95] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:12 2022] GET /identity/v3/role_assignments?user.id=fcec6386453a4aeb83b0960ebf40f96e&scope.project.id=8cac096f50b74f85bd46506ce124b834&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:12.979343 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8d0c8-dc9f-4b96-abcd-3cc40d5abbd7 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:13.018515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6c71e-cf2c-4596-9df6-26e5be1dd3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:13.019899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6c71e-cf2c-4596-9df6-26e5be1dd3aa None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:13.020412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6c71e-cf2c-4596-9df6-26e5be1dd3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:13.020892 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6c71e-cf2c-4596-9df6-26e5be1dd3aa None admin] PATH_INFO: `/v3/projects/5eb93debd5794f5fa7a7e7950d977216` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:13.022561 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6c71e-cf2c-4596-9df6-26e5be1dd3aa None admin] RBAC: Authorizing `identity:get_project(project_id=5eb93debd5794f5fa7a7e7950d977216)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:13.024305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6c71e-cf2c-4596-9df6-26e5be1dd3aa None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:13.026521 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 46/96] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:12 2022] GET /identity/v3/projects/5eb93debd5794f5fa7a7e7950d977216 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:13.034732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2e835-51b2-400f-830b-6da1f1a3d502 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:13.164091 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2e835-51b2-400f-830b-6da1f1a3d502 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:13.205915 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaaed4-65d5-4ce7-ad86-aa5b330ffec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:13.207926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaaed4-65d5-4ce7-ad86-aa5b330ffec8 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:13.208211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaaed4-65d5-4ce7-ad86-aa5b330ffec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:13.208487 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaaed4-65d5-4ce7-ad86-aa5b330ffec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:13.209328 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aaaed4-65d5-4ce7-ad86-aa5b330ffec8 None admin] RBAC: Adding query filter params (role.id=aac74c237ff74c5199b863b81ced5058, scope.project.id=5eb93debd5794f5fa7a7e7950d977216, user.id=19d06ea71ae34908aab1148a210d4a1c) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:13.209641 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aaaed4-65d5-4ce7-ad86-aa5b330ffec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:13.211154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aaaed4-65d5-4ce7-ad86-aa5b330ffec8 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:13.217389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 51/97] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:13 2022] GET /identity/v3/role_assignments?user.id=19d06ea71ae34908aab1148a210d4a1c&scope.project.id=5eb93debd5794f5fa7a7e7950d977216&role.id=aac74c237ff74c5199b863b81ced5058 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:15.236905 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bb591-5a58-42f3-b72b-1d60e4a9b370 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:15.238245 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bb591-5a58-42f3-b72b-1d60e4a9b370 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:15.238780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bb591-5a58-42f3-b72b-1d60e4a9b370 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:15.240380 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 47/98] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:15.245855 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd1fa-b3c7-4bbe-ae9e-28e03d7cfce4 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:15.246295 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd1fa-b3c7-4bbe-ae9e-28e03d7cfce4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:15.246473 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd1fa-b3c7-4bbe-ae9e-28e03d7cfce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:15.275775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-406bd1fa-b3c7-4bbe-ae9e-28e03d7cfce4 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:15.276986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-406bd1fa-b3c7-4bbe-ae9e-28e03d7cfce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:15.280708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b92d-0565-43c1-82b1-280630ec8091 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:15.281174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b92d-0565-43c1-82b1-280630ec8091 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:15.281451 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b92d-0565-43c1-82b1-280630ec8091 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:15.282999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 48/99] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:28:15.293626 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547568-6948-45a5-b1ed-53f34fa0ac7f None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:15.294201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547568-6948-45a5-b1ed-53f34fa0ac7f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:15.294729 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547568-6948-45a5-b1ed-53f34fa0ac7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:15.324344 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c8547568-6948-45a5-b1ed-53f34fa0ac7f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:15.326496 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c8547568-6948-45a5-b1ed-53f34fa0ac7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:15.384269 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 52/100] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:15.425925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bd1fa-b3c7-4bbe-ae9e-28e03d7cfce4 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:15.429787 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 49/101] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:15.512013 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8547568-6948-45a5-b1ed-53f34fa0ac7f None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:15.606314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bd1fa-b3c7-4bbe-ae9e-28e03d7cfce4 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:15.669007 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392851ba-e5ad-43a9-9ddc-52aa018daeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:15.670161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392851ba-e5ad-43a9-9ddc-52aa018daeea None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:15.670635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392851ba-e5ad-43a9-9ddc-52aa018daeea None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:15.671119 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392851ba-e5ad-43a9-9ddc-52aa018daeea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:15.691387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392851ba-e5ad-43a9-9ddc-52aa018daeea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-392851ba-e5ad-43a9-9ddc-52aa018daeea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:15.699619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:15.700568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:15.701358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:15.701358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:15.701358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:15.701358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:15.701358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:15.701358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:15.701358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:15.701358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:15.701358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:15.701358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:15.701358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:15.701358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:15.704588 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8547568-6948-45a5-b1ed-53f34fa0ac7f None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:15.713508 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 53/102] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:28:15.719332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392851ba-e5ad-43a9-9ddc-52aa018daeea None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:15.768374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747fda2-92e9-4328-810e-f601468dda2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:15.769430 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747fda2-92e9-4328-810e-f601468dda2d None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:15.769870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747fda2-92e9-4328-810e-f601468dda2d None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:15.770286 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747fda2-92e9-4328-810e-f601468dda2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:15.771888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747fda2-92e9-4328-810e-f601468dda2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:15.773672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747fda2-92e9-4328-810e-f601468dda2d None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:15.775503 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 50/103] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:28:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:15.781937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747fda2-92e9-4328-810e-f601468dda2d None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:15.914598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392851ba-e5ad-43a9-9ddc-52aa018daeea None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:15.948946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13253886-faa5-4443-a0a4-c8dd071e185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:15.949975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253886-faa5-4443-a0a4-c8dd071e185f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:15.950477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253886-faa5-4443-a0a4-c8dd071e185f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:15.951002 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253886-faa5-4443-a0a4-c8dd071e185f None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:15.951987 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13253886-faa5-4443-a0a4-c8dd071e185f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:15.952505 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13253886-faa5-4443-a0a4-c8dd071e185f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:15.954089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13253886-faa5-4443-a0a4-c8dd071e185f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:15.962945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 54/104] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:15.964508 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2b61-8064-45c1-ba90-d755f0de4eca None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:15.965020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2b61-8064-45c1-ba90-d755f0de4eca None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:15.965508 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2b61-8064-45c1-ba90-d755f0de4eca None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:15.966973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 55/105] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:15.968184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd2b61-8064-45c1-ba90-d755f0de4eca None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:15.980833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747fda2-92e9-4328-810e-f601468dda2d None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:16.060842 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ced5b-f69c-46a3-a6b2-0b4e5985813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:16.061443 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ced5b-f69c-46a3-a6b2-0b4e5985813e None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:16.061742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ced5b-f69c-46a3-a6b2-0b4e5985813e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:16.061996 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ced5b-f69c-46a3-a6b2-0b4e5985813e None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:16.062754 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ced5b-f69c-46a3-a6b2-0b4e5985813e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:16.064210 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ced5b-f69c-46a3-a6b2-0b4e5985813e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:16.072767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd2b61-8064-45c1-ba90-d755f0de4eca None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:16.107600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b34b9-fc31-43c8-b2aa-900450c82d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:16.108902 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b34b9-fc31-43c8-b2aa-900450c82d81 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:16.109383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b34b9-fc31-43c8-b2aa-900450c82d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:16.109864 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b34b9-fc31-43c8-b2aa-900450c82d81 None admin] PATH_INFO: `/v3/users/b9e5a4e3fd9a4d958241aa81bcf2cbdd` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:16.125349 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b34b9-fc31-43c8-b2aa-900450c82d81 None admin] RBAC: Authorizing `identity:get_user(user_id=b9e5a4e3fd9a4d958241aa81bcf2cbdd)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:16.127165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b34b9-fc31-43c8-b2aa-900450c82d81 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:16.128859 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 51/106] 10.222.0.76 () {60 vars in 1141 bytes} [Thu May 12 17:28:15 2022] POST /identity/v3/projects => generated 302 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:16.129980 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafc401-289a-42f5-b4cf-33e217d7708a None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:16.130274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafc401-289a-42f5-b4cf-33e217d7708a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:16.130549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafc401-289a-42f5-b4cf-33e217d7708a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:16.130787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 56/107] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:15 2022] GET /identity/v3/users/b9e5a4e3fd9a4d958241aa81bcf2cbdd => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:16.139878 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b34b9-fc31-43c8-b2aa-900450c82d81 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:16.172893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ffafc401-289a-42f5-b4cf-33e217d7708a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:16.174136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ffafc401-289a-42f5-b4cf-33e217d7708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:16.341887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 52/108] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:16.368495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b34b9-fc31-43c8-b2aa-900450c82d81 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:16.403612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafc401-289a-42f5-b4cf-33e217d7708a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:16.434707 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bfead-51e7-4447-9701-acde5a68457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:16.435377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bfead-51e7-4447-9701-acde5a68457e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:16.435660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bfead-51e7-4447-9701-acde5a68457e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:16.435940 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bfead-51e7-4447-9701-acde5a68457e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:16.561866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafc401-289a-42f5-b4cf-33e217d7708a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:16.567314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bfead-51e7-4447-9701-acde5a68457e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:16.568817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bfead-51e7-4447-9701-acde5a68457e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:16.604209 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c5ee2-5eed-46a0-95be-10f0f2aec535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:16.605206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c5ee2-5eed-46a0-95be-10f0f2aec535 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:16.605494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c5ee2-5eed-46a0-95be-10f0f2aec535 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:16.605768 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c5ee2-5eed-46a0-95be-10f0f2aec535 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:16.620126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c5ee2-5eed-46a0-95be-10f0f2aec535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-db6c5ee2-5eed-46a0-95be-10f0f2aec535 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:16.631334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:16.632730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:16.633480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:16.633480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:16.633480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:16.633480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:16.633480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:16.633480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:16.633480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:16.633480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:16.633480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:16.633480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:16.633480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:16.633480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:16.633480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 53/109] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:28:16.634615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89988835-4128-4a21-997e-d6e735acd0e2 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:16.634615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89988835-4128-4a21-997e-d6e735acd0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:16.639535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89988835-4128-4a21-997e-d6e735acd0e2 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:16.639535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 54/110] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:16.639535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2d443-77c2-4a58-8a97-d3cb5eb5834a None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:16.639535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2d443-77c2-4a58-8a97-d3cb5eb5834a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:16.639535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2d443-77c2-4a58-8a97-d3cb5eb5834a None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:16.639535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 55/111] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:16.646254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb4547-ccf5-45f4-ad99-507cdf0a62e7 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:16.646538 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb4547-ccf5-45f4-ad99-507cdf0a62e7 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:16.646841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb4547-ccf5-45f4-ad99-507cdf0a62e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:16.669490 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-10cb4547-ccf5-45f4-ad99-507cdf0a62e7 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:16.671046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-10cb4547-ccf5-45f4-ad99-507cdf0a62e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:16.701767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 57/112] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:16.707973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43297246-ec50-4542-a7ce-655e0285883c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:16.708543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43297246-ec50-4542-a7ce-655e0285883c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:16.709030 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43297246-ec50-4542-a7ce-655e0285883c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:16.731032 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-43297246-ec50-4542-a7ce-655e0285883c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:16.733042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-43297246-ec50-4542-a7ce-655e0285883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:16.752981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 56/113] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:16.759543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb4547-ccf5-45f4-ad99-507cdf0a62e7 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:16.825390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 58/114] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:16.834693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43297246-ec50-4542-a7ce-655e0285883c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:16.879785 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb4547-ccf5-45f4-ad99-507cdf0a62e7 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:16.916710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a83b-4d7a-45ff-82e0-f002a987060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:16.917653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a83b-4d7a-45ff-82e0-f002a987060e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:16.918091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a83b-4d7a-45ff-82e0-f002a987060e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:16.918506 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a83b-4d7a-45ff-82e0-f002a987060e None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:16.919853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27a83b-4d7a-45ff-82e0-f002a987060e None admin] RBAC: Adding query filter params (name=member) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:16.920568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27a83b-4d7a-45ff-82e0-f002a987060e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:16.922594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27a83b-4d7a-45ff-82e0-f002a987060e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:16.931614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43297246-ec50-4542-a7ce-655e0285883c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:16.935531 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 57/115] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:16.940539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a83b-4d7a-45ff-82e0-f002a987060e None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:16.968140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd949e-2789-43e1-8919-fd568ffd53b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:16.969002 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd949e-2789-43e1-8919-fd568ffd53b4 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:16.969284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd949e-2789-43e1-8919-fd568ffd53b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:16.969557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd949e-2789-43e1-8919-fd568ffd53b4 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:16.971038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd949e-2789-43e1-8919-fd568ffd53b4 None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:16.973040 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd949e-2789-43e1-8919-fd568ffd53b4 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:16.974783 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 59/116] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:16 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:16.975591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd949e-2789-43e1-8919-fd568ffd53b4 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:17.044458 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a83b-4d7a-45ff-82e0-f002a987060e None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:17.075275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd949e-2789-43e1-8919-fd568ffd53b4 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:17.078246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56531f1c-f96c-44a7-b2b0-3df45551348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:17.079081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531f1c-f96c-44a7-b2b0-3df45551348b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:17.079363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531f1c-f96c-44a7-b2b0-3df45551348b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:17.079633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531f1c-f96c-44a7-b2b0-3df45551348b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:17.090623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56531f1c-f96c-44a7-b2b0-3df45551348b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-56531f1c-f96c-44a7-b2b0-3df45551348b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:17.099312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:17.100170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:17.100962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:17.100962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:17.100962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:17.100962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:17.100962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:17.100962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:17.100962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:17.100962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:17.100962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:17.100962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:17.100962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:17.100962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:17.100962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 58/117] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:28:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:17.102089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e9822-43bb-4100-bf40-bb27725432dd None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:17.102089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e9822-43bb-4100-bf40-bb27725432dd None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:17.102384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e9822-43bb-4100-bf40-bb27725432dd None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:17.103832 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 59/118] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:17.107465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e9822-43bb-4100-bf40-bb27725432dd None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:17.115615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e252c-091d-4e5f-ac3b-a9e762558a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:17.116414 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e252c-091d-4e5f-ac3b-a9e762558a97 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:17.116695 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e252c-091d-4e5f-ac3b-a9e762558a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:17.116969 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e252c-091d-4e5f-ac3b-a9e762558a97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:17.127213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e252c-091d-4e5f-ac3b-a9e762558a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-1d2e252c-091d-4e5f-ac3b-a9e762558a97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:17.135775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:17.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:17.137459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:17.137459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:17.137459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:17.137459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:17.137459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:17.137459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:17.137459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:17.137459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:17.137459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:17.137459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:17.137459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:17.137459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:17.137459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 60/119] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:28:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:17.138116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e252c-091d-4e5f-ac3b-a9e762558a97 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:17.212061 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e9822-43bb-4100-bf40-bb27725432dd None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:17.236379 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e252c-091d-4e5f-ac3b-a9e762558a97 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:17.249487 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027c348-abe8-45ee-b76b-df9e72694fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:17.250365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027c348-abe8-45ee-b76b-df9e72694fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:17.250645 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027c348-abe8-45ee-b76b-df9e72694fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:17.250948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027c348-abe8-45ee-b76b-df9e72694fb0 None admin] PATH_INFO: `/v3/users/19d06ea71ae34908aab1148a210d4a1c` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:17.252131 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027c348-abe8-45ee-b76b-df9e72694fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=19d06ea71ae34908aab1148a210d4a1c)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:17.254240 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027c348-abe8-45ee-b76b-df9e72694fb0 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:17.260630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 60/120] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:17 2022] GET /identity/v3/users/19d06ea71ae34908aab1148a210d4a1c => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:17.260630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027c348-abe8-45ee-b76b-df9e72694fb0 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:17.271362 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b0eeb-858a-4303-82dc-2e062461d581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:17.272029 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0eeb-858a-4303-82dc-2e062461d581 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:17.272316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0eeb-858a-4303-82dc-2e062461d581 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:17.272596 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0eeb-858a-4303-82dc-2e062461d581 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:17.273436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b0eeb-858a-4303-82dc-2e062461d581 None admin] RBAC: Adding query filter params (role.id=b526c720d6b448189684bab16e2f425a, scope.project.id=8cac096f50b74f85bd46506ce124b834, user.id=b9e5a4e3fd9a4d958241aa81bcf2cbdd) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:17.273751 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b0eeb-858a-4303-82dc-2e062461d581 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:17.275247 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b0eeb-858a-4303-82dc-2e062461d581 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:17.284658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 61/121] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:17 2022] GET /identity/v3/role_assignments?user.id=b9e5a4e3fd9a4d958241aa81bcf2cbdd&scope.project.id=8cac096f50b74f85bd46506ce124b834&role.id=b526c720d6b448189684bab16e2f425a => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:17.288070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474bf46-b053-4e04-a4dc-dd94c0e84d5b None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:17.288070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474bf46-b053-4e04-a4dc-dd94c0e84d5b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:17.288070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474bf46-b053-4e04-a4dc-dd94c0e84d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:17.307220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-b474bf46-b053-4e04-a4dc-dd94c0e84d5b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:17.308506 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b474bf46-b053-4e04-a4dc-dd94c0e84d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:17.385116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 62/122] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:17.385967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027c348-abe8-45ee-b76b-df9e72694fb0 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:17.386336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474bf46-b053-4e04-a4dc-dd94c0e84d5b None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:17.421645 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8bb7f-d277-4945-adb2-3a2a2f288109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:17.422693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8bb7f-d277-4945-adb2-3a2a2f288109 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:17.423199 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8bb7f-d277-4945-adb2-3a2a2f288109 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:17.423672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8bb7f-d277-4945-adb2-3a2a2f288109 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:17.424624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8bb7f-d277-4945-adb2-3a2a2f288109 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:17.425693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8bb7f-d277-4945-adb2-3a2a2f288109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:17.427343 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8bb7f-d277-4945-adb2-3a2a2f288109 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:17.436870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 61/123] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:28:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:17.438049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8bb7f-d277-4945-adb2-3a2a2f288109 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:17.500791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474bf46-b053-4e04-a4dc-dd94c0e84d5b None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:17.537275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2383ca4-ea7f-453f-b4e1-7edf3ac33f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:17.537981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383ca4-ea7f-453f-b4e1-7edf3ac33f35 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:17.538269 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383ca4-ea7f-453f-b4e1-7edf3ac33f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:17.538609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383ca4-ea7f-453f-b4e1-7edf3ac33f35 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:17.539317 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2383ca4-ea7f-453f-b4e1-7edf3ac33f35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:17.539620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2383ca4-ea7f-453f-b4e1-7edf3ac33f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:17.541212 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2383ca4-ea7f-453f-b4e1-7edf3ac33f35 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:17.546942 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8bb7f-d277-4945-adb2-3a2a2f288109 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:17.550192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 63/124] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:17.551482 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2383ca4-ea7f-453f-b4e1-7edf3ac33f35 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:17.585151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b68ee-fb10-4f20-ac59-701714286234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:17.586374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b68ee-fb10-4f20-ac59-701714286234 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:17.586906 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b68ee-fb10-4f20-ac59-701714286234 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:17.587395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b68ee-fb10-4f20-ac59-701714286234 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:17.588803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b68ee-fb10-4f20-ac59-701714286234 None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:17.590490 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b68ee-fb10-4f20-ac59-701714286234 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:17.592459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 62/125] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:17 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:17.598591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b68ee-fb10-4f20-ac59-701714286234 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:17.658144 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2383ca4-ea7f-453f-b4e1-7edf3ac33f35 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:17.695454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6083b-1ca6-471b-ad4b-0379f4fda142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:17.696255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6083b-1ca6-471b-ad4b-0379f4fda142 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:17.696602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6083b-1ca6-471b-ad4b-0379f4fda142 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:17.696797 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6083b-1ca6-471b-ad4b-0379f4fda142 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:17.703722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b68ee-fb10-4f20-ac59-701714286234 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:17.709455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6083b-1ca6-471b-ad4b-0379f4fda142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-5ae6083b-1ca6-471b-ad4b-0379f4fda142 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:17.717739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:17.718611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:17.719418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:17.719418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:17.719418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:17.719418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:17.719418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:17.719418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:17.719418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:17.719418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:17.719418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:17.719418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:17.719418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:17.719418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:17.719418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 64/126] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:17.720047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6083b-1ca6-471b-ad4b-0379f4fda142 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:17.741599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18240fec-4a6d-4683-b507-019abea85146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:17.742728 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18240fec-4a6d-4683-b507-019abea85146 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:17.743156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18240fec-4a6d-4683-b507-019abea85146 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:17.743592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18240fec-4a6d-4683-b507-019abea85146 None admin] PATH_INFO: `/v3/users/19d06ea71ae34908aab1148a210d4a1c` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:17.744969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18240fec-4a6d-4683-b507-019abea85146 None admin] RBAC: Authorizing `identity:get_user(user_id=19d06ea71ae34908aab1148a210d4a1c)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:17.746620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18240fec-4a6d-4683-b507-019abea85146 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:17.748579 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 63/127] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:17 2022] GET /identity/v3/users/19d06ea71ae34908aab1148a210d4a1c => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:17.749476 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18240fec-4a6d-4683-b507-019abea85146 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:17.829248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6083b-1ca6-471b-ad4b-0379f4fda142 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:17.851921 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18240fec-4a6d-4683-b507-019abea85146 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:17.870112 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e3ffb-98e7-4d70-8321-e75667e40e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:17.871245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e3ffb-98e7-4d70-8321-e75667e40e59 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:17.871815 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e3ffb-98e7-4d70-8321-e75667e40e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:17.872242 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e3ffb-98e7-4d70-8321-e75667e40e59 None admin] PATH_INFO: `/v3/users/fcec6386453a4aeb83b0960ebf40f96e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:17.873835 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e3ffb-98e7-4d70-8321-e75667e40e59 None admin] RBAC: Authorizing `identity:get_user(user_id=fcec6386453a4aeb83b0960ebf40f96e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:17.875483 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e3ffb-98e7-4d70-8321-e75667e40e59 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:17.878889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 65/128] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:17 2022] GET /identity/v3/users/fcec6386453a4aeb83b0960ebf40f96e => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:17.879992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e3ffb-98e7-4d70-8321-e75667e40e59 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:17.900508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d250b-2813-4d19-8155-fba26736d155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:17.901788 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d250b-2813-4d19-8155-fba26736d155 None admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:17.902346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d250b-2813-4d19-8155-fba26736d155 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:17.902632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d250b-2813-4d19-8155-fba26736d155 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834/users/19d06ea71ae34908aab1148a210d4a1c/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:17.905078 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d250b-2813-4d19-8155-fba26736d155 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cac096f50b74f85bd46506ce124b834, user_id=19d06ea71ae34908aab1148a210d4a1c, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:17.906555 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d250b-2813-4d19-8155-fba26736d155 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:17.926919 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 64/129] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:28:17 2022] PUT /identity/v3/projects/8cac096f50b74f85bd46506ce124b834/users/19d06ea71ae34908aab1148a210d4a1c/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:28:17.927704 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d250b-2813-4d19-8155-fba26736d155 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:18.014988 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e3ffb-98e7-4d70-8321-e75667e40e59 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:18.093533 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d250b-2813-4d19-8155-fba26736d155 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:18.096625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4e6ad-8cb5-412b-982f-3c8359874bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:18.097324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4e6ad-8cb5-412b-982f-3c8359874bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:18.097607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4e6ad-8cb5-412b-982f-3c8359874bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:18.097883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4e6ad-8cb5-412b-982f-3c8359874bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:18.098651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4e6ad-8cb5-412b-982f-3c8359874bd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:18.098983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4e6ad-8cb5-412b-982f-3c8359874bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:18.100388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4e6ad-8cb5-412b-982f-3c8359874bd3 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:18.122190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 66/130] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:18.125147 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4e6ad-8cb5-412b-982f-3c8359874bd3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:18.150033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cfbfd-3a88-4bea-92aa-2b123904afe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:18.151280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cfbfd-3a88-4bea-92aa-2b123904afe8 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:18.151806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cfbfd-3a88-4bea-92aa-2b123904afe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:18.152278 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cfbfd-3a88-4bea-92aa-2b123904afe8 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:18.153676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cfbfd-3a88-4bea-92aa-2b123904afe8 None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:18.155395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cfbfd-3a88-4bea-92aa-2b123904afe8 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:18.157385 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 65/131] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:17 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:18.158365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cfbfd-3a88-4bea-92aa-2b123904afe8 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:18.270937 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4e6ad-8cb5-412b-982f-3c8359874bd3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:18.300793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cfbfd-3a88-4bea-92aa-2b123904afe8 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:18.343910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5bb16-5b6c-41f7-84a3-c38fbbb3b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:18.345412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5bb16-5b6c-41f7-84a3-c38fbbb3b35c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:18.345931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5bb16-5b6c-41f7-84a3-c38fbbb3b35c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:18.346403 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5bb16-5b6c-41f7-84a3-c38fbbb3b35c None admin] PATH_INFO: `/v3/users/19d06ea71ae34908aab1148a210d4a1c` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:18.347928 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5bb16-5b6c-41f7-84a3-c38fbbb3b35c None admin] RBAC: Authorizing `identity:get_user(user_id=19d06ea71ae34908aab1148a210d4a1c)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:18.349582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5bb16-5b6c-41f7-84a3-c38fbbb3b35c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:18.351606 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 66/132] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:18 2022] GET /identity/v3/users/19d06ea71ae34908aab1148a210d4a1c => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:18.352698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5bb16-5b6c-41f7-84a3-c38fbbb3b35c None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:18.363410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c92d45-acbc-4764-a39f-4f61f251e75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:18.364303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c92d45-acbc-4764-a39f-4f61f251e75c None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:18.364591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c92d45-acbc-4764-a39f-4f61f251e75c None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:18.364926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c92d45-acbc-4764-a39f-4f61f251e75c None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:18.366222 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c92d45-acbc-4764-a39f-4f61f251e75c None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:18.367749 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c92d45-acbc-4764-a39f-4f61f251e75c None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:18.369791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 67/133] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:18 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:18.370602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c92d45-acbc-4764-a39f-4f61f251e75c None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:18.470048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5bb16-5b6c-41f7-84a3-c38fbbb3b35c None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:18.510631 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95cc1c-3575-4c3f-83af-8fda9d654fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:18.512020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95cc1c-3575-4c3f-83af-8fda9d654fe1 None admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:18.512682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95cc1c-3575-4c3f-83af-8fda9d654fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:18.513173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95cc1c-3575-4c3f-83af-8fda9d654fe1 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834/users/19d06ea71ae34908aab1148a210d4a1c/roles/b63d5637c42b47588880ae919eb7f448` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:18.516299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95cc1c-3575-4c3f-83af-8fda9d654fe1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cac096f50b74f85bd46506ce124b834, user_id=19d06ea71ae34908aab1148a210d4a1c, role_id=b63d5637c42b47588880ae919eb7f448)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:18.518035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95cc1c-3575-4c3f-83af-8fda9d654fe1 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:18.555265 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 67/134] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:28:18 2022] PUT /identity/v3/projects/8cac096f50b74f85bd46506ce124b834/users/19d06ea71ae34908aab1148a210d4a1c/roles/b63d5637c42b47588880ae919eb7f448 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:28:18.556395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95cc1c-3575-4c3f-83af-8fda9d654fe1 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:18.619702 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c92d45-acbc-4764-a39f-4f61f251e75c None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:18.667962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c30cf-9904-45f6-a86a-9af6ab0450f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:18.669146 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c30cf-9904-45f6-a86a-9af6ab0450f5 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:18.669507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c30cf-9904-45f6-a86a-9af6ab0450f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:18.669789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c30cf-9904-45f6-a86a-9af6ab0450f5 None admin] PATH_INFO: `/v3/projects/5eb93debd5794f5fa7a7e7950d977216` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:18.673329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c30cf-9904-45f6-a86a-9af6ab0450f5 None admin] RBAC: Authorizing `identity:get_project(project_id=5eb93debd5794f5fa7a7e7950d977216)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:18.675560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c30cf-9904-45f6-a86a-9af6ab0450f5 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:18.677615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 68/135] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:18 2022] GET /identity/v3/projects/5eb93debd5794f5fa7a7e7950d977216 => generated 312 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:18.684689 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c30cf-9904-45f6-a86a-9af6ab0450f5 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:18.813665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c30cf-9904-45f6-a86a-9af6ab0450f5 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:18.828859 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95cc1c-3575-4c3f-83af-8fda9d654fe1 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:18.859669 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407a4a9-8f40-4417-8d9b-bc8251eef5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:18.860730 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407a4a9-8f40-4417-8d9b-bc8251eef5e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:18.861079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407a4a9-8f40-4417-8d9b-bc8251eef5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:18.861367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407a4a9-8f40-4417-8d9b-bc8251eef5e0 None admin] PATH_INFO: `/v3/projects/5eb93debd5794f5fa7a7e7950d977216/users/19d06ea71ae34908aab1148a210d4a1c/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:18.863922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407a4a9-8f40-4417-8d9b-bc8251eef5e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5eb93debd5794f5fa7a7e7950d977216, user_id=19d06ea71ae34908aab1148a210d4a1c, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:18.866319 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407a4a9-8f40-4417-8d9b-bc8251eef5e0 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:18.890410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 69/136] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:28:18 2022] PUT /identity/v3/projects/5eb93debd5794f5fa7a7e7950d977216/users/19d06ea71ae34908aab1148a210d4a1c/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:28:18.891601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce462f75-0e6c-4d55-88a1-70ab3258a6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:18.891754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430b5b-676e-4d5d-83fd-8486db6d3302 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:18.891996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430b5b-676e-4d5d-83fd-8486db6d3302 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:18.892413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be430b5b-676e-4d5d-83fd-8486db6d3302 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:18.893062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce462f75-0e6c-4d55-88a1-70ab3258a6b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:18.893540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce462f75-0e6c-4d55-88a1-70ab3258a6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:18.893925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 70/137] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:18.894093 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce462f75-0e6c-4d55-88a1-70ab3258a6b3 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834/users/fcec6386453a4aeb83b0960ebf40f96e/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:18.896335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce462f75-0e6c-4d55-88a1-70ab3258a6b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cac096f50b74f85bd46506ce124b834, user_id=fcec6386453a4aeb83b0960ebf40f96e, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:18.898001 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce462f75-0e6c-4d55-88a1-70ab3258a6b3 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:18.901068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5a67a-f250-4dd3-aa1e-b6ffc8fb427f None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:18.901362 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5a67a-f250-4dd3-aa1e-b6ffc8fb427f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:18.901932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5a67a-f250-4dd3-aa1e-b6ffc8fb427f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:18.918855 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 68/138] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:28:18 2022] PUT /identity/v3/projects/8cac096f50b74f85bd46506ce124b834/users/fcec6386453a4aeb83b0960ebf40f96e/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:28:18.933567 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-4bc5a67a-f250-4dd3-aa1e-b6ffc8fb427f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:18.935102 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4bc5a67a-f250-4dd3-aa1e-b6ffc8fb427f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:19.039235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 71/139] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:19.092515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce462f75-0e6c-4d55-88a1-70ab3258a6b3 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:19.235176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce462f75-0e6c-4d55-88a1-70ab3258a6b3 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:19.283313 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3dcacc-cf28-4bae-9748-9f780a7dec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:19.284132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dcacc-cf28-4bae-9748-9f780a7dec8b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:19.284613 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dcacc-cf28-4bae-9748-9f780a7dec8b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:19.286805 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dcacc-cf28-4bae-9748-9f780a7dec8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:19.288016 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3dcacc-cf28-4bae-9748-9f780a7dec8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:19.289105 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3dcacc-cf28-4bae-9748-9f780a7dec8b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:19.294708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 69/140] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:28:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:19.296892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5a67a-f250-4dd3-aa1e-b6ffc8fb427f None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:19.416833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5a67a-f250-4dd3-aa1e-b6ffc8fb427f None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:19.457270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39a269-7f3e-4d7a-96b1-ac8ffb490069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:19.457953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a269-7f3e-4d7a-96b1-ac8ffb490069 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:19.458282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a269-7f3e-4d7a-96b1-ac8ffb490069 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:19.458562 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a269-7f3e-4d7a-96b1-ac8ffb490069 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:19.459316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39a269-7f3e-4d7a-96b1-ac8ffb490069 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:19.460922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39a269-7f3e-4d7a-96b1-ac8ffb490069 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:19.490407 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 72/141] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:28:19 2022] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:20.170886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3ca8-fed2-4e74-8205-5f0a5e1cbed6 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:20.171396 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3ca8-fed2-4e74-8205-5f0a5e1cbed6 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:20.171470 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3ca8-fed2-4e74-8205-5f0a5e1cbed6 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:20.172818 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 70/142] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:20.178142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afe0d6-23c9-4f99-aae3-5dd87c5590e3 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:20.178561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afe0d6-23c9-4f99-aae3-5dd87c5590e3 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:20.178776 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afe0d6-23c9-4f99-aae3-5dd87c5590e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:20.197057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-01afe0d6-23c9-4f99-aae3-5dd87c5590e3 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:20.198372 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-01afe0d6-23c9-4f99-aae3-5dd87c5590e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:20.267489 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 73/143] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:20.290781 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e3ca8-fed2-4e74-8205-5f0a5e1cbed6 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:20.396588 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e3ca8-fed2-4e74-8205-5f0a5e1cbed6 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:20.431759 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43edfd-f98f-49a3-9cc8-b500179de3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:20.432496 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43edfd-f98f-49a3-9cc8-b500179de3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:20.432782 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43edfd-f98f-49a3-9cc8-b500179de3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:20.433061 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43edfd-f98f-49a3-9cc8-b500179de3c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:20.445398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43edfd-f98f-49a3-9cc8-b500179de3c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-ba43edfd-f98f-49a3-9cc8-b500179de3c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:20.453327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:20.454200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:20.454993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:20.454993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:20.454993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:20.454993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:20.454993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:20.454993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:20.454993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:20.454993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:20.454993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:20.454993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:20.454993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:20.454993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:20.454993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 71/144] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:20.460924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afe0d6-23c9-4f99-aae3-5dd87c5590e3 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:20.563591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afe0d6-23c9-4f99-aae3-5dd87c5590e3 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:20.599154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2f091-d098-4133-bbcd-4e5121b2df7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:20.599840 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f091-d098-4133-bbcd-4e5121b2df7d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:20.600129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f091-d098-4133-bbcd-4e5121b2df7d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:20.600412 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f091-d098-4133-bbcd-4e5121b2df7d None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:20.601170 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2f091-d098-4133-bbcd-4e5121b2df7d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:20.601592 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2f091-d098-4133-bbcd-4e5121b2df7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:20.603013 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2f091-d098-4133-bbcd-4e5121b2df7d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:20.611731 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 74/145] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:20.617925 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43edfd-f98f-49a3-9cc8-b500179de3c4 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:20.731358 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43edfd-f98f-49a3-9cc8-b500179de3c4 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:20.766506 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e520e05-475c-4e7e-a3d0-e02aa11d4744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:20.767464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e520e05-475c-4e7e-a3d0-e02aa11d4744 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:20.767747 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e520e05-475c-4e7e-a3d0-e02aa11d4744 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:20.768025 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e520e05-475c-4e7e-a3d0-e02aa11d4744 None admin] PATH_INFO: `/v3/users/b9e5a4e3fd9a4d958241aa81bcf2cbdd` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:20.769811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e520e05-475c-4e7e-a3d0-e02aa11d4744 None admin] RBAC: Authorizing `identity:get_user(user_id=b9e5a4e3fd9a4d958241aa81bcf2cbdd)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:20.771319 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e520e05-475c-4e7e-a3d0-e02aa11d4744 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:20.772986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 72/146] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:20 2022] GET /identity/v3/users/b9e5a4e3fd9a4d958241aa81bcf2cbdd => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:20.778433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2f091-d098-4133-bbcd-4e5121b2df7d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:20.881567 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2f091-d098-4133-bbcd-4e5121b2df7d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:20.902367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcf18f-5280-4761-85b8-e5d73db759a4 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:20.902656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcf18f-5280-4761-85b8-e5d73db759a4 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:20.902941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcf18f-5280-4761-85b8-e5d73db759a4 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:20.904607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 73/147] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:20.909694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c752f-d620-468d-9d84-c7c0fa0ed1fa None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:20.910024 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c752f-d620-468d-9d84-c7c0fa0ed1fa None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:20.910435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c752f-d620-468d-9d84-c7c0fa0ed1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:20.929028 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d6550-622b-4f66-86fc-8bd6558d2315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:20.929213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-a36c752f-d620-468d-9d84-c7c0fa0ed1fa None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:20.930333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6550-622b-4f66-86fc-8bd6558d2315 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:20.930437 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a36c752f-d620-468d-9d84-c7c0fa0ed1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:20.930938 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6550-622b-4f66-86fc-8bd6558d2315 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:20.931409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6550-622b-4f66-86fc-8bd6558d2315 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:20.935395 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d6550-622b-4f66-86fc-8bd6558d2315 None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:20.937114 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d6550-622b-4f66-86fc-8bd6558d2315 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:20.939103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 75/148] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:20 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:20.959966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d6550-622b-4f66-86fc-8bd6558d2315 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:21.010540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 74/149] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:21.037819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c752f-d620-468d-9d84-c7c0fa0ed1fa None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:21.151062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c752f-d620-468d-9d84-c7c0fa0ed1fa None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:21.179871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d6550-622b-4f66-86fc-8bd6558d2315 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:21.189999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa01f47-5ac9-40a1-83e6-2b4c1ebd04a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:21.191384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01f47-5ac9-40a1-83e6-2b4c1ebd04a4 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:21.191671 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01f47-5ac9-40a1-83e6-2b4c1ebd04a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:21.191952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01f47-5ac9-40a1-83e6-2b4c1ebd04a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:21.204218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa01f47-5ac9-40a1-83e6-2b4c1ebd04a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-4fa01f47-5ac9-40a1-83e6-2b4c1ebd04a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:21.214069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:21.215020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:21.215816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:21.215816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:21.215816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:21.215816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:21.215816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:21.215816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:21.215816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:21.215816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:21.215816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:21.215816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:21.215816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:21.215816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:21.216390 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 75/150] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:21.222380 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa01f47-5ac9-40a1-83e6-2b4c1ebd04a4 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:21.245698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b38a7f-3c1d-4f57-aa38-cc3d7e7707f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:21.246599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b38a7f-3c1d-4f57-aa38-cc3d7e7707f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:21.246896 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b38a7f-3c1d-4f57-aa38-cc3d7e7707f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:21.247216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b38a7f-3c1d-4f57-aa38-cc3d7e7707f1 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834/users/b9e5a4e3fd9a4d958241aa81bcf2cbdd/roles/b526c720d6b448189684bab16e2f425a` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:21.249260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b38a7f-3c1d-4f57-aa38-cc3d7e7707f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cac096f50b74f85bd46506ce124b834, user_id=b9e5a4e3fd9a4d958241aa81bcf2cbdd, role_id=b526c720d6b448189684bab16e2f425a)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:21.250776 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b38a7f-3c1d-4f57-aa38-cc3d7e7707f1 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:21.272999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 76/151] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:28:20 2022] PUT /identity/v3/projects/8cac096f50b74f85bd46506ce124b834/users/b9e5a4e3fd9a4d958241aa81bcf2cbdd/roles/b526c720d6b448189684bab16e2f425a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:28:21.363867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa01f47-5ac9-40a1-83e6-2b4c1ebd04a4 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:21.409121 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e94216-53ee-4a6b-9970-03341ee013e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:21.410612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e94216-53ee-4a6b-9970-03341ee013e3 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:21.410964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e94216-53ee-4a6b-9970-03341ee013e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:21.411246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e94216-53ee-4a6b-9970-03341ee013e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:21.412020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e94216-53ee-4a6b-9970-03341ee013e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:21.412328 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e94216-53ee-4a6b-9970-03341ee013e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:21.413740 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e94216-53ee-4a6b-9970-03341ee013e3 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:21.423183 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 76/152] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:21.431855 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b38a7f-3c1d-4f57-aa38-cc3d7e7707f1 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:21.541494 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b38a7f-3c1d-4f57-aa38-cc3d7e7707f1 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:21.576688 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1ca5b-931b-48e5-8cc9-d776450126a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:21.577589 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1ca5b-931b-48e5-8cc9-d776450126a6 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:21.577870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1ca5b-931b-48e5-8cc9-d776450126a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:21.578143 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1ca5b-931b-48e5-8cc9-d776450126a6 None admin] PATH_INFO: `/v3/users/19d06ea71ae34908aab1148a210d4a1c` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:21.579412 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1ca5b-931b-48e5-8cc9-d776450126a6 None admin] RBAC: Authorizing `identity:get_user(user_id=19d06ea71ae34908aab1148a210d4a1c)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:21.581475 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1ca5b-931b-48e5-8cc9-d776450126a6 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:21.583592 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 77/153] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:21 2022] GET /identity/v3/users/19d06ea71ae34908aab1148a210d4a1c => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:21.589200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e94216-53ee-4a6b-9970-03341ee013e3 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:21.703040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e94216-53ee-4a6b-9970-03341ee013e3 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:21.742579 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96c2dc-dbf6-4003-93cb-8ab51e0ecb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:21.743284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96c2dc-dbf6-4003-93cb-8ab51e0ecb33 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:21.743573 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96c2dc-dbf6-4003-93cb-8ab51e0ecb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:21.743855 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96c2dc-dbf6-4003-93cb-8ab51e0ecb33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:21.817245 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96c2dc-dbf6-4003-93cb-8ab51e0ecb33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:21.818657 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96c2dc-dbf6-4003-93cb-8ab51e0ecb33 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:21.924722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 77/154] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:21.930995 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1ca5b-931b-48e5-8cc9-d776450126a6 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:22.036425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1ca5b-931b-48e5-8cc9-d776450126a6 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:22.071451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34212d00-095f-4fa6-a037-d7fe87fccad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:22.072320 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212d00-095f-4fa6-a037-d7fe87fccad7 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:22.072598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212d00-095f-4fa6-a037-d7fe87fccad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:22.072868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212d00-095f-4fa6-a037-d7fe87fccad7 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:22.074056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34212d00-095f-4fa6-a037-d7fe87fccad7 None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:22.075537 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34212d00-095f-4fa6-a037-d7fe87fccad7 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:22.077626 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 78/155] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:21 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:22.083356 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96c2dc-dbf6-4003-93cb-8ab51e0ecb33 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:22.183721 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96c2dc-dbf6-4003-93cb-8ab51e0ecb33 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:22.218992 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2d4ce-fe74-4227-b9a2-a190f0af6288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:22.219749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2d4ce-fe74-4227-b9a2-a190f0af6288 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:22.219923 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2d4ce-fe74-4227-b9a2-a190f0af6288 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:22.220186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2d4ce-fe74-4227-b9a2-a190f0af6288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:22.221023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2d4ce-fe74-4227-b9a2-a190f0af6288 None admin] RBAC: Adding query filter params (role.id=aac74c237ff74c5199b863b81ced5058, scope.project.id=8cac096f50b74f85bd46506ce124b834, user.id=19d06ea71ae34908aab1148a210d4a1c) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:22.221334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2d4ce-fe74-4227-b9a2-a190f0af6288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:22.222942 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2d4ce-fe74-4227-b9a2-a190f0af6288 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:22.231879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 78/156] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:22 2022] GET /identity/v3/role_assignments?user.id=19d06ea71ae34908aab1148a210d4a1c&scope.project.id=8cac096f50b74f85bd46506ce124b834&role.id=aac74c237ff74c5199b863b81ced5058 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:22.310085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858be2-09ef-4013-9b39-18980c25b284 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:22.310755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858be2-09ef-4013-9b39-18980c25b284 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:22.310755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858be2-09ef-4013-9b39-18980c25b284 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:22.312163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 79/157] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:22.318552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12832ec8-8760-4bf1-bc98-b7055f05ca06 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:22.318882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12832ec8-8760-4bf1-bc98-b7055f05ca06 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:22.319167 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12832ec8-8760-4bf1-bc98-b7055f05ca06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:22.348599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-12832ec8-8760-4bf1-bc98-b7055f05ca06 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:22.349743 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-12832ec8-8760-4bf1-bc98-b7055f05ca06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:22.437207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 79/158] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:22.473076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48858be2-09ef-4013-9b39-18980c25b284 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:22.599543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48858be2-09ef-4013-9b39-18980c25b284 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:22.639580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cf984-6e40-4382-bf7c-5dd16af9be77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:22.640413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cf984-6e40-4382-bf7c-5dd16af9be77 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:22.640692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cf984-6e40-4382-bf7c-5dd16af9be77 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:22.640967 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cf984-6e40-4382-bf7c-5dd16af9be77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:22.657059 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cf984-6e40-4382-bf7c-5dd16af9be77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-f51cf984-6e40-4382-bf7c-5dd16af9be77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:22.668556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:22.670781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:22.672700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:22.672700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:22.672700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:22.672700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:22.672700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:22.672700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:22.672700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:22.672700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:22.672700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:22.672700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:22.672700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:22.672700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:22.672700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 80/159] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:28:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:22.680660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12832ec8-8760-4bf1-bc98-b7055f05ca06 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:22.810197 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12832ec8-8760-4bf1-bc98-b7055f05ca06 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:22.847206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3ec52-0d30-43c5-a2db-d6a493407a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:22.848230 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3ec52-0d30-43c5-a2db-d6a493407a7f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:22.848745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3ec52-0d30-43c5-a2db-d6a493407a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:22.849229 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3ec52-0d30-43c5-a2db-d6a493407a7f None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:22.850230 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3ec52-0d30-43c5-a2db-d6a493407a7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:22.850757 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3ec52-0d30-43c5-a2db-d6a493407a7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:22.852351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3ec52-0d30-43c5-a2db-d6a493407a7f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:22.866732 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 80/160] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:28:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:22.872647 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cf984-6e40-4382-bf7c-5dd16af9be77 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:23.001227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cf984-6e40-4382-bf7c-5dd16af9be77 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:23.041227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54153e-3752-4c29-b84e-9a651bccaede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:23.042111 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54153e-3752-4c29-b84e-9a651bccaede None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:23.042385 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54153e-3752-4c29-b84e-9a651bccaede None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:23.042662 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54153e-3752-4c29-b84e-9a651bccaede None admin] PATH_INFO: `/v3/users/19d06ea71ae34908aab1148a210d4a1c` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:23.043908 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54153e-3752-4c29-b84e-9a651bccaede None admin] RBAC: Authorizing `identity:get_user(user_id=19d06ea71ae34908aab1148a210d4a1c)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:23.045356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54153e-3752-4c29-b84e-9a651bccaede None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:23.047052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 81/161] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:22 2022] GET /identity/v3/users/19d06ea71ae34908aab1148a210d4a1c => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:23.053431 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3ec52-0d30-43c5-a2db-d6a493407a7f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:23.198991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3ec52-0d30-43c5-a2db-d6a493407a7f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:23.236873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f6c6a-63e6-4460-b2a0-7e79449ad569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:23.238497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f6c6a-63e6-4460-b2a0-7e79449ad569 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:23.238741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f6c6a-63e6-4460-b2a0-7e79449ad569 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:23.241454 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f6c6a-63e6-4460-b2a0-7e79449ad569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:23.322209 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f6c6a-63e6-4460-b2a0-7e79449ad569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:23.323720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f6c6a-63e6-4460-b2a0-7e79449ad569 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:23.457657 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 81/162] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:23.463004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54153e-3752-4c29-b84e-9a651bccaede None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:23.609434 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54153e-3752-4c29-b84e-9a651bccaede None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:23.652440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7aee72-0d32-41bc-98ed-4c76bef05a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:23.653660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aee72-0d32-41bc-98ed-4c76bef05a7e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:23.654148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aee72-0d32-41bc-98ed-4c76bef05a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:23.654625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7aee72-0d32-41bc-98ed-4c76bef05a7e None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:23.659455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7aee72-0d32-41bc-98ed-4c76bef05a7e None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:23.661148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7aee72-0d32-41bc-98ed-4c76bef05a7e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:23.663111 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 82/163] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:23 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:23.668951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f6c6a-63e6-4460-b2a0-7e79449ad569 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:23.679163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd032796-104b-4b60-a90e-6d79a9f71249 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:23.679753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd032796-104b-4b60-a90e-6d79a9f71249 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:23.680229 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd032796-104b-4b60-a90e-6d79a9f71249 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:23.681817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 83/164] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:28:23.691711 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc3f82-566a-42c3-ac43-ea6f0911b5da None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:23.692263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc3f82-566a-42c3-ac43-ea6f0911b5da None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:23.692745 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc3f82-566a-42c3-ac43-ea6f0911b5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:23.719726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-1edc3f82-566a-42c3-ac43-ea6f0911b5da None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:23.721272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-1edc3f82-566a-42c3-ac43-ea6f0911b5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:23.836756 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f6c6a-63e6-4460-b2a0-7e79449ad569 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:23.876997 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 84/165] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:23.894403 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515739c-9071-4455-bb5d-a16c73b3f7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:23.895454 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515739c-9071-4455-bb5d-a16c73b3f7eb None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:23.895933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515739c-9071-4455-bb5d-a16c73b3f7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:23.896411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515739c-9071-4455-bb5d-a16c73b3f7eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:23.897465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515739c-9071-4455-bb5d-a16c73b3f7eb None admin] RBAC: Adding query filter params (role.id=b63d5637c42b47588880ae919eb7f448, scope.project.id=8cac096f50b74f85bd46506ce124b834, user.id=19d06ea71ae34908aab1148a210d4a1c) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:23.897975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515739c-9071-4455-bb5d-a16c73b3f7eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:23.899736 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515739c-9071-4455-bb5d-a16c73b3f7eb None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:23.911687 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 82/166] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:23 2022] GET /identity/v3/role_assignments?user.id=19d06ea71ae34908aab1148a210d4a1c&scope.project.id=8cac096f50b74f85bd46506ce124b834&role.id=b63d5637c42b47588880ae919eb7f448 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:23.920957 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc3f82-566a-42c3-ac43-ea6f0911b5da None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:24.039212 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc3f82-566a-42c3-ac43-ea6f0911b5da None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:24.079017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65046ae5-82ca-47a7-836d-cf44429b13e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:24.080181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65046ae5-82ca-47a7-836d-cf44429b13e3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:24.080684 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65046ae5-82ca-47a7-836d-cf44429b13e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:24.081721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65046ae5-82ca-47a7-836d-cf44429b13e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:24.098315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65046ae5-82ca-47a7-836d-cf44429b13e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-65046ae5-82ca-47a7-836d-cf44429b13e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:24.106426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:24.107522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:24.108517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:24.108517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:24.108517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:24.108517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:24.108517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:24.108517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:24.108517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:24.108517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:24.108517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:24.108517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:24.108517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:24.108517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:24.110691 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 85/167] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:28:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:24.116641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515739c-9071-4455-bb5d-a16c73b3f7eb None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:24.250815 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515739c-9071-4455-bb5d-a16c73b3f7eb None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:24.303221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab61f9c-9007-4714-a304-927ac5b06430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:24.304119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab61f9c-9007-4714-a304-927ac5b06430 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:24.304567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab61f9c-9007-4714-a304-927ac5b06430 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:24.304988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab61f9c-9007-4714-a304-927ac5b06430 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:24.305890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab61f9c-9007-4714-a304-927ac5b06430 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:24.306339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab61f9c-9007-4714-a304-927ac5b06430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:24.307894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab61f9c-9007-4714-a304-927ac5b06430 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:24.323328 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 83/168] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:24.328739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65046ae5-82ca-47a7-836d-cf44429b13e3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:24.371856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52d875-b029-4616-998d-06e83c0ea4f9 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:24.372369 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52d875-b029-4616-998d-06e83c0ea4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:24.372792 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52d875-b029-4616-998d-06e83c0ea4f9 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:24.374339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 84/169] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:28:24.381489 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a647123-e285-45d7-8c6b-a526c6e5e675 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:24.381972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a647123-e285-45d7-8c6b-a526c6e5e675 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:24.382396 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a647123-e285-45d7-8c6b-a526c6e5e675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:24.408093 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-3a647123-e285-45d7-8c6b-a526c6e5e675 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:24.410483 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3a647123-e285-45d7-8c6b-a526c6e5e675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:24.508361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 85/170] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:24.511158 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7ae5d-21d3-4af8-9be6-4ff043e2f60b None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:24.512251 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7ae5d-21d3-4af8-9be6-4ff043e2f60b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:24.513228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7ae5d-21d3-4af8-9be6-4ff043e2f60b None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:24.516985 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65046ae5-82ca-47a7-836d-cf44429b13e3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:24.517723 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 86/171] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:24.523955 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ef3af-814d-41f4-8090-60f28451af0f None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:24.524404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ef3af-814d-41f4-8090-60f28451af0f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:24.524824 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ef3af-814d-41f4-8090-60f28451af0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:24.556238 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-cf6ef3af-814d-41f4-8090-60f28451af0f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:24.557655 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-cf6ef3af-814d-41f4-8090-60f28451af0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:24.570696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ad9e9-9d1a-4c5c-8b32-49f5d277a66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:24.570696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ad9e9-9d1a-4c5c-8b32-49f5d277a66a None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:24.570696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ad9e9-9d1a-4c5c-8b32-49f5d277a66a None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:24.570696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ad9e9-9d1a-4c5c-8b32-49f5d277a66a None admin] PATH_INFO: `/v3/users/fcec6386453a4aeb83b0960ebf40f96e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:24.571111 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ad9e9-9d1a-4c5c-8b32-49f5d277a66a None admin] RBAC: Authorizing `identity:get_user(user_id=fcec6386453a4aeb83b0960ebf40f96e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:24.572015 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ad9e9-9d1a-4c5c-8b32-49f5d277a66a None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:24.573757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 86/172] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:24 2022] GET /identity/v3/users/fcec6386453a4aeb83b0960ebf40f96e => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:24.574628 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ad9e9-9d1a-4c5c-8b32-49f5d277a66a None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:24.651186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 87/173] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:24.652325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ef3af-814d-41f4-8090-60f28451af0f None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:24.690981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ad9e9-9d1a-4c5c-8b32-49f5d277a66a None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:24.734148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9fa1c-f2cb-4ab5-b5e8-b45f7e3c8e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:24.739290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9fa1c-f2cb-4ab5-b5e8-b45f7e3c8e0c None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:24.739699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9fa1c-f2cb-4ab5-b5e8-b45f7e3c8e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:24.740081 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9fa1c-f2cb-4ab5-b5e8-b45f7e3c8e0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:24.750852 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9fa1c-f2cb-4ab5-b5e8-b45f7e3c8e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:24.758618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ef3af-814d-41f4-8090-60f28451af0f None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-79e9fa1c-f2cb-4ab5-b5e8-b45f7e3c8e0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:24.763017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:24.764288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:24.765268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:24.765268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:24.765268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:24.765268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:24.765268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:24.765268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:24.765268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:24.765268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:24.765268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:24.765268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:24.765268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:24.765268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:24.767070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 87/174] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:24.767945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9fa1c-f2cb-4ab5-b5e8-b45f7e3c8e0c None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:24.798789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e36b80-094e-44f0-992a-a53587757744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:24.800286 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e36b80-094e-44f0-992a-a53587757744 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:24.800716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e36b80-094e-44f0-992a-a53587757744 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:24.801116 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e36b80-094e-44f0-992a-a53587757744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:24.870201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e36b80-094e-44f0-992a-a53587757744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:24.871994 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e36b80-094e-44f0-992a-a53587757744 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:24.876816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9fa1c-f2cb-4ab5-b5e8-b45f7e3c8e0c None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:24.912525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abdb63-245b-4b5d-b63f-2582e0fb9df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:24.913059 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abdb63-245b-4b5d-b63f-2582e0fb9df5 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:24.913409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abdb63-245b-4b5d-b63f-2582e0fb9df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:24.913749 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abdb63-245b-4b5d-b63f-2582e0fb9df5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:24.924464 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abdb63-245b-4b5d-b63f-2582e0fb9df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-f3abdb63-245b-4b5d-b63f-2582e0fb9df5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:24.934748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:24.935670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:24.936652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:24.936652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:24.936652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:24.936652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:24.936652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:24.936652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:24.936652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:24.936652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:24.936652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:24.936652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:24.936652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:24.936652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:24.936652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 88/175] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:28:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:24.937501 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abdb63-245b-4b5d-b63f-2582e0fb9df5 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:24.978813 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 88/176] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:24.980110 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e36b80-094e-44f0-992a-a53587757744 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:25.077937 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abdb63-245b-4b5d-b63f-2582e0fb9df5 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:25.086089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e36b80-094e-44f0-992a-a53587757744 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:25.121884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0d7bc-29cf-4b49-8f71-2660461c2063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:25.122918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0d7bc-29cf-4b49-8f71-2660461c2063 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:25.123406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0d7bc-29cf-4b49-8f71-2660461c2063 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:25.123877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0d7bc-29cf-4b49-8f71-2660461c2063 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:25.124824 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0d7bc-29cf-4b49-8f71-2660461c2063 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:25.125350 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0d7bc-29cf-4b49-8f71-2660461c2063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:25.126961 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0d7bc-29cf-4b49-8f71-2660461c2063 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:25.135410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73c30e-6471-47af-8de9-89d86e811a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:25.136093 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73c30e-6471-47af-8de9-89d86e811a75 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:25.136376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73c30e-6471-47af-8de9-89d86e811a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:25.136651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73c30e-6471-47af-8de9-89d86e811a75 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:25.137403 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73c30e-6471-47af-8de9-89d86e811a75 None admin] RBAC: Adding query filter params (name=member) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:25.137706 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73c30e-6471-47af-8de9-89d86e811a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:25.138258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 89/177] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:25.139131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73c30e-6471-47af-8de9-89d86e811a75 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:25.139651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0d7bc-29cf-4b49-8f71-2660461c2063 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:25.153013 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 89/178] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:25.157727 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73c30e-6471-47af-8de9-89d86e811a75 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:25.252516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0d7bc-29cf-4b49-8f71-2660461c2063 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:25.291684 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73c30e-6471-47af-8de9-89d86e811a75 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:25.293456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2d750-b360-4e1f-a13b-bd33d8e7e182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:25.294549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d750-b360-4e1f-a13b-bd33d8e7e182 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:25.295056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d750-b360-4e1f-a13b-bd33d8e7e182 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:25.295524 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d750-b360-4e1f-a13b-bd33d8e7e182 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:25.296944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2d750-b360-4e1f-a13b-bd33d8e7e182 None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:25.298629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2d750-b360-4e1f-a13b-bd33d8e7e182 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:25.301329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 90/179] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:25 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:25.302367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2d750-b360-4e1f-a13b-bd33d8e7e182 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:25.337825 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fb82a-f1a6-4083-9c31-c524418c56cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:25.338853 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fb82a-f1a6-4083-9c31-c524418c56cc None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:25.339160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fb82a-f1a6-4083-9c31-c524418c56cc None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:25.339435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fb82a-f1a6-4083-9c31-c524418c56cc None admin] PATH_INFO: `/v3/users/e3ad3f8011e8471eaf0ca4d134fa6a95` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:25.356347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fb82a-f1a6-4083-9c31-c524418c56cc None admin] RBAC: Authorizing `identity:get_user(user_id=e3ad3f8011e8471eaf0ca4d134fa6a95)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:25.357831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fb82a-f1a6-4083-9c31-c524418c56cc None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:25.362748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 90/180] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:25 2022] GET /identity/v3/users/e3ad3f8011e8471eaf0ca4d134fa6a95 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:25.364484 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01100c45-63bd-4be0-985b-50bdf2776e89 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:25.365068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01100c45-63bd-4be0-985b-50bdf2776e89 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:25.365598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01100c45-63bd-4be0-985b-50bdf2776e89 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:25.367900 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 91/181] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:25.369770 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01100c45-63bd-4be0-985b-50bdf2776e89 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:25.427882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2d750-b360-4e1f-a13b-bd33d8e7e182 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:25.473942 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abea982-ee57-4037-b18d-ef4347f20392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:25.475021 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abea982-ee57-4037-b18d-ef4347f20392 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:25.475425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abea982-ee57-4037-b18d-ef4347f20392 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:25.475801 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abea982-ee57-4037-b18d-ef4347f20392 None admin] PATH_INFO: `/v3/users/19d06ea71ae34908aab1148a210d4a1c` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:25.477814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abea982-ee57-4037-b18d-ef4347f20392 None admin] RBAC: Authorizing `identity:get_user(user_id=19d06ea71ae34908aab1148a210d4a1c)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:25.479899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abea982-ee57-4037-b18d-ef4347f20392 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:25.486977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 91/182] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:25 2022] GET /identity/v3/users/19d06ea71ae34908aab1148a210d4a1c => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:25.486977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abea982-ee57-4037-b18d-ef4347f20392 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:25.497763 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01100c45-63bd-4be0-985b-50bdf2776e89 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:25.545377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfade0-e1c9-48e9-90a1-c5b16fb8cfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:25.546171 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfade0-e1c9-48e9-90a1-c5b16fb8cfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:25.546347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfade0-e1c9-48e9-90a1-c5b16fb8cfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:25.546579 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfade0-e1c9-48e9-90a1-c5b16fb8cfe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:25.547449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfade0-e1c9-48e9-90a1-c5b16fb8cfe3 None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=8cac096f50b74f85bd46506ce124b834, user.id=fcec6386453a4aeb83b0960ebf40f96e) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:25.547757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfade0-e1c9-48e9-90a1-c5b16fb8cfe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:25.550345 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfade0-e1c9-48e9-90a1-c5b16fb8cfe3 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:25.558378 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 92/183] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:25 2022] GET /identity/v3/role_assignments?user.id=fcec6386453a4aeb83b0960ebf40f96e&scope.project.id=8cac096f50b74f85bd46506ce124b834&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:25.563610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f78e8-d52a-4825-9fe1-14087e78a743 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:25.564227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f78e8-d52a-4825-9fe1-14087e78a743 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:25.564716 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f78e8-d52a-4825-9fe1-14087e78a743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:25.599787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-e39f78e8-d52a-4825-9fe1-14087e78a743 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:25.602752 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e39f78e8-d52a-4825-9fe1-14087e78a743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:25.638099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abea982-ee57-4037-b18d-ef4347f20392 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:25.685346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec822c-8d08-434a-b947-986db09764db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:25.686521 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec822c-8d08-434a-b947-986db09764db None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:25.687322 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec822c-8d08-434a-b947-986db09764db None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:25.688026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec822c-8d08-434a-b947-986db09764db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:25.691645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 93/184] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:25.692722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f78e8-d52a-4825-9fe1-14087e78a743 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:25.762826 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec822c-8d08-434a-b947-986db09764db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:25.764372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec822c-8d08-434a-b947-986db09764db None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:25.796091 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f78e8-d52a-4825-9fe1-14087e78a743 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:25.831812 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61304f9a-5a63-4064-b3c4-805160d29a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:25.832462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61304f9a-5a63-4064-b3c4-805160d29a50 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:25.832739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61304f9a-5a63-4064-b3c4-805160d29a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:25.833014 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61304f9a-5a63-4064-b3c4-805160d29a50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:25.873213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 92/185] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:25.874547 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f518ee-78bb-4249-960d-8c356df0f18c None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:25.874870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f518ee-78bb-4249-960d-8c356df0f18c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:25.875141 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f518ee-78bb-4249-960d-8c356df0f18c None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:25.876559 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 93/186] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:25.879797 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ffceb-f056-4306-b779-49fb96ecc81a None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:25.880080 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ffceb-f056-4306-b779-49fb96ecc81a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:25.880372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ffceb-f056-4306-b779-49fb96ecc81a None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:25.881639 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 94/187] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:25.882333 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ffceb-f056-4306-b779-49fb96ecc81a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:25.907155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61304f9a-5a63-4064-b3c4-805160d29a50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:25.908642 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61304f9a-5a63-4064-b3c4-805160d29a50 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:25.978872 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ffceb-f056-4306-b779-49fb96ecc81a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:26.006603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 94/188] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:26.007717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61304f9a-5a63-4064-b3c4-805160d29a50 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:26.010381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3586d2-e0e2-45d8-9df2-88b73bc3190f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:26.011214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3586d2-e0e2-45d8-9df2-88b73bc3190f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:26.011493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3586d2-e0e2-45d8-9df2-88b73bc3190f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:26.011762 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3586d2-e0e2-45d8-9df2-88b73bc3190f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:26.022064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3586d2-e0e2-45d8-9df2-88b73bc3190f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-bd3586d2-e0e2-45d8-9df2-88b73bc3190f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:26.030074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:26.030969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:26.031749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:26.031749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:26.031749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:26.031749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:26.031749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:26.031749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:26.031749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:26.031749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:26.031749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:26.031749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:26.031749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:26.031749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:26.031749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 95/189] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:28:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:26.036363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2f6f-66c2-43e9-b57e-6efe2f54f5cf None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:26.036363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2f6f-66c2-43e9-b57e-6efe2f54f5cf None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:26.036363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2f6f-66c2-43e9-b57e-6efe2f54f5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:26.051054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-cdbe2f6f-66c2-43e9-b57e-6efe2f54f5cf None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:26.052237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-cdbe2f6f-66c2-43e9-b57e-6efe2f54f5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:26.105481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61304f9a-5a63-4064-b3c4-805160d29a50 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:26.115405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 96/190] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:26.116654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754e28-672a-4d0e-83cf-466aa997d8e2 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:26.116969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754e28-672a-4d0e-83cf-466aa997d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:26.117290 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754e28-672a-4d0e-83cf-466aa997d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:26.133352 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-b9754e28-672a-4d0e-83cf-466aa997d8e2 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:26.134512 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b9754e28-672a-4d0e-83cf-466aa997d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:26.138881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151d392-6099-4174-8793-933ce3ae1274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:26.140067 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151d392-6099-4174-8793-933ce3ae1274 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:26.140353 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151d392-6099-4174-8793-933ce3ae1274 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:26.140625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151d392-6099-4174-8793-933ce3ae1274 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:26.141828 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151d392-6099-4174-8793-933ce3ae1274 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:26.143348 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151d392-6099-4174-8793-933ce3ae1274 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:26.145583 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 95/191] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:26 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:26.146413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151d392-6099-4174-8793-933ce3ae1274 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:26.199344 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 97/192] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:26.200187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9754e28-672a-4d0e-83cf-466aa997d8e2 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:26.242631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151d392-6099-4174-8793-933ce3ae1274 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:26.276023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed42471-79ea-4bf1-9e34-b74e7685436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:26.276865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed42471-79ea-4bf1-9e34-b74e7685436b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:26.277139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed42471-79ea-4bf1-9e34-b74e7685436b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:26.277406 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed42471-79ea-4bf1-9e34-b74e7685436b None admin] PATH_INFO: `/v3/projects/5eb93debd5794f5fa7a7e7950d977216` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:26.278572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed42471-79ea-4bf1-9e34-b74e7685436b None admin] RBAC: Authorizing `identity:get_project(project_id=5eb93debd5794f5fa7a7e7950d977216)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:26.280026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed42471-79ea-4bf1-9e34-b74e7685436b None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:26.281709 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 96/193] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:26 2022] GET /identity/v3/projects/5eb93debd5794f5fa7a7e7950d977216 => generated 312 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:26.282451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed42471-79ea-4bf1-9e34-b74e7685436b None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:26.296694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9754e28-672a-4d0e-83cf-466aa997d8e2 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:26.329437 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40400d1-ac31-44ac-8d25-21bed39d7e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:26.330104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40400d1-ac31-44ac-8d25-21bed39d7e38 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:26.330385 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40400d1-ac31-44ac-8d25-21bed39d7e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:26.330658 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40400d1-ac31-44ac-8d25-21bed39d7e38 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:26.331999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40400d1-ac31-44ac-8d25-21bed39d7e38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:26.332297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40400d1-ac31-44ac-8d25-21bed39d7e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:26.333688 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40400d1-ac31-44ac-8d25-21bed39d7e38 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:26.341364 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 98/194] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:28:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:26.341364 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40400d1-ac31-44ac-8d25-21bed39d7e38 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:26.377310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed42471-79ea-4bf1-9e34-b74e7685436b None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:26.409737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56942cc3-33ed-4917-bcf7-be811c07c8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:26.410523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56942cc3-33ed-4917-bcf7-be811c07c8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:26.410830 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56942cc3-33ed-4917-bcf7-be811c07c8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:26.411106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56942cc3-33ed-4917-bcf7-be811c07c8a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:26.412281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56942cc3-33ed-4917-bcf7-be811c07c8a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:26.413724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56942cc3-33ed-4917-bcf7-be811c07c8a7 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:26.415380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 97/195] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:28:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:26.416137 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56942cc3-33ed-4917-bcf7-be811c07c8a7 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:26.436978 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40400d1-ac31-44ac-8d25-21bed39d7e38 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:26.468626 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c428ef-89e2-47e5-8373-846fd2c6bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:26.469331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c428ef-89e2-47e5-8373-846fd2c6bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:26.469611 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c428ef-89e2-47e5-8373-846fd2c6bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:26.469883 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c428ef-89e2-47e5-8373-846fd2c6bdc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:26.470737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c428ef-89e2-47e5-8373-846fd2c6bdc7 None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e, user.id=e3ad3f8011e8471eaf0ca4d134fa6a95) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:26.471051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c428ef-89e2-47e5-8373-846fd2c6bdc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:26.473031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c428ef-89e2-47e5-8373-846fd2c6bdc7 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:26.478284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 99/196] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:26 2022] GET /identity/v3/role_assignments?user.id=e3ad3f8011e8471eaf0ca4d134fa6a95&scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:26.479095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c428ef-89e2-47e5-8373-846fd2c6bdc7 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:26.514271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56942cc3-33ed-4917-bcf7-be811c07c8a7 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:26.550422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b46c84-955f-453d-b2db-8db6004a39c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:26.551324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b46c84-955f-453d-b2db-8db6004a39c3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:26.551600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b46c84-955f-453d-b2db-8db6004a39c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:26.551877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b46c84-955f-453d-b2db-8db6004a39c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:26.563314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b46c84-955f-453d-b2db-8db6004a39c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-23b46c84-955f-453d-b2db-8db6004a39c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:26.571701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:26.572866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:26.573952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:26.573952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:26.573952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:26.573952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:26.573952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:26.573952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:26.573952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:26.573952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:26.573952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:26.573952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:26.573952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:26.573952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:26.573952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 98/197] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:26.573952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b46c84-955f-453d-b2db-8db6004a39c3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:26.593015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c428ef-89e2-47e5-8373-846fd2c6bdc7 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:26.629461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f4f1b-d291-40c1-abc8-2103158278cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:26.630478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f4f1b-d291-40c1-abc8-2103158278cc None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:26.630988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f4f1b-d291-40c1-abc8-2103158278cc None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:26.631459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f4f1b-d291-40c1-abc8-2103158278cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:26.632391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f4f1b-d291-40c1-abc8-2103158278cc None admin] RBAC: Adding query filter params (role.id=aac74c237ff74c5199b863b81ced5058, scope.project.id=5eb93debd5794f5fa7a7e7950d977216, user.id=19d06ea71ae34908aab1148a210d4a1c) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:26.632976 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f4f1b-d291-40c1-abc8-2103158278cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:26.634460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f4f1b-d291-40c1-abc8-2103158278cc None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:26.650709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 100/198] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:26 2022] GET /identity/v3/role_assignments?user.id=19d06ea71ae34908aab1148a210d4a1c&scope.project.id=5eb93debd5794f5fa7a7e7950d977216&role.id=aac74c237ff74c5199b863b81ced5058 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:26.650709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f4f1b-d291-40c1-abc8-2103158278cc None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:26.682645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b46c84-955f-453d-b2db-8db6004a39c3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:26.718868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207632a-d4ce-416b-b202-61ce7a3bbc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:26.719755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207632a-d4ce-416b-b202-61ce7a3bbc6f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:26.720154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207632a-d4ce-416b-b202-61ce7a3bbc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:26.720344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207632a-d4ce-416b-b202-61ce7a3bbc6f None admin] PATH_INFO: `/v3/users/e3ad3f8011e8471eaf0ca4d134fa6a95` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:26.722182 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207632a-d4ce-416b-b202-61ce7a3bbc6f None admin] RBAC: Authorizing `identity:get_user(user_id=e3ad3f8011e8471eaf0ca4d134fa6a95)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:26.723674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207632a-d4ce-416b-b202-61ce7a3bbc6f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:26.725467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 99/199] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:26 2022] GET /identity/v3/users/e3ad3f8011e8471eaf0ca4d134fa6a95 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:26.726165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207632a-d4ce-416b-b202-61ce7a3bbc6f None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:26.787873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f4f1b-d291-40c1-abc8-2103158278cc None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:26.832914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbf638-6f9b-4297-9f44-c95cc78d4153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:26.832914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf638-6f9b-4297-9f44-c95cc78d4153 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:26.832914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf638-6f9b-4297-9f44-c95cc78d4153 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:26.832914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf638-6f9b-4297-9f44-c95cc78d4153 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:26.835605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbf638-6f9b-4297-9f44-c95cc78d4153 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:26.835605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbf638-6f9b-4297-9f44-c95cc78d4153 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:26.836764 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207632a-d4ce-416b-b202-61ce7a3bbc6f None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:26.858212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 101/200] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:28:26 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:26.859086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbf638-6f9b-4297-9f44-c95cc78d4153 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:26.894503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb487a-153d-4e60-a486-cb7978d343ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:26.895798 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb487a-153d-4e60-a486-cb7978d343ba None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:26.896318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb487a-153d-4e60-a486-cb7978d343ba None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:26.896797 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb487a-153d-4e60-a486-cb7978d343ba None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:26.897843 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb487a-153d-4e60-a486-cb7978d343ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:26.898379 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb487a-153d-4e60-a486-cb7978d343ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:26.900082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb487a-153d-4e60-a486-cb7978d343ba None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:26.910329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 100/201] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:26.916313 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb487a-153d-4e60-a486-cb7978d343ba None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:26.994738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbf638-6f9b-4297-9f44-c95cc78d4153 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:27.035904 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb487a-153d-4e60-a486-cb7978d343ba None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:27.044190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56ff77-ffba-40d3-85ca-2b5bbe545198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:27.044794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56ff77-ffba-40d3-85ca-2b5bbe545198 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:27.045078 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56ff77-ffba-40d3-85ca-2b5bbe545198 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:27.045357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56ff77-ffba-40d3-85ca-2b5bbe545198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:27.078436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824c9c7-a4bc-4c58-9cc5-021179f2ef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:27.079360 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824c9c7-a4bc-4c58-9cc5-021179f2ef52 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:27.079644 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824c9c7-a4bc-4c58-9cc5-021179f2ef52 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:27.079921 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824c9c7-a4bc-4c58-9cc5-021179f2ef52 None admin] PATH_INFO: `/v3/users/b9e5a4e3fd9a4d958241aa81bcf2cbdd` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:27.082112 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824c9c7-a4bc-4c58-9cc5-021179f2ef52 None admin] RBAC: Authorizing `identity:get_user(user_id=b9e5a4e3fd9a4d958241aa81bcf2cbdd)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:27.083605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824c9c7-a4bc-4c58-9cc5-021179f2ef52 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:27.085437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 101/202] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:26 2022] GET /identity/v3/users/b9e5a4e3fd9a4d958241aa81bcf2cbdd => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:27.090586 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824c9c7-a4bc-4c58-9cc5-021179f2ef52 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:27.130832 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56ff77-ffba-40d3-85ca-2b5bbe545198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:27.132305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56ff77-ffba-40d3-85ca-2b5bbe545198 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:27.216153 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824c9c7-a4bc-4c58-9cc5-021179f2ef52 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:27.248261 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 102/203] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:27.255845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56ff77-ffba-40d3-85ca-2b5bbe545198 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:27.260869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad88cca-2354-46b3-9476-9d66b7ccbec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:27.261575 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88cca-2354-46b3-9476-9d66b7ccbec0 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:27.261807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88cca-2354-46b3-9476-9d66b7ccbec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:27.262080 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88cca-2354-46b3-9476-9d66b7ccbec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:27.351184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad88cca-2354-46b3-9476-9d66b7ccbec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:27.352657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad88cca-2354-46b3-9476-9d66b7ccbec0 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:27.380711 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56ff77-ffba-40d3-85ca-2b5bbe545198 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:27.416537 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b6901-1727-447a-8cbc-e1bfaf896c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:27.417399 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b6901-1727-447a-8cbc-e1bfaf896c15 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:27.417674 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b6901-1727-447a-8cbc-e1bfaf896c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:27.417941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b6901-1727-447a-8cbc-e1bfaf896c15 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:27.419188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b6901-1727-447a-8cbc-e1bfaf896c15 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:27.420761 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b6901-1727-447a-8cbc-e1bfaf896c15 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:27.422863 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 103/204] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:27 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:27.429978 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b6901-1727-447a-8cbc-e1bfaf896c15 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:27.460859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 102/205] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 17:28:27.466438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad88cca-2354-46b3-9476-9d66b7ccbec0 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:27.532659 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b6901-1727-447a-8cbc-e1bfaf896c15 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:27.567302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad88cca-2354-46b3-9476-9d66b7ccbec0 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:27.569571 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a879a6-bc97-449f-9c7c-b197dc5e566b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:27.570330 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a879a6-bc97-449f-9c7c-b197dc5e566b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:27.570655 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a879a6-bc97-449f-9c7c-b197dc5e566b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:27.570954 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a879a6-bc97-449f-9c7c-b197dc5e566b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:27.571781 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a879a6-bc97-449f-9c7c-b197dc5e566b None admin] RBAC: Adding query filter params (role.id=b63d5637c42b47588880ae919eb7f448, scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e, user.id=e3ad3f8011e8471eaf0ca4d134fa6a95) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:27.572083 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a879a6-bc97-449f-9c7c-b197dc5e566b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:27.573647 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a879a6-bc97-449f-9c7c-b197dc5e566b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:27.579703 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 104/206] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:27 2022] GET /identity/v3/role_assignments?user.id=e3ad3f8011e8471eaf0ca4d134fa6a95&scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e&role.id=b63d5637c42b47588880ae919eb7f448 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:27.603414 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114a2c9-49d2-47c5-8281-69f63e73dda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:27.604218 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114a2c9-49d2-47c5-8281-69f63e73dda2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:27.604502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114a2c9-49d2-47c5-8281-69f63e73dda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:27.604778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114a2c9-49d2-47c5-8281-69f63e73dda2 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:27.606080 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114a2c9-49d2-47c5-8281-69f63e73dda2 None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:27.607604 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114a2c9-49d2-47c5-8281-69f63e73dda2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:27.609422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 103/207] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:27 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:27.616462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a879a6-bc97-449f-9c7c-b197dc5e566b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:27.774854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a879a6-bc97-449f-9c7c-b197dc5e566b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:27.824139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a77a7-fb2e-4c61-88fe-a1c76df83887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:27.824794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a77a7-fb2e-4c61-88fe-a1c76df83887 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:27.825071 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a77a7-fb2e-4c61-88fe-a1c76df83887 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:27.825339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a77a7-fb2e-4c61-88fe-a1c76df83887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:27.826166 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a77a7-fb2e-4c61-88fe-a1c76df83887 None admin] RBAC: Adding query filter params (role.id=b526c720d6b448189684bab16e2f425a, scope.project.id=8cac096f50b74f85bd46506ce124b834, user.id=b9e5a4e3fd9a4d958241aa81bcf2cbdd) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:27.826468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a77a7-fb2e-4c61-88fe-a1c76df83887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:27.827976 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a77a7-fb2e-4c61-88fe-a1c76df83887 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:27.834645 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 105/208] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:27 2022] GET /identity/v3/role_assignments?user.id=b9e5a4e3fd9a4d958241aa81bcf2cbdd&scope.project.id=8cac096f50b74f85bd46506ce124b834&role.id=b526c720d6b448189684bab16e2f425a => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:29.019686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0a0ba-04ca-4989-96e6-6a2dd63c7ac8 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:29.019686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0a0ba-04ca-4989-96e6-6a2dd63c7ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:29.019686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0a0ba-04ca-4989-96e6-6a2dd63c7ac8 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:29.023541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 104/209] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:29.027257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92fa9c-227a-4135-8454-d8a1e78f39d9 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:29.028084 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92fa9c-227a-4135-8454-d8a1e78f39d9 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:29.028561 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92fa9c-227a-4135-8454-d8a1e78f39d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:29.046378 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-8f92fa9c-227a-4135-8454-d8a1e78f39d9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:29.047952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-8f92fa9c-227a-4135-8454-d8a1e78f39d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:29.118922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 106/210] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:29.142575 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0a0ba-04ca-4989-96e6-6a2dd63c7ac8 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:29.249242 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0a0ba-04ca-4989-96e6-6a2dd63c7ac8 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:29.284380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd5957-5259-4c3b-ad12-2aaa09a30d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:29.287649 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd5957-5259-4c3b-ad12-2aaa09a30d63 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:29.287649 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd5957-5259-4c3b-ad12-2aaa09a30d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:29.287649 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd5957-5259-4c3b-ad12-2aaa09a30d63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:29.296662 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd5957-5259-4c3b-ad12-2aaa09a30d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-d9dd5957-5259-4c3b-ad12-2aaa09a30d63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:29.305377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:29.306299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:29.307174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:29.307174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:29.307174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:29.307174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:29.307174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:29.307174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:29.307174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:29.307174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:29.307174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:29.307174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:29.307174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:29.307174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:29.307174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 105/211] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:28:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:29.312340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92fa9c-227a-4135-8454-d8a1e78f39d9 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:29.420266 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92fa9c-227a-4135-8454-d8a1e78f39d9 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:29.455524 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d454a05-aa79-49fc-8359-1665c098631d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:29.457254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d454a05-aa79-49fc-8359-1665c098631d None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:29.457733 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d454a05-aa79-49fc-8359-1665c098631d None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:29.458157 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d454a05-aa79-49fc-8359-1665c098631d None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:29.458948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d454a05-aa79-49fc-8359-1665c098631d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:29.459250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d454a05-aa79-49fc-8359-1665c098631d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:29.460641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d454a05-aa79-49fc-8359-1665c098631d None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:29.469701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 107/212] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:29.476099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd5957-5259-4c3b-ad12-2aaa09a30d63 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:29.577739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250d2dc-561c-4e59-975a-812e0c56c1d5 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:29.578093 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250d2dc-561c-4e59-975a-812e0c56c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:29.578280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250d2dc-561c-4e59-975a-812e0c56c1d5 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:29.580018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 108/213] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:29.586236 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5fb3a-538b-4f99-8918-da65f339c41e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:29.586544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5fb3a-538b-4f99-8918-da65f339c41e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:29.586834 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5fb3a-538b-4f99-8918-da65f339c41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:29.587633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd5957-5259-4c3b-ad12-2aaa09a30d63 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:29.608244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-23c5fb3a-538b-4f99-8918-da65f339c41e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:29.609856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-23c5fb3a-538b-4f99-8918-da65f339c41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:29.624048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3923add-9a29-4b2c-955c-5593861b9189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:29.624845 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3923add-9a29-4b2c-955c-5593861b9189 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:29.625118 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3923add-9a29-4b2c-955c-5593861b9189 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:29.625384 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3923add-9a29-4b2c-955c-5593861b9189 None admin] PATH_INFO: `/v3/users/e3ad3f8011e8471eaf0ca4d134fa6a95` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:29.626593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3923add-9a29-4b2c-955c-5593861b9189 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ad3f8011e8471eaf0ca4d134fa6a95)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:29.628687 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3923add-9a29-4b2c-955c-5593861b9189 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:29.630435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 106/214] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:29 2022] GET /identity/v3/users/e3ad3f8011e8471eaf0ca4d134fa6a95 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:29.636322 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3923add-9a29-4b2c-955c-5593861b9189 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:29.698175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 109/215] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:29.722546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5fb3a-538b-4f99-8918-da65f339c41e None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:29.757220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3923add-9a29-4b2c-955c-5593861b9189 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:29.790249 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776f182-5f1b-43e2-a797-805c86f46d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:29.791126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776f182-5f1b-43e2-a797-805c86f46d41 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:29.791404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776f182-5f1b-43e2-a797-805c86f46d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:29.791672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776f182-5f1b-43e2-a797-805c86f46d41 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:29.792864 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776f182-5f1b-43e2-a797-805c86f46d41 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:29.794296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776f182-5f1b-43e2-a797-805c86f46d41 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:29.796022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 107/216] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:29 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:29.800827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90dc77-4eca-448b-85e1-d00585383a59 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:29.801327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90dc77-4eca-448b-85e1-d00585383a59 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:29.802054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90dc77-4eca-448b-85e1-d00585383a59 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:29.803058 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 108/217] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:29.807606 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90dc77-4eca-448b-85e1-d00585383a59 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:29.837042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5fb3a-538b-4f99-8918-da65f339c41e None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:29.869790 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a1899-c69d-48b9-b88d-46fdfd06c57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:29.870764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a1899-c69d-48b9-b88d-46fdfd06c57e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:29.871051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a1899-c69d-48b9-b88d-46fdfd06c57e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:29.871322 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a1899-c69d-48b9-b88d-46fdfd06c57e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:29.883314 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a1899-c69d-48b9-b88d-46fdfd06c57e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-3e2a1899-c69d-48b9-b88d-46fdfd06c57e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:29.891216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:29.892201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:29.893003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:29.893003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:29.893003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:29.893003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:29.893003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:29.893003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:29.893003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:29.893003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:29.893003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:29.893003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:29.893003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:29.893003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:29.897781 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 110/218] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:28:29.899429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd02a-f69d-41b8-899b-d4f8e7561217 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:29.899772 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd02a-f69d-41b8-899b-d4f8e7561217 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:29.899960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd02a-f69d-41b8-899b-d4f8e7561217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:29.917975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-80cbd02a-f69d-41b8-899b-d4f8e7561217 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:29.919202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-80cbd02a-f69d-41b8-899b-d4f8e7561217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:29.920470 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90dc77-4eca-448b-85e1-d00585383a59 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:29.954431 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d71f0-d84b-4859-97ae-9e5ae54419c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:29.955344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d71f0-d84b-4859-97ae-9e5ae54419c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:29.955614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d71f0-d84b-4859-97ae-9e5ae54419c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:29.956299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d71f0-d84b-4859-97ae-9e5ae54419c0 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e/users/e3ad3f8011e8471eaf0ca4d134fa6a95/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:29.957867 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d71f0-d84b-4859-97ae-9e5ae54419c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e, user_id=e3ad3f8011e8471eaf0ca4d134fa6a95, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:29.959334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d71f0-d84b-4859-97ae-9e5ae54419c0 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:29.974127 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 109/219] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:28:29 2022] PUT /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e/users/e3ad3f8011e8471eaf0ca4d134fa6a95/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:28:29.975162 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d71f0-d84b-4859-97ae-9e5ae54419c0 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:29.992937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 111/220] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:30.020435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbd02a-f69d-41b8-899b-d4f8e7561217 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:30.122240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d71f0-d84b-4859-97ae-9e5ae54419c0 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:30.128177 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbd02a-f69d-41b8-899b-d4f8e7561217 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:30.156574 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3241882-139d-4f44-bc7c-af86576fcea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:30.157245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3241882-139d-4f44-bc7c-af86576fcea2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:30.157582 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3241882-139d-4f44-bc7c-af86576fcea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:30.157861 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3241882-139d-4f44-bc7c-af86576fcea2 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:30.158612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3241882-139d-4f44-bc7c-af86576fcea2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:30.159482 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3241882-139d-4f44-bc7c-af86576fcea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:30.160922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3241882-139d-4f44-bc7c-af86576fcea2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:30.170378 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcd066-4f8f-460e-b6f1-435df0a4ac9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:30.171470 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 110/221] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:30.171775 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcd066-4f8f-460e-b6f1-435df0a4ac9c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:30.172270 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcd066-4f8f-460e-b6f1-435df0a4ac9c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:30.172547 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcd066-4f8f-460e-b6f1-435df0a4ac9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:30.172766 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2e44-d50a-4692-a57f-1bc0b32bc13b None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:30.173052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2e44-d50a-4692-a57f-1bc0b32bc13b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:30.173326 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2e44-d50a-4692-a57f-1bc0b32bc13b None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:30.173921 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcd066-4f8f-460e-b6f1-435df0a4ac9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:30.175455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 111/222] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:30.177561 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcd066-4f8f-460e-b6f1-435df0a4ac9c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:30.177865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f2e44-d50a-4692-a57f-1bc0b32bc13b None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:30.180729 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 112/223] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:28:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:30.185180 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d0ba-5cc6-4ca7-871b-9d2890a11e50 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:30.185470 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d0ba-5cc6-4ca7-871b-9d2890a11e50 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:30.185746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d0ba-5cc6-4ca7-871b-9d2890a11e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:30.205104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-0801d0ba-5cc6-4ca7-871b-9d2890a11e50 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:30.207041 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0801d0ba-5cc6-4ca7-871b-9d2890a11e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:30.275871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 113/224] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:30.283548 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801d0ba-5cc6-4ca7-871b-9d2890a11e50 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:30.289080 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f2e44-d50a-4692-a57f-1bc0b32bc13b None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:30.326474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba2ede-990e-4813-9944-1ccc8ec1f701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:30.327856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba2ede-990e-4813-9944-1ccc8ec1f701 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:30.327856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba2ede-990e-4813-9944-1ccc8ec1f701 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:30.328063 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba2ede-990e-4813-9944-1ccc8ec1f701 None admin] PATH_INFO: `/v3/users/896a1b8ee9674c7c8eeb9813702990a2` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:30.343439 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba2ede-990e-4813-9944-1ccc8ec1f701 None admin] RBAC: Authorizing `identity:get_user(user_id=896a1b8ee9674c7c8eeb9813702990a2)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:30.344926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba2ede-990e-4813-9944-1ccc8ec1f701 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:30.347812 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 112/225] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:30 2022] GET /identity/v3/users/896a1b8ee9674c7c8eeb9813702990a2 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:30.348634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba2ede-990e-4813-9944-1ccc8ec1f701 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:30.414391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801d0ba-5cc6-4ca7-871b-9d2890a11e50 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:30.449804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67173274-3fc6-4570-8440-90ec00a91556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:30.450662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67173274-3fc6-4570-8440-90ec00a91556 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:30.451059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67173274-3fc6-4570-8440-90ec00a91556 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:30.451430 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67173274-3fc6-4570-8440-90ec00a91556 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:30.452243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67173274-3fc6-4570-8440-90ec00a91556 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:30.453790 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67173274-3fc6-4570-8440-90ec00a91556 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:30.467616 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba2ede-990e-4813-9944-1ccc8ec1f701 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:30.478720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 114/226] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:28:30 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:30.479771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67173274-3fc6-4570-8440-90ec00a91556 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:30.535366 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ef2c0-c2ff-4685-ac68-3820be281c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:30.537939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ef2c0-c2ff-4685-ac68-3820be281c15 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:30.539657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ef2c0-c2ff-4685-ac68-3820be281c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:30.540270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ef2c0-c2ff-4685-ac68-3820be281c15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:30.557956 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ef2c0-c2ff-4685-ac68-3820be281c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-a83ef2c0-c2ff-4685-ac68-3820be281c15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:30.571139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:30.572282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:30.573122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:30.573122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:30.573122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:30.573122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:30.573122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:30.573122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:30.573122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:30.573122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:30.573122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:30.573122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:30.573122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:30.573122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:30.576495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 113/227] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:28:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:30.584042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ef2c0-c2ff-4685-ac68-3820be281c15 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:30.673956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67173274-3fc6-4570-8440-90ec00a91556 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:30.727821 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d7770-cf78-4332-8336-d3082fbcae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:30.728571 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d7770-cf78-4332-8336-d3082fbcae52 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:30.731404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d7770-cf78-4332-8336-d3082fbcae52 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:30.731404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d7770-cf78-4332-8336-d3082fbcae52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:30.772131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ef2c0-c2ff-4685-ac68-3820be281c15 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:30.822556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78ff74-9f0f-4a5f-a1ea-3fb0ba7641d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:30.823379 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78ff74-9f0f-4a5f-a1ea-3fb0ba7641d9 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:30.823658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78ff74-9f0f-4a5f-a1ea-3fb0ba7641d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:30.823924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78ff74-9f0f-4a5f-a1ea-3fb0ba7641d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:30.824773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78ff74-9f0f-4a5f-a1ea-3fb0ba7641d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:30.825075 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78ff74-9f0f-4a5f-a1ea-3fb0ba7641d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:30.826460 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78ff74-9f0f-4a5f-a1ea-3fb0ba7641d9 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:30.841542 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 114/228] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:28:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:30.852569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78ff74-9f0f-4a5f-a1ea-3fb0ba7641d9 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:30.862086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d7770-cf78-4332-8336-d3082fbcae52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:30.863646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d7770-cf78-4332-8336-d3082fbcae52 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:30.987960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 115/229] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:30.989004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78ff74-9f0f-4a5f-a1ea-3fb0ba7641d9 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:30.993411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d7770-cf78-4332-8336-d3082fbcae52 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:31.031645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82588f-550b-4a8a-b8e8-e0a7adab16d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:31.032841 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82588f-550b-4a8a-b8e8-e0a7adab16d8 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:31.033294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82588f-550b-4a8a-b8e8-e0a7adab16d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:31.033742 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82588f-550b-4a8a-b8e8-e0a7adab16d8 None admin] PATH_INFO: `/v3/users/e3ad3f8011e8471eaf0ca4d134fa6a95` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:31.035254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82588f-550b-4a8a-b8e8-e0a7adab16d8 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ad3f8011e8471eaf0ca4d134fa6a95)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:31.036888 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82588f-550b-4a8a-b8e8-e0a7adab16d8 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:31.038871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 115/230] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:30 2022] GET /identity/v3/users/e3ad3f8011e8471eaf0ca4d134fa6a95 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:31.051631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82588f-550b-4a8a-b8e8-e0a7adab16d8 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:31.099166 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d7770-cf78-4332-8336-d3082fbcae52 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:31.135081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e751c-8520-45d3-9b34-1e0c10c050bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:31.135712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e751c-8520-45d3-9b34-1e0c10c050bd None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:31.135899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e751c-8520-45d3-9b34-1e0c10c050bd None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:31.136221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e751c-8520-45d3-9b34-1e0c10c050bd None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:31.137410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e751c-8520-45d3-9b34-1e0c10c050bd None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:31.138954 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e751c-8520-45d3-9b34-1e0c10c050bd None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:31.140900 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 116/231] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:30 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:31.147396 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e751c-8520-45d3-9b34-1e0c10c050bd None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:31.197396 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82588f-550b-4a8a-b8e8-e0a7adab16d8 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:31.244013 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18989014-868d-487a-a703-ad62b680ffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:31.244892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18989014-868d-487a-a703-ad62b680ffe7 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:31.245178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18989014-868d-487a-a703-ad62b680ffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:31.245453 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18989014-868d-487a-a703-ad62b680ffe7 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:31.250390 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e751c-8520-45d3-9b34-1e0c10c050bd None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:31.251415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18989014-868d-487a-a703-ad62b680ffe7 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:31.252978 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18989014-868d-487a-a703-ad62b680ffe7 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:31.254720 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 116/232] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:31 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:31.260598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18989014-868d-487a-a703-ad62b680ffe7 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:31.286664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2aacd-5801-48a6-9e7c-8d13a959cdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:31.287361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2aacd-5801-48a6-9e7c-8d13a959cdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:31.287638 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2aacd-5801-48a6-9e7c-8d13a959cdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:31.287908 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2aacd-5801-48a6-9e7c-8d13a959cdb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:31.288758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2aacd-5801-48a6-9e7c-8d13a959cdb9 None admin] RBAC: Adding query filter params (role.id=aac74c237ff74c5199b863b81ced5058, scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e, user.id=896a1b8ee9674c7c8eeb9813702990a2) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:31.289067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2aacd-5801-48a6-9e7c-8d13a959cdb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:31.290564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2aacd-5801-48a6-9e7c-8d13a959cdb9 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:31.296956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 117/233] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:31 2022] GET /identity/v3/role_assignments?user.id=896a1b8ee9674c7c8eeb9813702990a2&scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e&role.id=aac74c237ff74c5199b863b81ced5058 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:31.391505 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18989014-868d-487a-a703-ad62b680ffe7 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:31.428856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b5dd5-53ae-4024-b7e8-026001ddbc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:31.429756 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b5dd5-53ae-4024-b7e8-026001ddbc5f None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:31.430036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b5dd5-53ae-4024-b7e8-026001ddbc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:31.430313 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b5dd5-53ae-4024-b7e8-026001ddbc5f None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e/users/e3ad3f8011e8471eaf0ca4d134fa6a95/roles/b63d5637c42b47588880ae919eb7f448` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:31.432684 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b5dd5-53ae-4024-b7e8-026001ddbc5f None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e, user_id=e3ad3f8011e8471eaf0ca4d134fa6a95, role_id=b63d5637c42b47588880ae919eb7f448)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:31.434173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b5dd5-53ae-4024-b7e8-026001ddbc5f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:31.449430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 117/234] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:28:31 2022] PUT /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e/users/e3ad3f8011e8471eaf0ca4d134fa6a95/roles/b63d5637c42b47588880ae919eb7f448 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:28:32.642392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa4e1d-7495-49e9-ab77-d2e9caa96b07 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:32.642931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa4e1d-7495-49e9-ab77-d2e9caa96b07 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:32.642931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa4e1d-7495-49e9-ab77-d2e9caa96b07 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:32.644370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 118/235] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:32.649582 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930aecf-be36-4a38-8c6e-6b455786603a None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:32.649984 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930aecf-be36-4a38-8c6e-6b455786603a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:32.650146 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930aecf-be36-4a38-8c6e-6b455786603a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:32.670799 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-7930aecf-be36-4a38-8c6e-6b455786603a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:32.671981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-7930aecf-be36-4a38-8c6e-6b455786603a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:32.751635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 118/236] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:32.787117 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa4e1d-7495-49e9-ab77-d2e9caa96b07 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:32.919418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa4e1d-7495-49e9-ab77-d2e9caa96b07 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:32.956282 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23051cb1-2041-4371-a356-ce2c166a60b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:32.957079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23051cb1-2041-4371-a356-ce2c166a60b8 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:32.957354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23051cb1-2041-4371-a356-ce2c166a60b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:32.957628 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23051cb1-2041-4371-a356-ce2c166a60b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:32.967812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23051cb1-2041-4371-a356-ce2c166a60b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-23051cb1-2041-4371-a356-ce2c166a60b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:32.975991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:32.976889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:32.977689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:32.977689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:32.977689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:32.977689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:32.977689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:32.977689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:32.977689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:32.977689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:32.977689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:32.977689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:32.977689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:32.977689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:32.977689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 119/237] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:28:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:32.982980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930aecf-be36-4a38-8c6e-6b455786603a None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:33.119786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930aecf-be36-4a38-8c6e-6b455786603a None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:33.162865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed2a7f-5fc4-4477-949e-7bd2b0dcbcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:33.163545 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed2a7f-5fc4-4477-949e-7bd2b0dcbcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:33.163833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed2a7f-5fc4-4477-949e-7bd2b0dcbcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:33.164114 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed2a7f-5fc4-4477-949e-7bd2b0dcbcd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:33.164869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed2a7f-5fc4-4477-949e-7bd2b0dcbcd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:33.165173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed2a7f-5fc4-4477-949e-7bd2b0dcbcd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:33.166573 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed2a7f-5fc4-4477-949e-7bd2b0dcbcd2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:33.179050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 119/238] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:33.181132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23051cb1-2041-4371-a356-ce2c166a60b8 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:33.291830 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23051cb1-2041-4371-a356-ce2c166a60b8 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:33.318294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7613b56-de14-4e74-8fca-cc6b536e6de3 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:33.318963 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7613b56-de14-4e74-8fca-cc6b536e6de3 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:33.319451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7613b56-de14-4e74-8fca-cc6b536e6de3 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:33.322085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 120/239] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:28:33.325509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad968eda-e2ac-40a4-9ad3-c20cf3d5279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:33.326388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968eda-e2ac-40a4-9ad3-c20cf3d5279e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:33.326664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968eda-e2ac-40a4-9ad3-c20cf3d5279e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:33.326953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968eda-e2ac-40a4-9ad3-c20cf3d5279e None admin] PATH_INFO: `/v3/users/e3ad3f8011e8471eaf0ca4d134fa6a95` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:33.327546 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3d459-1dbc-4a38-8557-515f5f290441 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:33.328025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3d459-1dbc-4a38-8557-515f5f290441 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:33.328128 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad968eda-e2ac-40a4-9ad3-c20cf3d5279e None admin] RBAC: Authorizing `identity:get_user(user_id=e3ad3f8011e8471eaf0ca4d134fa6a95)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:33.328603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3d459-1dbc-4a38-8557-515f5f290441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:33.329696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad968eda-e2ac-40a4-9ad3-c20cf3d5279e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:33.332525 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 120/240] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:33 2022] GET /identity/v3/users/e3ad3f8011e8471eaf0ca4d134fa6a95 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:33.337533 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad968eda-e2ac-40a4-9ad3-c20cf3d5279e None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:33.359017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-dfb3d459-1dbc-4a38-8557-515f5f290441 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:33.363567 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-dfb3d459-1dbc-4a38-8557-515f5f290441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:33.466762 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 121/241] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:33.491903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3d459-1dbc-4a38-8557-515f5f290441 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:33.550924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad968eda-e2ac-40a4-9ad3-c20cf3d5279e None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:33.608664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589ccaf-6fc5-43b3-b151-392b8f714e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:33.609718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589ccaf-6fc5-43b3-b151-392b8f714e78 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:33.610213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589ccaf-6fc5-43b3-b151-392b8f714e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:33.610715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589ccaf-6fc5-43b3-b151-392b8f714e78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:33.672352 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3d459-1dbc-4a38-8557-515f5f290441 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:33.727124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589ccaf-6fc5-43b3-b151-392b8f714e78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:33.729987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589ccaf-6fc5-43b3-b151-392b8f714e78 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:33.733254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda95c3c-4688-46ee-8603-4a60cfd61e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:33.734289 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda95c3c-4688-46ee-8603-4a60cfd61e4d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:33.734739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda95c3c-4688-46ee-8603-4a60cfd61e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:33.735321 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda95c3c-4688-46ee-8603-4a60cfd61e4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:33.736638 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda95c3c-4688-46ee-8603-4a60cfd61e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:33.738548 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda95c3c-4688-46ee-8603-4a60cfd61e4d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:33.740634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 122/242] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:28:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:33.742128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20232e19-996a-4845-84f6-93807abff6b4 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:33.742542 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20232e19-996a-4845-84f6-93807abff6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:33.743065 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20232e19-996a-4845-84f6-93807abff6b4 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:33.744419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 123/243] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:33.747022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20232e19-996a-4845-84f6-93807abff6b4 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:33.855079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 121/244] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:33.858838 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b786-4eb1-4f24-be7d-8309da7feb6a None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:33.858838 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b786-4eb1-4f24-be7d-8309da7feb6a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:33.858838 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b786-4eb1-4f24-be7d-8309da7feb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:33.870319 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20232e19-996a-4845-84f6-93807abff6b4 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:33.877365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-3075b786-4eb1-4f24-be7d-8309da7feb6a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:33.880022 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3075b786-4eb1-4f24-be7d-8309da7feb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:33.913021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ab74b-508b-47c2-a13b-d47f1e27b4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:33.913804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ab74b-508b-47c2-a13b-d47f1e27b4a3 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:33.914088 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ab74b-508b-47c2-a13b-d47f1e27b4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:33.914373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ab74b-508b-47c2-a13b-d47f1e27b4a3 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:33.915306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ab74b-508b-47c2-a13b-d47f1e27b4a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:33.916925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ab74b-508b-47c2-a13b-d47f1e27b4a3 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:33.949160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 124/245] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:28:33 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:28:33.951209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ab74b-508b-47c2-a13b-d47f1e27b4a3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:33.966203 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 122/246] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:33.991753 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075b786-4eb1-4f24-be7d-8309da7feb6a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:34.124516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075b786-4eb1-4f24-be7d-8309da7feb6a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:34.185522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22accd-ba2e-41be-9ea5-d3213632eae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:34.186499 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22accd-ba2e-41be-9ea5-d3213632eae8 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:34.186893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22accd-ba2e-41be-9ea5-d3213632eae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:34.187265 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22accd-ba2e-41be-9ea5-d3213632eae8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:34.195472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ab74b-508b-47c2-a13b-d47f1e27b4a3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:34.211857 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22accd-ba2e-41be-9ea5-d3213632eae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-ae22accd-ba2e-41be-9ea5-d3213632eae8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:34.221140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:34.222751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:34.223556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:34.223556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:34.223556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:34.223556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:34.223556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:34.223556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:34.223556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:34.223556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:34.223556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:34.223556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:34.223556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:34.223556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:34.223556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 123/247] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:34.228643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50e828-df30-49a7-830c-618d4104fbf3 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:34.228935 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50e828-df30-49a7-830c-618d4104fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:34.229214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50e828-df30-49a7-830c-618d4104fbf3 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:34.234615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 124/248] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:34.234615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50e828-df30-49a7-830c-618d4104fbf3 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:34.246144 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9459a-275f-4bfb-8284-e710f781e7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:34.247309 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9459a-275f-4bfb-8284-e710f781e7cc None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:34.247747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9459a-275f-4bfb-8284-e710f781e7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:34.248178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9459a-275f-4bfb-8284-e710f781e7cc None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:34.249570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9459a-275f-4bfb-8284-e710f781e7cc None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:34.251381 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9459a-275f-4bfb-8284-e710f781e7cc None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:34.254584 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 125/249] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:33 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:34.256169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342943b-27f3-4075-aeb8-314dcd968d51 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:34.256706 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342943b-27f3-4075-aeb8-314dcd968d51 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:34.257186 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342943b-27f3-4075-aeb8-314dcd968d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:34.277892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-9342943b-27f3-4075-aeb8-314dcd968d51 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:34.279599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9342943b-27f3-4075-aeb8-314dcd968d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:34.359053 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50e828-df30-49a7-830c-618d4104fbf3 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:34.360439 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 126/250] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:34.361333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342943b-27f3-4075-aeb8-314dcd968d51 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:34.401854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6f6af-8005-42f2-97d1-9487e9ed1bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:34.402536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6f6af-8005-42f2-97d1-9487e9ed1bfc None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:34.402853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6f6af-8005-42f2-97d1-9487e9ed1bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:34.403125 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6f6af-8005-42f2-97d1-9487e9ed1bfc None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:34.403879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6f6af-8005-42f2-97d1-9487e9ed1bfc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:34.404186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6f6af-8005-42f2-97d1-9487e9ed1bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:34.406051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6f6af-8005-42f2-97d1-9487e9ed1bfc None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:34.417865 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 125/251] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:34.419549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc91bf-ca6b-488d-89fd-8d5346b4f257 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:34.419899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc91bf-ca6b-488d-89fd-8d5346b4f257 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:34.420263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc91bf-ca6b-488d-89fd-8d5346b4f257 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:34.421581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 126/252] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:34.422338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc91bf-ca6b-488d-89fd-8d5346b4f257 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:34.479941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342943b-27f3-4075-aeb8-314dcd968d51 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:34.520175 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189dfe6-9f00-444a-9ffe-d401465b5bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:34.520851 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189dfe6-9f00-444a-9ffe-d401465b5bfd None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:34.521204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189dfe6-9f00-444a-9ffe-d401465b5bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:34.521549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189dfe6-9f00-444a-9ffe-d401465b5bfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:34.522623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189dfe6-9f00-444a-9ffe-d401465b5bfd None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e, user.id=e3ad3f8011e8471eaf0ca4d134fa6a95) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:34.523062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189dfe6-9f00-444a-9ffe-d401465b5bfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:34.525281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189dfe6-9f00-444a-9ffe-d401465b5bfd None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:34.532732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 127/253] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:34 2022] GET /identity/v3/role_assignments?user.id=e3ad3f8011e8471eaf0ca4d134fa6a95&scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:34.535220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f6b86-c36c-432f-81ae-d3703203fb53 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:34.535579 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f6b86-c36c-432f-81ae-d3703203fb53 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:34.535924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f6b86-c36c-432f-81ae-d3703203fb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:34.544624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc91bf-ca6b-488d-89fd-8d5346b4f257 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:34.556763 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-d66f6b86-c36c-432f-81ae-d3703203fb53 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:34.558441 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d66f6b86-c36c-432f-81ae-d3703203fb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:34.583625 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad390f-b74f-45b0-a992-f5df61ed0ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:34.584847 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad390f-b74f-45b0-a992-f5df61ed0ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:34.585339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad390f-b74f-45b0-a992-f5df61ed0ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:34.585793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad390f-b74f-45b0-a992-f5df61ed0ca8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:34.597814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad390f-b74f-45b0-a992-f5df61ed0ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-33ad390f-b74f-45b0-a992-f5df61ed0ca8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:34.607220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:34.608202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:34.608999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:34.608999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:34.608999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:34.608999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:34.608999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:34.608999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:34.608999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:34.608999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:34.608999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:34.608999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:34.608999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:34.608999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:34.611983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 127/254] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:28:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:34.613249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad390f-b74f-45b0-a992-f5df61ed0ca8 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:34.649584 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 128/255] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:34.650978 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f6b86-c36c-432f-81ae-d3703203fb53 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:34.766476 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad390f-b74f-45b0-a992-f5df61ed0ca8 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:34.813089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd15d9-ae06-4cdf-a871-f99097c313e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:34.814304 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd15d9-ae06-4cdf-a871-f99097c313e9 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:34.814304 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd15d9-ae06-4cdf-a871-f99097c313e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:34.814476 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd15d9-ae06-4cdf-a871-f99097c313e9 None admin] PATH_INFO: `/v3/users/58259b035ece409c8f85648218ffe693` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:34.830349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd15d9-ae06-4cdf-a871-f99097c313e9 None admin] RBAC: Authorizing `identity:get_user(user_id=58259b035ece409c8f85648218ffe693)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:34.832879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd15d9-ae06-4cdf-a871-f99097c313e9 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:34.835422 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 128/256] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:34 2022] GET /identity/v3/users/58259b035ece409c8f85648218ffe693 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:34.835974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd15d9-ae06-4cdf-a871-f99097c313e9 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:34.850278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f6b86-c36c-432f-81ae-d3703203fb53 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:34.889728 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a019a-f16e-469f-b3ad-d1189c813deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:34.890223 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a019a-f16e-469f-b3ad-d1189c813deb None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:34.890500 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a019a-f16e-469f-b3ad-d1189c813deb None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:34.890817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a019a-f16e-469f-b3ad-d1189c813deb None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:34.891569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a019a-f16e-469f-b3ad-d1189c813deb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:34.891872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a019a-f16e-469f-b3ad-d1189c813deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:34.893873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a019a-f16e-469f-b3ad-d1189c813deb None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:34.902935 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 129/257] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:28:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:34.903762 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a019a-f16e-469f-b3ad-d1189c813deb None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:34.961882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd15d9-ae06-4cdf-a871-f99097c313e9 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:35.010236 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e441e-c6b0-42f4-80a6-a37aa21f1548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:35.011085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e441e-c6b0-42f4-80a6-a37aa21f1548 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:35.011360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e441e-c6b0-42f4-80a6-a37aa21f1548 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:35.011629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e441e-c6b0-42f4-80a6-a37aa21f1548 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:35.015990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a019a-f16e-469f-b3ad-d1189c813deb None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:35.026981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e441e-c6b0-42f4-80a6-a37aa21f1548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-526e441e-c6b0-42f4-80a6-a37aa21f1548 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:35.035102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:35.036077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:35.036876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:35.036876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:35.036876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:35.036876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:35.036876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:35.036876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:35.036876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:35.036876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:35.036876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:35.036876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:35.036876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:35.036876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:35.036876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 129/258] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:35.038144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e441e-c6b0-42f4-80a6-a37aa21f1548 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:35.051644 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972482d-c3c8-42f7-84d4-a7ae6a2f04c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:35.052298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972482d-c3c8-42f7-84d4-a7ae6a2f04c4 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:35.052583 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972482d-c3c8-42f7-84d4-a7ae6a2f04c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:35.052859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972482d-c3c8-42f7-84d4-a7ae6a2f04c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:35.133759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972482d-c3c8-42f7-84d4-a7ae6a2f04c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:35.135288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972482d-c3c8-42f7-84d4-a7ae6a2f04c4 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:35.156176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e441e-c6b0-42f4-80a6-a37aa21f1548 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:35.191720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b56de-2291-42f2-8d26-4b5c9e0c4307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:35.192594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b56de-2291-42f2-8d26-4b5c9e0c4307 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:35.192867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b56de-2291-42f2-8d26-4b5c9e0c4307 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:35.193137 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b56de-2291-42f2-8d26-4b5c9e0c4307 None admin] PATH_INFO: `/v3/users/e3ad3f8011e8471eaf0ca4d134fa6a95` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:35.194354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b56de-2291-42f2-8d26-4b5c9e0c4307 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ad3f8011e8471eaf0ca4d134fa6a95)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:35.195830 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b56de-2291-42f2-8d26-4b5c9e0c4307 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:35.197529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 130/259] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:35 2022] GET /identity/v3/users/e3ad3f8011e8471eaf0ca4d134fa6a95 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:35.198282 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b56de-2291-42f2-8d26-4b5c9e0c4307 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:35.240020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 130/260] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:35.240985 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972482d-c3c8-42f7-84d4-a7ae6a2f04c4 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:35.300188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b56de-2291-42f2-8d26-4b5c9e0c4307 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:35.334951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee85f4-be0e-4ba7-b31d-80b9f1ba68d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:35.335657 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee85f4-be0e-4ba7-b31d-80b9f1ba68d6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:35.335938 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee85f4-be0e-4ba7-b31d-80b9f1ba68d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:35.336208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee85f4-be0e-4ba7-b31d-80b9f1ba68d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:35.336946 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee85f4-be0e-4ba7-b31d-80b9f1ba68d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:35.337247 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee85f4-be0e-4ba7-b31d-80b9f1ba68d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:35.338619 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee85f4-be0e-4ba7-b31d-80b9f1ba68d6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:35.341771 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972482d-c3c8-42f7-84d4-a7ae6a2f04c4 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:35.347567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 131/261] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:35.348371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee85f4-be0e-4ba7-b31d-80b9f1ba68d6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:35.375482 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99780098-c741-46b8-b933-ee1dc58de90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:35.376129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99780098-c741-46b8-b933-ee1dc58de90d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:35.376407 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99780098-c741-46b8-b933-ee1dc58de90d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:35.376678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99780098-c741-46b8-b933-ee1dc58de90d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:35.444918 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99780098-c741-46b8-b933-ee1dc58de90d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:35.446332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99780098-c741-46b8-b933-ee1dc58de90d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:35.447786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee85f4-be0e-4ba7-b31d-80b9f1ba68d6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:35.483448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee04e-0097-4c5c-b4b3-6bc03f26719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:35.484320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee04e-0097-4c5c-b4b3-6bc03f26719f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:35.484599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee04e-0097-4c5c-b4b3-6bc03f26719f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:35.484867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee04e-0097-4c5c-b4b3-6bc03f26719f None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:35.486092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dee04e-0097-4c5c-b4b3-6bc03f26719f None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:35.487868 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dee04e-0097-4c5c-b4b3-6bc03f26719f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:35.489938 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 132/262] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:35 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:35.490865 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee04e-0097-4c5c-b4b3-6bc03f26719f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:35.563031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 131/263] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:35.563892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99780098-c741-46b8-b933-ee1dc58de90d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:35.611423 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee04e-0097-4c5c-b4b3-6bc03f26719f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:35.648678 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b2e3d-61a5-4a10-96c4-a1c0bcc70f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:35.649952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b2e3d-61a5-4a10-96c4-a1c0bcc70f1f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:35.650920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b2e3d-61a5-4a10-96c4-a1c0bcc70f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:35.651340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b2e3d-61a5-4a10-96c4-a1c0bcc70f1f None admin] PATH_INFO: `/v3/users/896a1b8ee9674c7c8eeb9813702990a2` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:35.653134 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b2e3d-61a5-4a10-96c4-a1c0bcc70f1f None admin] RBAC: Authorizing `identity:get_user(user_id=896a1b8ee9674c7c8eeb9813702990a2)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:35.655879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b2e3d-61a5-4a10-96c4-a1c0bcc70f1f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:35.657706 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 133/264] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:35 2022] GET /identity/v3/users/896a1b8ee9674c7c8eeb9813702990a2 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:35.659694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b2e3d-61a5-4a10-96c4-a1c0bcc70f1f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:35.684612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99780098-c741-46b8-b933-ee1dc58de90d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:35.720257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4284a8-6a6d-4a21-bed8-3adecf2ef32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:35.721122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4284a8-6a6d-4a21-bed8-3adecf2ef32c None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:35.722101 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4284a8-6a6d-4a21-bed8-3adecf2ef32c None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:35.722536 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4284a8-6a6d-4a21-bed8-3adecf2ef32c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:35.723532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4284a8-6a6d-4a21-bed8-3adecf2ef32c None admin] RBAC: Adding query filter params (role.id=b526c720d6b448189684bab16e2f425a, scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e, user.id=58259b035ece409c8f85648218ffe693) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:35.723976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4284a8-6a6d-4a21-bed8-3adecf2ef32c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:35.725551 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4284a8-6a6d-4a21-bed8-3adecf2ef32c None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:35.731293 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 132/265] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:35 2022] GET /identity/v3/role_assignments?user.id=58259b035ece409c8f85648218ffe693&scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e&role.id=b526c720d6b448189684bab16e2f425a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:35.732215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4284a8-6a6d-4a21-bed8-3adecf2ef32c None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:35.763472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b2e3d-61a5-4a10-96c4-a1c0bcc70f1f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:35.800216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd574a-85cf-4a4f-8545-60f5c9f08325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:35.801102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd574a-85cf-4a4f-8545-60f5c9f08325 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:35.801351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd574a-85cf-4a4f-8545-60f5c9f08325 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:35.801617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd574a-85cf-4a4f-8545-60f5c9f08325 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:35.802937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd574a-85cf-4a4f-8545-60f5c9f08325 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:35.804445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd574a-85cf-4a4f-8545-60f5c9f08325 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:35.806563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 134/266] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:35 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:35.812280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd574a-85cf-4a4f-8545-60f5c9f08325 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:35.839296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4284a8-6a6d-4a21-bed8-3adecf2ef32c None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:35.877149 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ecc21-0d87-48ef-9b98-fa124fc483d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:35.879637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ecc21-0d87-48ef-9b98-fa124fc483d3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:35.880581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ecc21-0d87-48ef-9b98-fa124fc483d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:35.881090 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ecc21-0d87-48ef-9b98-fa124fc483d3 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:35.883244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ecc21-0d87-48ef-9b98-fa124fc483d3 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:35.885713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ecc21-0d87-48ef-9b98-fa124fc483d3 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:35.888675 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 133/267] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:35 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:35.897612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ecc21-0d87-48ef-9b98-fa124fc483d3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:35.971029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd574a-85cf-4a4f-8545-60f5c9f08325 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:36.025179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069aae0-8f78-425f-b621-7e96093a3b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:36.025986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069aae0-8f78-425f-b621-7e96093a3b6b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:36.026362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069aae0-8f78-425f-b621-7e96093a3b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:36.026765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069aae0-8f78-425f-b621-7e96093a3b6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:36.027695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069aae0-8f78-425f-b621-7e96093a3b6b None admin] RBAC: Adding query filter params (role.id=b63d5637c42b47588880ae919eb7f448, scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e, user.id=e3ad3f8011e8471eaf0ca4d134fa6a95) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:36.028101 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069aae0-8f78-425f-b621-7e96093a3b6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:36.029667 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069aae0-8f78-425f-b621-7e96093a3b6b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:36.037170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 135/268] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:35 2022] GET /identity/v3/role_assignments?user.id=e3ad3f8011e8471eaf0ca4d134fa6a95&scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e&role.id=b63d5637c42b47588880ae919eb7f448 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:36.049153 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ecc21-0d87-48ef-9b98-fa124fc483d3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:36.094378 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e2ae8-022b-42c7-a5e2-51f343e5f8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:36.095331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e2ae8-022b-42c7-a5e2-51f343e5f8be None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:36.095615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e2ae8-022b-42c7-a5e2-51f343e5f8be None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:36.095895 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e2ae8-022b-42c7-a5e2-51f343e5f8be None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e/users/896a1b8ee9674c7c8eeb9813702990a2/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:36.103161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e2ae8-022b-42c7-a5e2-51f343e5f8be None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e, user_id=896a1b8ee9674c7c8eeb9813702990a2, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:36.104737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e2ae8-022b-42c7-a5e2-51f343e5f8be None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:36.129828 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 134/269] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:28:35 2022] PUT /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e/users/896a1b8ee9674c7c8eeb9813702990a2/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:28:36.710123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c2e92-0e1f-4783-b2ec-31854d900f65 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:36.710449 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c2e92-0e1f-4783-b2ec-31854d900f65 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:36.710711 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c2e92-0e1f-4783-b2ec-31854d900f65 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:36.712633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 136/270] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:36.717801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8addbad-7c55-4a1e-bb90-99502e0777b0 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:36.718096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8addbad-7c55-4a1e-bb90-99502e0777b0 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:36.718374 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8addbad-7c55-4a1e-bb90-99502e0777b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:36.739158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-a8addbad-7c55-4a1e-bb90-99502e0777b0 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:36.740353 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a8addbad-7c55-4a1e-bb90-99502e0777b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:36.814784 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 135/271] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:36.832351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c2e92-0e1f-4783-b2ec-31854d900f65 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:36.832999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd62baf-61ec-4654-bf96-99eafac72f28 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:36.833294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd62baf-61ec-4654-bf96-99eafac72f28 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:36.833573 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd62baf-61ec-4654-bf96-99eafac72f28 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:36.835271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 136/272] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:28:36.841581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b304163-83f4-44b4-a569-f4ceb809418c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:36.841581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b304163-83f4-44b4-a569-f4ceb809418c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:36.841581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b304163-83f4-44b4-a569-f4ceb809418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:36.857947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-0b304163-83f4-44b4-a569-f4ceb809418c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:36.859146 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-0b304163-83f4-44b4-a569-f4ceb809418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:36.938800 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 137/273] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:36.957664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c2e92-0e1f-4783-b2ec-31854d900f65 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:36.963926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b304163-83f4-44b4-a569-f4ceb809418c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:36.997695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed792db-1e1e-4c4d-abaf-ee7bc5bd171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:36.998505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed792db-1e1e-4c4d-abaf-ee7bc5bd171d None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:36.998972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed792db-1e1e-4c4d-abaf-ee7bc5bd171d None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:36.999250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed792db-1e1e-4c4d-abaf-ee7bc5bd171d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:37.011724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed792db-1e1e-4c4d-abaf-ee7bc5bd171d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-9ed792db-1e1e-4c4d-abaf-ee7bc5bd171d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:37.022450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:37.023371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:37.024253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:37.024253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:37.024253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:37.024253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:37.024253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:37.024253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:37.024253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:37.024253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:37.024253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:37.024253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:37.024253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:37.024253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:37.026848 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 137/274] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:37.030166 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed792db-1e1e-4c4d-abaf-ee7bc5bd171d None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:37.089546 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b304163-83f4-44b4-a569-f4ceb809418c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:37.129274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868874c-3fe2-4b25-a78f-eddac4af7334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:37.130095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868874c-3fe2-4b25-a78f-eddac4af7334 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:37.130373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868874c-3fe2-4b25-a78f-eddac4af7334 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:37.130644 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868874c-3fe2-4b25-a78f-eddac4af7334 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:37.131837 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868874c-3fe2-4b25-a78f-eddac4af7334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:37.133561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868874c-3fe2-4b25-a78f-eddac4af7334 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:37.139790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 138/275] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:28:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:37.140623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868874c-3fe2-4b25-a78f-eddac4af7334 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:37.151377 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed792db-1e1e-4c4d-abaf-ee7bc5bd171d None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:37.198654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b88913-a48a-4678-99f5-a518b78f2902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:37.199360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b88913-a48a-4678-99f5-a518b78f2902 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:37.199641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b88913-a48a-4678-99f5-a518b78f2902 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:37.199918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b88913-a48a-4678-99f5-a518b78f2902 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:37.200674 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b88913-a48a-4678-99f5-a518b78f2902 None admin] RBAC: Adding query filter params (name=member) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:37.200975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b88913-a48a-4678-99f5-a518b78f2902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:37.202374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b88913-a48a-4678-99f5-a518b78f2902 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:37.212321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 138/276] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:37.217590 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b88913-a48a-4678-99f5-a518b78f2902 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:37.262631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868874c-3fe2-4b25-a78f-eddac4af7334 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:37.308952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f6798-70c1-475b-a440-68ba55f289c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:37.309621 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6798-70c1-475b-a440-68ba55f289c5 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:37.309902 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6798-70c1-475b-a440-68ba55f289c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:37.310178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6798-70c1-475b-a440-68ba55f289c5 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:37.311007 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f6798-70c1-475b-a440-68ba55f289c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:37.312470 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f6798-70c1-475b-a440-68ba55f289c5 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:37.334941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 139/277] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:28:37 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:37.342906 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b88913-a48a-4678-99f5-a518b78f2902 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:37.388991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c04102-9945-44e6-bfc3-0cfc0d29d961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:37.390375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c04102-9945-44e6-bfc3-0cfc0d29d961 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:37.390912 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c04102-9945-44e6-bfc3-0cfc0d29d961 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:37.391439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c04102-9945-44e6-bfc3-0cfc0d29d961 None admin] PATH_INFO: `/v3/users/ffdc6f6e73274870a75b5a732f430338` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:37.410013 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c04102-9945-44e6-bfc3-0cfc0d29d961 None admin] RBAC: Authorizing `identity:get_user(user_id=ffdc6f6e73274870a75b5a732f430338)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:37.411875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c04102-9945-44e6-bfc3-0cfc0d29d961 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:37.418100 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 139/278] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:37 2022] GET /identity/v3/users/ffdc6f6e73274870a75b5a732f430338 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:37.420979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f6798-70c1-475b-a440-68ba55f289c5 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:37.533417 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f6798-70c1-475b-a440-68ba55f289c5 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:37.569157 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d234ab-bd13-443d-a544-d28ea64784f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:37.569875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d234ab-bd13-443d-a544-d28ea64784f0 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:37.570165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d234ab-bd13-443d-a544-d28ea64784f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:37.570436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d234ab-bd13-443d-a544-d28ea64784f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:37.571346 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d234ab-bd13-443d-a544-d28ea64784f0 None admin] RBAC: Adding query filter params (role.id=aac74c237ff74c5199b863b81ced5058, user.id=ffdc6f6e73274870a75b5a732f430338, scope.system=all) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:37.571657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d234ab-bd13-443d-a544-d28ea64784f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:37.573093 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d234ab-bd13-443d-a544-d28ea64784f0 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:37.578690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 140/279] 10.222.0.76 () {56 vars in 1308 bytes} [Thu May 12 17:28:37 2022] GET /identity/v3/role_assignments?user.id=ffdc6f6e73274870a75b5a732f430338&scope.system=all&role.id=aac74c237ff74c5199b863b81ced5058 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:38.311038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca719a-1048-4f90-9b3c-71987c86e934 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:38.311979 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca719a-1048-4f90-9b3c-71987c86e934 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:38.312456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca719a-1048-4f90-9b3c-71987c86e934 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:38.314302 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 140/280] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:38.320846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1409-479f-4a0f-a0a2-228d059a51b2 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:38.321723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1409-479f-4a0f-a0a2-228d059a51b2 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:38.322194 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1409-479f-4a0f-a0a2-228d059a51b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:38.343912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-d80f1409-479f-4a0f-a0a2-228d059a51b2 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:38.345420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d80f1409-479f-4a0f-a0a2-228d059a51b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:38.422551 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 141/281] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:38.461960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca719a-1048-4f90-9b3c-71987c86e934 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:38.566904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca719a-1048-4f90-9b3c-71987c86e934 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:38.601458 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33487c2d-983b-46ff-9250-8f0294550f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:38.602634 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487c2d-983b-46ff-9250-8f0294550f5f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:38.603136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487c2d-983b-46ff-9250-8f0294550f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:38.603600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487c2d-983b-46ff-9250-8f0294550f5f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:38.614595 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33487c2d-983b-46ff-9250-8f0294550f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-33487c2d-983b-46ff-9250-8f0294550f5f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:38.622416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:38.623338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:38.624126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:38.624126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:38.624126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:38.624126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:38.624126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:38.624126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:38.624126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:38.624126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:38.624126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:38.624126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:38.624126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:38.624126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:38.626786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 141/282] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:38.635794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f1409-479f-4a0f-a0a2-228d059a51b2 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:38.762084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f1409-479f-4a0f-a0a2-228d059a51b2 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:38.796044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322d7db-454f-475f-a575-c8535451d8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:38.796978 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322d7db-454f-475f-a575-c8535451d8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:38.797409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322d7db-454f-475f-a575-c8535451d8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:38.797828 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322d7db-454f-475f-a575-c8535451d8d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:38.798746 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322d7db-454f-475f-a575-c8535451d8d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:38.799197 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322d7db-454f-475f-a575-c8535451d8d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:38.801388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322d7db-454f-475f-a575-c8535451d8d0 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:38.810272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 142/283] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:38.816436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33487c2d-983b-46ff-9250-8f0294550f5f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:38.918252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2f45a-8cb8-4be4-aa4c-f60105029591 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:38.918535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2f45a-8cb8-4be4-aa4c-f60105029591 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:38.919101 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2f45a-8cb8-4be4-aa4c-f60105029591 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:38.920917 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 143/284] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:38.928868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354e424-0649-4010-bb76-be1273058197 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:38.929169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354e424-0649-4010-bb76-be1273058197 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:38.929428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354e424-0649-4010-bb76-be1273058197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:38.960104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-d354e424-0649-4010-bb76-be1273058197 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:38.961303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d354e424-0649-4010-bb76-be1273058197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:38.973127 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33487c2d-983b-46ff-9250-8f0294550f5f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:39.007453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45621ee3-2e40-4ae1-9584-1d2c3c45a363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:39.008936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45621ee3-2e40-4ae1-9584-1d2c3c45a363 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:39.009432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45621ee3-2e40-4ae1-9584-1d2c3c45a363 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:39.009897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45621ee3-2e40-4ae1-9584-1d2c3c45a363 None admin] PATH_INFO: `/v3/users/58259b035ece409c8f85648218ffe693` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:39.011291 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45621ee3-2e40-4ae1-9584-1d2c3c45a363 None admin] RBAC: Authorizing `identity:get_user(user_id=58259b035ece409c8f85648218ffe693)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:39.012925 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45621ee3-2e40-4ae1-9584-1d2c3c45a363 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:39.015305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 142/285] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:38 2022] GET /identity/v3/users/58259b035ece409c8f85648218ffe693 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:39.024863 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45621ee3-2e40-4ae1-9584-1d2c3c45a363 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:39.072092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 144/286] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:39.113916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354e424-0649-4010-bb76-be1273058197 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:39.166100 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45621ee3-2e40-4ae1-9584-1d2c3c45a363 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:39.208150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274fbb4-1bb1-4d5e-a2e9-9be64681ec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:39.208937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274fbb4-1bb1-4d5e-a2e9-9be64681ec79 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:39.209216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274fbb4-1bb1-4d5e-a2e9-9be64681ec79 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:39.209489 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274fbb4-1bb1-4d5e-a2e9-9be64681ec79 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:39.210715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274fbb4-1bb1-4d5e-a2e9-9be64681ec79 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:39.212175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274fbb4-1bb1-4d5e-a2e9-9be64681ec79 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:39.214201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 143/287] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:39 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:39.219299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274fbb4-1bb1-4d5e-a2e9-9be64681ec79 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:39.306361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354e424-0649-4010-bb76-be1273058197 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:39.344507 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274fbb4-1bb1-4d5e-a2e9-9be64681ec79 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:39.378040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129072d-03e6-4937-a7ab-2900e2ad94bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:39.379003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129072d-03e6-4937-a7ab-2900e2ad94bb None admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:39.379282 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129072d-03e6-4937-a7ab-2900e2ad94bb None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:39.379557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129072d-03e6-4937-a7ab-2900e2ad94bb None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e/users/58259b035ece409c8f85648218ffe693/roles/b526c720d6b448189684bab16e2f425a` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:39.381575 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129072d-03e6-4937-a7ab-2900e2ad94bb None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e, user_id=58259b035ece409c8f85648218ffe693, role_id=b526c720d6b448189684bab16e2f425a)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:39.383328 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129072d-03e6-4937-a7ab-2900e2ad94bb None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:39.390638 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cdb24-2f47-4784-b839-78e3538f6305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:39.391499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cdb24-2f47-4784-b839-78e3538f6305 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:39.391813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cdb24-2f47-4784-b839-78e3538f6305 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:39.392139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cdb24-2f47-4784-b839-78e3538f6305 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:39.400679 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 144/288] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:28:39 2022] PUT /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e/users/58259b035ece409c8f85648218ffe693/roles/b526c720d6b448189684bab16e2f425a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:28:39.409737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cdb24-2f47-4784-b839-78e3538f6305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-165cdb24-2f47-4784-b839-78e3538f6305 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:39.418389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:39.419467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:39.420286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:39.420286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:39.420286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:39.420286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:39.420286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:39.420286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:39.420286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:39.420286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:39.420286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:39.420286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:39.420286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:39.420286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:39.422865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 145/289] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:28:39.430816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129072d-03e6-4937-a7ab-2900e2ad94bb None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:39.623017 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129072d-03e6-4937-a7ab-2900e2ad94bb None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:39.678816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eafb5d-d538-4b43-82da-825f38e4eb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:39.679676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eafb5d-d538-4b43-82da-825f38e4eb5f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:39.679954 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eafb5d-d538-4b43-82da-825f38e4eb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:39.680223 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eafb5d-d538-4b43-82da-825f38e4eb5f None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:39.680980 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eafb5d-d538-4b43-82da-825f38e4eb5f None admin] RBAC: Adding query filter params (name=member) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:39.681280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eafb5d-d538-4b43-82da-825f38e4eb5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:39.682704 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eafb5d-d538-4b43-82da-825f38e4eb5f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:39.693333 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 145/290] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:39.698506 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cdb24-2f47-4784-b839-78e3538f6305 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:39.835167 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cdb24-2f47-4784-b839-78e3538f6305 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:39.881273 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb280f-f0cc-4dd5-be7c-a46d2af59f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:39.882060 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb280f-f0cc-4dd5-be7c-a46d2af59f21 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:39.882332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb280f-f0cc-4dd5-be7c-a46d2af59f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:39.882608 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb280f-f0cc-4dd5-be7c-a46d2af59f21 None admin] PATH_INFO: `/v3/users/896a1b8ee9674c7c8eeb9813702990a2` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:39.884091 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb280f-f0cc-4dd5-be7c-a46d2af59f21 None admin] RBAC: Authorizing `identity:get_user(user_id=896a1b8ee9674c7c8eeb9813702990a2)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:39.885519 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb280f-f0cc-4dd5-be7c-a46d2af59f21 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:39.887344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 146/291] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:39 2022] GET /identity/v3/users/896a1b8ee9674c7c8eeb9813702990a2 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:39.892683 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eafb5d-d538-4b43-82da-825f38e4eb5f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:40.042453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eafb5d-d538-4b43-82da-825f38e4eb5f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:40.099589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efe36f-fe81-4ad3-9da9-5db2810fa8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:40.100273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efe36f-fe81-4ad3-9da9-5db2810fa8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:40.100553 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efe36f-fe81-4ad3-9da9-5db2810fa8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:40.100822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efe36f-fe81-4ad3-9da9-5db2810fa8d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:40.214455 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efe36f-fe81-4ad3-9da9-5db2810fa8d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:40.215922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efe36f-fe81-4ad3-9da9-5db2810fa8d4 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:40.285713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db6eb0-dc1f-4439-b5eb-4a61fd2bc4ef None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:40.285713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db6eb0-dc1f-4439-b5eb-4a61fd2bc4ef None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:40.285713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db6eb0-dc1f-4439-b5eb-4a61fd2bc4ef None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:40.286447 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 147/292] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:40.292251 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8666-d86e-4389-ab96-28fb65a8d272 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:40.292616 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8666-d86e-4389-ab96-28fb65a8d272 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:40.292966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8666-d86e-4389-ab96-28fb65a8d272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:40.327734 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-731e8666-d86e-4389-ab96-28fb65a8d272 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:40.328939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-731e8666-d86e-4389-ab96-28fb65a8d272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:40.358098 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 146/293] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 17:28:40.363388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efe36f-fe81-4ad3-9da9-5db2810fa8d4 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:40.450750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 148/294] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:40.452214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e234e-27f7-4158-9f0c-b1533698759a None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:40.452525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e234e-27f7-4158-9f0c-b1533698759a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:40.452779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e234e-27f7-4158-9f0c-b1533698759a None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:40.454042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 149/295] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:40.462719 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2702d-51d8-46e6-b607-0a7e4669b4c4 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:40.462719 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2702d-51d8-46e6-b607-0a7e4669b4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:40.462719 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2702d-51d8-46e6-b607-0a7e4669b4c4 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:40.462719 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 150/296] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:40.463106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74380ec-b1a5-4c2a-b499-8805086e4088 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:40.463191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74380ec-b1a5-4c2a-b499-8805086e4088 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:40.463421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74380ec-b1a5-4c2a-b499-8805086e4088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:40.480172 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-e74380ec-b1a5-4c2a-b499-8805086e4088 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:40.481288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e74380ec-b1a5-4c2a-b499-8805086e4088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:40.505766 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efe36f-fe81-4ad3-9da9-5db2810fa8d4 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:40.540009 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970dc14-a8ba-480b-b964-9a5a0623d435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:40.540864 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970dc14-a8ba-480b-b964-9a5a0623d435 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:40.541151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970dc14-a8ba-480b-b964-9a5a0623d435 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:40.541476 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970dc14-a8ba-480b-b964-9a5a0623d435 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:40.542863 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970dc14-a8ba-480b-b964-9a5a0623d435 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:40.544303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970dc14-a8ba-480b-b964-9a5a0623d435 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:40.546362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 147/297] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:40 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:40.547612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bb255-54c4-42ff-a8ec-dd28f866b962 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:40.547898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bb255-54c4-42ff-a8ec-dd28f866b962 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:40.548172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bb255-54c4-42ff-a8ec-dd28f866b962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:40.552747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 151/298] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:40.553856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74380ec-b1a5-4c2a-b499-8805086e4088 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:40.566845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-431bb255-54c4-42ff-a8ec-dd28f866b962 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:40.568129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-431bb255-54c4-42ff-a8ec-dd28f866b962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:40.633230 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 148/299] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:40.634329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bb255-54c4-42ff-a8ec-dd28f866b962 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:40.657137 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74380ec-b1a5-4c2a-b499-8805086e4088 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:40.692111 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18326683-467a-417e-b46a-40d02481993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:40.692892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326683-467a-417e-b46a-40d02481993f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:40.693163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326683-467a-417e-b46a-40d02481993f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:40.693426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18326683-467a-417e-b46a-40d02481993f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:40.703293 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18326683-467a-417e-b46a-40d02481993f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-18326683-467a-417e-b46a-40d02481993f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:40.711678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:40.712559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:40.713359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:40.713359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:40.713359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:40.713359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:40.713359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:40.713359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:40.713359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:40.713359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:40.713359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:40.713359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:40.713359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:40.713359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:40.713359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 152/300] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:40.714009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18326683-467a-417e-b46a-40d02481993f None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:40.744096 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bb255-54c4-42ff-a8ec-dd28f866b962 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:40.782095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abd174-4ae8-427f-926f-c4d471dbb545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:40.783060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abd174-4ae8-427f-926f-c4d471dbb545 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:40.783518 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abd174-4ae8-427f-926f-c4d471dbb545 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:40.784149 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abd174-4ae8-427f-926f-c4d471dbb545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:40.785176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abd174-4ae8-427f-926f-c4d471dbb545 None admin] RBAC: Adding query filter params (role.id=aac74c237ff74c5199b863b81ced5058, scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e, user.id=896a1b8ee9674c7c8eeb9813702990a2) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:40.785662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abd174-4ae8-427f-926f-c4d471dbb545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:40.787757 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abd174-4ae8-427f-926f-c4d471dbb545 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:40.795619 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 149/301] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:40 2022] GET /identity/v3/role_assignments?user.id=896a1b8ee9674c7c8eeb9813702990a2&scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e&role.id=aac74c237ff74c5199b863b81ced5058 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:40.797053 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abd174-4ae8-427f-926f-c4d471dbb545 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:40.817142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18326683-467a-417e-b46a-40d02481993f None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:40.853683 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ae2f7-bc35-4161-91dc-ed24ab7588e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:40.854477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ae2f7-bc35-4161-91dc-ed24ab7588e6 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:40.854791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ae2f7-bc35-4161-91dc-ed24ab7588e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:40.855066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ae2f7-bc35-4161-91dc-ed24ab7588e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:40.856267 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ae2f7-bc35-4161-91dc-ed24ab7588e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:40.857735 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ae2f7-bc35-4161-91dc-ed24ab7588e6 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:40.859600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 153/302] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:28:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:40.865933 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ae2f7-bc35-4161-91dc-ed24ab7588e6 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:40.936619 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abd174-4ae8-427f-926f-c4d471dbb545 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:40.978386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a23291-fd93-46d7-80b9-d4b61fc5f1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:40.979630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23291-fd93-46d7-80b9-d4b61fc5f1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:40.980081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23291-fd93-46d7-80b9-d4b61fc5f1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:40.980520 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23291-fd93-46d7-80b9-d4b61fc5f1e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:40.987742 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ae2f7-bc35-4161-91dc-ed24ab7588e6 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:40.995035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a23291-fd93-46d7-80b9-d4b61fc5f1e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-f4a23291-fd93-46d7-80b9-d4b61fc5f1e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:41.005111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:41.006036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:41.007327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:41.007327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:41.007327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:41.007327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:41.007327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:41.007327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:41.007327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:41.007327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:41.007327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:41.007327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:41.007327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:41.007327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:41.007327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 150/303] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:41.007327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a23291-fd93-46d7-80b9-d4b61fc5f1e0 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:41.038758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be66953-6bd6-4b56-b90c-03a5dcba1028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:41.039840 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66953-6bd6-4b56-b90c-03a5dcba1028 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:41.040331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66953-6bd6-4b56-b90c-03a5dcba1028 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:41.040658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66953-6bd6-4b56-b90c-03a5dcba1028 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:41.041650 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be66953-6bd6-4b56-b90c-03a5dcba1028 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:41.041771 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be66953-6bd6-4b56-b90c-03a5dcba1028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:41.043219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be66953-6bd6-4b56-b90c-03a5dcba1028 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:41.053235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 154/304] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:41.054044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be66953-6bd6-4b56-b90c-03a5dcba1028 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:41.130967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a23291-fd93-46d7-80b9-d4b61fc5f1e0 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:41.158235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be66953-6bd6-4b56-b90c-03a5dcba1028 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:41.165829 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da0642-ea8e-40a1-aff1-242c90d71751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:41.166634 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da0642-ea8e-40a1-aff1-242c90d71751 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:41.166944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da0642-ea8e-40a1-aff1-242c90d71751 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:41.167219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da0642-ea8e-40a1-aff1-242c90d71751 None admin] PATH_INFO: `/v3/groups` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:41.167904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da0642-ea8e-40a1-aff1-242c90d71751 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:41.169396 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da0642-ea8e-40a1-aff1-242c90d71751 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:41.184795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 151/305] 10.222.0.76 () {60 vars in 1134 bytes} [Thu May 12 17:28:41 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:41.191753 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da0642-ea8e-40a1-aff1-242c90d71751 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:41.194174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9090ce8-b6a0-4a58-89f8-60571cf4c4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:41.195242 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9090ce8-b6a0-4a58-89f8-60571cf4c4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:41.195743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9090ce8-b6a0-4a58-89f8-60571cf4c4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:41.196222 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9090ce8-b6a0-4a58-89f8-60571cf4c4d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:41.197262 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9090ce8-b6a0-4a58-89f8-60571cf4c4d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:41.197799 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9090ce8-b6a0-4a58-89f8-60571cf4c4d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:41.199557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9090ce8-b6a0-4a58-89f8-60571cf4c4d0 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:41.219153 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 155/306] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:41.228376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9090ce8-b6a0-4a58-89f8-60571cf4c4d0 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:41.319876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da0642-ea8e-40a1-aff1-242c90d71751 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:41.354533 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9090ce8-b6a0-4a58-89f8-60571cf4c4d0 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:41.360925 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd4321-a7c7-4790-83bc-d30a9af9fee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:41.363659 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd4321-a7c7-4790-83bc-d30a9af9fee5 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:41.364148 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd4321-a7c7-4790-83bc-d30a9af9fee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:41.364617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd4321-a7c7-4790-83bc-d30a9af9fee5 None admin] PATH_INFO: `/v3/users/55e106036bc34331820ee5b2b9f34772` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:41.380763 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd4321-a7c7-4790-83bc-d30a9af9fee5 None admin] RBAC: Authorizing `identity:get_user(user_id=55e106036bc34331820ee5b2b9f34772)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:41.383336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd4321-a7c7-4790-83bc-d30a9af9fee5 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:41.385612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 152/307] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:41 2022] GET /identity/v3/users/55e106036bc34331820ee5b2b9f34772 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:41.391457 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd4321-a7c7-4790-83bc-d30a9af9fee5 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:41.395401 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b250a1b-71d0-4abe-9197-088d8e4ef87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:41.396282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b250a1b-71d0-4abe-9197-088d8e4ef87e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:41.396563 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b250a1b-71d0-4abe-9197-088d8e4ef87e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:41.396835 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b250a1b-71d0-4abe-9197-088d8e4ef87e None admin] PATH_INFO: `/v3/users/ffdc6f6e73274870a75b5a732f430338` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:41.398054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b250a1b-71d0-4abe-9197-088d8e4ef87e None admin] RBAC: Authorizing `identity:get_user(user_id=ffdc6f6e73274870a75b5a732f430338)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:41.399615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b250a1b-71d0-4abe-9197-088d8e4ef87e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:41.401971 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 156/308] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:41 2022] GET /identity/v3/users/ffdc6f6e73274870a75b5a732f430338 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:41.406942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b250a1b-71d0-4abe-9197-088d8e4ef87e None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:41.522271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd4321-a7c7-4790-83bc-d30a9af9fee5 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:41.525577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b250a1b-71d0-4abe-9197-088d8e4ef87e None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:41.559600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae33f4f-04c3-4896-9696-5a1f77f47500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:41.560500 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33f4f-04c3-4896-9696-5a1f77f47500 None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:41.560781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33f4f-04c3-4896-9696-5a1f77f47500 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:41.561056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33f4f-04c3-4896-9696-5a1f77f47500 None admin] PATH_INFO: `/v3/system/users/ffdc6f6e73274870a75b5a732f430338/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:41.562517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae33f4f-04c3-4896-9696-5a1f77f47500 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ffdc6f6e73274870a75b5a732f430338, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:41.563975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae33f4f-04c3-4896-9696-5a1f77f47500 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:41.565846 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c236b-acf8-484c-834d-be3f70809681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:41.566514 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c236b-acf8-484c-834d-be3f70809681 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:41.566815 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c236b-acf8-484c-834d-be3f70809681 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:41.567086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c236b-acf8-484c-834d-be3f70809681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:41.568534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c236b-acf8-484c-834d-be3f70809681 None admin] RBAC: Adding query filter params (role.id=b526c720d6b448189684bab16e2f425a, user.id=55e106036bc34331820ee5b2b9f34772, scope.system=all) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:41.568846 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c236b-acf8-484c-834d-be3f70809681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:41.570762 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c236b-acf8-484c-834d-be3f70809681 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:41.575352 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 157/309] 10.222.0.76 () {58 vars in 1334 bytes} [Thu May 12 17:28:41 2022] PUT /identity/v3/system/users/ffdc6f6e73274870a75b5a732f430338/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:28:41.576357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 153/310] 10.222.0.76 () {56 vars in 1308 bytes} [Thu May 12 17:28:41 2022] GET /identity/v3/role_assignments?user.id=55e106036bc34331820ee5b2b9f34772&scope.system=all&role.id=b526c720d6b448189684bab16e2f425a => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:41.986313 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2e607-e850-463f-82a9-0b01199c4d79 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:41.986705 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2e607-e850-463f-82a9-0b01199c4d79 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:41.988535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2e607-e850-463f-82a9-0b01199c4d79 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:41.988535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 158/311] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:41.994054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2876-e6b3-4497-b20b-7e45f95ca101 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:41.994344 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2876-e6b3-4497-b20b-7e45f95ca101 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:41.994617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2876-e6b3-4497-b20b-7e45f95ca101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:42.012063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-37ac2876-e6b3-4497-b20b-7e45f95ca101 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:42.013253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-37ac2876-e6b3-4497-b20b-7e45f95ca101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:42.080331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 154/312] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:42.104460 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2e607-e850-463f-82a9-0b01199c4d79 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:42.212192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2e607-e850-463f-82a9-0b01199c4d79 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:42.250986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f0a6c-7dae-4d07-aab2-5e6e3ab2edda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:42.251780 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f0a6c-7dae-4d07-aab2-5e6e3ab2edda None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:42.252060 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f0a6c-7dae-4d07-aab2-5e6e3ab2edda None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:42.252414 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f0a6c-7dae-4d07-aab2-5e6e3ab2edda None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:42.263013 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f0a6c-7dae-4d07-aab2-5e6e3ab2edda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-228f0a6c-7dae-4d07-aab2-5e6e3ab2edda None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:42.271457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:42.272359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:42.273303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:42.273303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:42.273303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:42.273303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:42.273303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:42.273303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:42.273303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:42.273303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:42.273303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:42.273303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:42.273303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:42.273303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:42.273303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 159/313] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:42.280210 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac2876-e6b3-4497-b20b-7e45f95ca101 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:42.388274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac2876-e6b3-4497-b20b-7e45f95ca101 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:42.427333 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf949b-cdf4-4a34-ba01-28d622ec85f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:42.428364 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf949b-cdf4-4a34-ba01-28d622ec85f5 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:42.428873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf949b-cdf4-4a34-ba01-28d622ec85f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:42.429391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf949b-cdf4-4a34-ba01-28d622ec85f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:42.430395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf949b-cdf4-4a34-ba01-28d622ec85f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:42.430938 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf949b-cdf4-4a34-ba01-28d622ec85f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:42.432532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf949b-cdf4-4a34-ba01-28d622ec85f5 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:42.445996 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 155/314] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:42.447623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f0a6c-7dae-4d07-aab2-5e6e3ab2edda None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:42.552525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f0a6c-7dae-4d07-aab2-5e6e3ab2edda None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:42.587194 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe3a7d-a5f2-4627-b7f6-f906c2d36727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:42.588395 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe3a7d-a5f2-4627-b7f6-f906c2d36727 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:42.588928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe3a7d-a5f2-4627-b7f6-f906c2d36727 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:42.589489 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe3a7d-a5f2-4627-b7f6-f906c2d36727 None admin] PATH_INFO: `/v3/users/58259b035ece409c8f85648218ffe693` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:42.590936 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe3a7d-a5f2-4627-b7f6-f906c2d36727 None admin] RBAC: Authorizing `identity:get_user(user_id=58259b035ece409c8f85648218ffe693)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:42.592690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe3a7d-a5f2-4627-b7f6-f906c2d36727 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:42.598783 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 160/315] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:42 2022] GET /identity/v3/users/58259b035ece409c8f85648218ffe693 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:42.601455 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf949b-cdf4-4a34-ba01-28d622ec85f5 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:42.701462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf949b-cdf4-4a34-ba01-28d622ec85f5 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:42.735218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e8bc4-4990-4bb4-9050-d4bab43697d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:42.736183 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e8bc4-4990-4bb4-9050-d4bab43697d0 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:42.736751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e8bc4-4990-4bb4-9050-d4bab43697d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:42.737313 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e8bc4-4990-4bb4-9050-d4bab43697d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:42.809368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e8bc4-4990-4bb4-9050-d4bab43697d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:42.810771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e8bc4-4990-4bb4-9050-d4bab43697d0 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:42.912340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 156/316] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:42.918097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe3a7d-a5f2-4627-b7f6-f906c2d36727 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:43.021139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe3a7d-a5f2-4627-b7f6-f906c2d36727 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:43.055161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24248c-51da-4759-bcdb-128320787785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:43.056424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24248c-51da-4759-bcdb-128320787785 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:43.056923 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24248c-51da-4759-bcdb-128320787785 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:43.057432 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24248c-51da-4759-bcdb-128320787785 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:43.058906 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24248c-51da-4759-bcdb-128320787785 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:43.060626 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24248c-51da-4759-bcdb-128320787785 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:43.066776 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 161/317] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:42 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:43.069274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e8bc4-4990-4bb4-9050-d4bab43697d0 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:43.171523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e8bc4-4990-4bb4-9050-d4bab43697d0 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:43.204819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fc9c0-b74b-4755-8cec-66ad0741d097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:43.205999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fc9c0-b74b-4755-8cec-66ad0741d097 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:43.206280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fc9c0-b74b-4755-8cec-66ad0741d097 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:43.206553 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fc9c0-b74b-4755-8cec-66ad0741d097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:43.207405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fc9c0-b74b-4755-8cec-66ad0741d097 None admin] RBAC: Adding query filter params (role.id=b526c720d6b448189684bab16e2f425a, scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e, user.id=58259b035ece409c8f85648218ffe693) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:43.207709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fc9c0-b74b-4755-8cec-66ad0741d097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:43.209156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fc9c0-b74b-4755-8cec-66ad0741d097 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:43.215627 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 157/318] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:28:43 2022] GET /identity/v3/role_assignments?user.id=58259b035ece409c8f85648218ffe693&scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e&role.id=b526c720d6b448189684bab16e2f425a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:43.587928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248decb-d18b-401b-9df6-e4a24ed40c22 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:43.588487 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248decb-d18b-401b-9df6-e4a24ed40c22 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:43.588487 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248decb-d18b-401b-9df6-e4a24ed40c22 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:43.590018 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 162/319] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:43.595098 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fabcf-5886-4d0d-be5f-5dff732d987b None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:43.595497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fabcf-5886-4d0d-be5f-5dff732d987b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:43.595690 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fabcf-5886-4d0d-be5f-5dff732d987b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:43.612254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-095fabcf-5886-4d0d-be5f-5dff732d987b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:43.613512 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-095fabcf-5886-4d0d-be5f-5dff732d987b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:43.680660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 158/320] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:43.703639 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248decb-d18b-401b-9df6-e4a24ed40c22 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:43.809786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248decb-d18b-401b-9df6-e4a24ed40c22 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:43.841653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b47cf-a458-4481-9e88-ce460739b3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:43.842356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b47cf-a458-4481-9e88-ce460739b3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:43.842633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b47cf-a458-4481-9e88-ce460739b3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:43.842931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b47cf-a458-4481-9e88-ce460739b3c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:43.844084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b47cf-a458-4481-9e88-ce460739b3c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:43.845510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b47cf-a458-4481-9e88-ce460739b3c5 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:43.847429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 163/321] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:28:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:43.853061 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fabcf-5886-4d0d-be5f-5dff732d987b None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:43.948531 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fabcf-5886-4d0d-be5f-5dff732d987b None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:43.952280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2ab7-1a81-4134-83fa-708a2b7a1740 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:43.952569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2ab7-1a81-4134-83fa-708a2b7a1740 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:43.952847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b2ab7-1a81-4134-83fa-708a2b7a1740 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:43.954226 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 164/322] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:43.955334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea872-e28e-4338-a13c-85511afbb41e None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:43.955635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea872-e28e-4338-a13c-85511afbb41e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:43.956013 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea872-e28e-4338-a13c-85511afbb41e None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:43.957500 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 165/323] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:43.959555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6d2e0-52d7-49ee-be98-7c0002422370 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:43.959845 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6d2e0-52d7-49ee-be98-7c0002422370 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:43.960126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6d2e0-52d7-49ee-be98-7c0002422370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:43.976308 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-5be6d2e0-52d7-49ee-be98-7c0002422370 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:43.977514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5be6d2e0-52d7-49ee-be98-7c0002422370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:43.982042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cff5a1-f4cf-46ca-b4b0-96393737295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:43.982726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cff5a1-f4cf-46ca-b4b0-96393737295b None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:43.983007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cff5a1-f4cf-46ca-b4b0-96393737295b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:43.983275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cff5a1-f4cf-46ca-b4b0-96393737295b None admin] PATH_INFO: `/v3/groups` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:43.983971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cff5a1-f4cf-46ca-b4b0-96393737295b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:43.985392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cff5a1-f4cf-46ca-b4b0-96393737295b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:43.999755 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 159/324] 10.222.0.76 () {60 vars in 1134 bytes} [Thu May 12 17:28:43 2022] POST /identity/v3/groups => generated 226 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:28:44.001251 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9484e-9450-4e3b-a1de-506fdc2bdcdc None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:44.001739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9484e-9450-4e3b-a1de-506fdc2bdcdc None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:44.002025 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9484e-9450-4e3b-a1de-506fdc2bdcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:44.020171 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-6bf9484e-9450-4e3b-a1de-506fdc2bdcdc None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:44.021411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-6bf9484e-9450-4e3b-a1de-506fdc2bdcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:44.050801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 166/325] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:44.074220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6d2e0-52d7-49ee-be98-7c0002422370 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:44.094805 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 160/326] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:44.117346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9484e-9450-4e3b-a1de-506fdc2bdcdc None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:44.183008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6d2e0-52d7-49ee-be98-7c0002422370 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:44.218201 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa919d-5156-4c01-ae59-be8011fdf8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:44.219053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa919d-5156-4c01-ae59-be8011fdf8fe None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:44.219332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa919d-5156-4c01-ae59-be8011fdf8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:44.219605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa919d-5156-4c01-ae59-be8011fdf8fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:44.228120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9484e-9450-4e3b-a1de-506fdc2bdcdc None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:44.231598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa919d-5156-4c01-ae59-be8011fdf8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-79fa919d-5156-4c01-ae59-be8011fdf8fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:44.240221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:44.241193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:44.242036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:44.242036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:44.242036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:44.242036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:44.242036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:44.242036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:44.242036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:44.242036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:44.242036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:44.242036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:44.242036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:44.242036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:44.242036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 167/327] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:28:44.247262 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa919d-5156-4c01-ae59-be8011fdf8fe None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:44.273892 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dc236-e35f-49fb-bab9-29b47ec4a1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:44.274708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dc236-e35f-49fb-bab9-29b47ec4a1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:44.275016 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dc236-e35f-49fb-bab9-29b47ec4a1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:44.275271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dc236-e35f-49fb-bab9-29b47ec4a1d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:44.292646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11dc236-e35f-49fb-bab9-29b47ec4a1d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-b11dc236-e35f-49fb-bab9-29b47ec4a1d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:44.301405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:44.302339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:44.303193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:44.303193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:44.303193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:44.303193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:44.303193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:44.303193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:44.303193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:44.303193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:44.303193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:44.303193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:44.303193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:44.303193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:44.303193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 161/328] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:28:44.308679 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dc236-e35f-49fb-bab9-29b47ec4a1d7 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:44.376321 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa919d-5156-4c01-ae59-be8011fdf8fe None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:44.418971 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d8b62-dfe2-46f8-b36d-77be2109f18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:44.419980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d8b62-dfe2-46f8-b36d-77be2109f18e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:44.420440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d8b62-dfe2-46f8-b36d-77be2109f18e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:44.420880 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d8b62-dfe2-46f8-b36d-77be2109f18e None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:44.421854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d8b62-dfe2-46f8-b36d-77be2109f18e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:44.422338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d8b62-dfe2-46f8-b36d-77be2109f18e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:44.424000 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d8b62-dfe2-46f8-b36d-77be2109f18e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:44.433660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 168/329] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:44.438649 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dc236-e35f-49fb-bab9-29b47ec4a1d7 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:44.439701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d8b62-dfe2-46f8-b36d-77be2109f18e None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:44.483400 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933e5e0-1a53-4db0-b5fe-708b7113103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:44.484128 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933e5e0-1a53-4db0-b5fe-708b7113103f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:44.485879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933e5e0-1a53-4db0-b5fe-708b7113103f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:44.485879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933e5e0-1a53-4db0-b5fe-708b7113103f None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:44.486359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933e5e0-1a53-4db0-b5fe-708b7113103f None admin] RBAC: Adding query filter params (name=member) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:44.487324 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933e5e0-1a53-4db0-b5fe-708b7113103f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:44.488969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933e5e0-1a53-4db0-b5fe-708b7113103f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:44.500943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 162/330] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:44.508069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933e5e0-1a53-4db0-b5fe-708b7113103f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:44.570968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d8b62-dfe2-46f8-b36d-77be2109f18e None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:44.607205 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c8ddf-dfe9-4f9f-a649-fbd7cfb232d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:44.608864 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c8ddf-dfe9-4f9f-a649-fbd7cfb232d6 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:44.609351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c8ddf-dfe9-4f9f-a649-fbd7cfb232d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:44.609823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c8ddf-dfe9-4f9f-a649-fbd7cfb232d6 None admin] PATH_INFO: `/v3/users/55e106036bc34331820ee5b2b9f34772` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:44.611267 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c8ddf-dfe9-4f9f-a649-fbd7cfb232d6 None admin] RBAC: Authorizing `identity:get_user(user_id=55e106036bc34331820ee5b2b9f34772)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:44.613514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c8ddf-dfe9-4f9f-a649-fbd7cfb232d6 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:44.615741 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 169/331] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:44 2022] GET /identity/v3/users/55e106036bc34331820ee5b2b9f34772 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:44.622396 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c8ddf-dfe9-4f9f-a649-fbd7cfb232d6 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:44.632375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933e5e0-1a53-4db0-b5fe-708b7113103f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:44.697433 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aa935-846d-440e-a565-28467fb07932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:44.698317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa935-846d-440e-a565-28467fb07932 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:44.698592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa935-846d-440e-a565-28467fb07932 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:44.698947 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa935-846d-440e-a565-28467fb07932 None admin] PATH_INFO: `/v3/users/ffdc6f6e73274870a75b5a732f430338` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:44.700579 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910aa935-846d-440e-a565-28467fb07932 None admin] RBAC: Authorizing `identity:get_user(user_id=ffdc6f6e73274870a75b5a732f430338)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:44.702191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910aa935-846d-440e-a565-28467fb07932 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:44.704172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 163/332] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:44 2022] GET /identity/v3/users/ffdc6f6e73274870a75b5a732f430338 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:44.710325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aa935-846d-440e-a565-28467fb07932 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:44.737236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c8ddf-dfe9-4f9f-a649-fbd7cfb232d6 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:44.785223 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59907437-a98f-43b3-8de4-76a321c11a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:44.786085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59907437-a98f-43b3-8de4-76a321c11a38 None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:44.786361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59907437-a98f-43b3-8de4-76a321c11a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:44.786634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59907437-a98f-43b3-8de4-76a321c11a38 None admin] PATH_INFO: `/v3/system/users/55e106036bc34331820ee5b2b9f34772/roles/b526c720d6b448189684bab16e2f425a` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:44.788191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59907437-a98f-43b3-8de4-76a321c11a38 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=55e106036bc34331820ee5b2b9f34772, role_id=b526c720d6b448189684bab16e2f425a)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:44.789654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59907437-a98f-43b3-8de4-76a321c11a38 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:44.800120 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 170/333] 10.222.0.76 () {58 vars in 1334 bytes} [Thu May 12 17:28:44 2022] PUT /identity/v3/system/users/55e106036bc34331820ee5b2b9f34772/roles/b526c720d6b448189684bab16e2f425a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:28:44.860165 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aa935-846d-440e-a565-28467fb07932 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:44.900620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb2075-90fa-4c10-afce-f84a26930c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:44.901582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb2075-90fa-4c10-afce-f84a26930c3c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:44.902018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb2075-90fa-4c10-afce-f84a26930c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:44.902441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb2075-90fa-4c10-afce-f84a26930c3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:44.903496 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb2075-90fa-4c10-afce-f84a26930c3c None admin] RBAC: Adding query filter params (role.id=aac74c237ff74c5199b863b81ced5058, user.id=ffdc6f6e73274870a75b5a732f430338, scope.system=all) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:44.903979 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb2075-90fa-4c10-afce-f84a26930c3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:44.905606 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb2075-90fa-4c10-afce-f84a26930c3c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:44.920288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 164/334] 10.222.0.76 () {56 vars in 1308 bytes} [Thu May 12 17:28:44 2022] GET /identity/v3/role_assignments?user.id=ffdc6f6e73274870a75b5a732f430338&scope.system=all&role.id=aac74c237ff74c5199b863b81ced5058 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:46.806551 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644039c0-947a-464b-9b6e-0c833c936135 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:46.807115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644039c0-947a-464b-9b6e-0c833c936135 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:46.807115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644039c0-947a-464b-9b6e-0c833c936135 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:46.808760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 171/335] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:46.828725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb41569-0686-4a02-8ec1-52443b47235f None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:46.829232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb41569-0686-4a02-8ec1-52443b47235f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:46.829330 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb41569-0686-4a02-8ec1-52443b47235f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:46.847757 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-7fb41569-0686-4a02-8ec1-52443b47235f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:46.848965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-7fb41569-0686-4a02-8ec1-52443b47235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:46.933312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 165/336] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:46.968210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644039c0-947a-464b-9b6e-0c833c936135 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:47.024700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bd015-cc39-41c7-82c4-6c6b9d528fdd None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:47.025039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bd015-cc39-41c7-82c4-6c6b9d528fdd None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:47.025258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bd015-cc39-41c7-82c4-6c6b9d528fdd None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:47.026951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 166/337] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:28:47.032287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eee697-af39-44fd-b46d-9c8fd714b39c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:47.032564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eee697-af39-44fd-b46d-9c8fd714b39c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:47.032835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eee697-af39-44fd-b46d-9c8fd714b39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:47.059078 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-b7eee697-af39-44fd-b46d-9c8fd714b39c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:47.060189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b7eee697-af39-44fd-b46d-9c8fd714b39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:47.096505 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644039c0-947a-464b-9b6e-0c833c936135 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:47.163438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dc776-475c-4c27-875c-2771d0a3d251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:47.164245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dc776-475c-4c27-875c-2771d0a3d251 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:47.164523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dc776-475c-4c27-875c-2771d0a3d251 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:47.164790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dc776-475c-4c27-875c-2771d0a3d251 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:47.184750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052dc776-475c-4c27-875c-2771d0a3d251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-052dc776-475c-4c27-875c-2771d0a3d251 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:47.192634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:47.194761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:47.196769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:47.196769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:47.196769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:47.196769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:47.196769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:47.196769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:47.196769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:47.196769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:47.196769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:47.196769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:47.196769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:47.196769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:47.196769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 172/338] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:47.200090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 167/339] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:47.200771 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dc776-475c-4c27-875c-2771d0a3d251 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:47.256266 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eee697-af39-44fd-b46d-9c8fd714b39c None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:47.366430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dc776-475c-4c27-875c-2771d0a3d251 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:47.407519 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edd433-9c9b-4b0a-a6f7-ab441c472f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:47.409568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd433-9c9b-4b0a-a6f7-ab441c472f31 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:47.410206 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd433-9c9b-4b0a-a6f7-ab441c472f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:47.410845 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd433-9c9b-4b0a-a6f7-ab441c472f31 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:47.411778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edd433-9c9b-4b0a-a6f7-ab441c472f31 None admin] RBAC: Adding query filter params (name=member) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:47.412241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edd433-9c9b-4b0a-a6f7-ab441c472f31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:47.413779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edd433-9c9b-4b0a-a6f7-ab441c472f31 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:47.424853 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 173/340] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:47.430145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edd433-9c9b-4b0a-a6f7-ab441c472f31 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:47.479427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eee697-af39-44fd-b46d-9c8fd714b39c None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:47.530183 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531c328-becc-42b4-8748-209c31a3cd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:47.531648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c328-becc-42b4-8748-209c31a3cd5e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:47.531922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c328-becc-42b4-8748-209c31a3cd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:47.532189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c328-becc-42b4-8748-209c31a3cd5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:47.552789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531c328-becc-42b4-8748-209c31a3cd5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-d531c328-becc-42b4-8748-209c31a3cd5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:47.561028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:47.561929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:47.562774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:47.562774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:47.562774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:47.562774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:47.562774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:47.562774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:47.562774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:47.562774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:47.562774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:47.562774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:47.562774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:47.562774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:47.562774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 168/341] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:28:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:47.570528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531c328-becc-42b4-8748-209c31a3cd5e None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:47.571528 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edd433-9c9b-4b0a-a6f7-ab441c472f31 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:47.651964 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571deb9-0b94-4c16-bf58-d68ffbb93918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:47.653541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571deb9-0b94-4c16-bf58-d68ffbb93918 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:47.653820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571deb9-0b94-4c16-bf58-d68ffbb93918 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:47.654092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571deb9-0b94-4c16-bf58-d68ffbb93918 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:47.794636 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531c328-becc-42b4-8748-209c31a3cd5e None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:47.798279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571deb9-0b94-4c16-bf58-d68ffbb93918 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:47.799868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571deb9-0b94-4c16-bf58-d68ffbb93918 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:47.863390 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ce985-568e-41b4-9936-2b8ad3011e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:47.864073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ce985-568e-41b4-9936-2b8ad3011e48 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:47.864356 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ce985-568e-41b4-9936-2b8ad3011e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:47.864631 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ce985-568e-41b4-9936-2b8ad3011e48 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:47.865397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ce985-568e-41b4-9936-2b8ad3011e48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:47.865710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ce985-568e-41b4-9936-2b8ad3011e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:47.867192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ce985-568e-41b4-9936-2b8ad3011e48 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:47.875992 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 169/342] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:28:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:47.882393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ce985-568e-41b4-9936-2b8ad3011e48 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:47.945167 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 174/343] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:47.950367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571deb9-0b94-4c16-bf58-d68ffbb93918 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:48.021641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ce985-568e-41b4-9936-2b8ad3011e48 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:48.072422 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93669af9-49ed-491a-8417-e625fad58164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:48.073501 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93669af9-49ed-491a-8417-e625fad58164 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:48.073985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93669af9-49ed-491a-8417-e625fad58164 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:48.074506 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93669af9-49ed-491a-8417-e625fad58164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:48.094160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571deb9-0b94-4c16-bf58-d68ffbb93918 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:48.126316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c4320-a041-491e-98b3-04a0f59512cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:48.127700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c4320-a041-491e-98b3-04a0f59512cd None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:48.127987 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c4320-a041-491e-98b3-04a0f59512cd None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:48.128942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c4320-a041-491e-98b3-04a0f59512cd None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:48.130817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c4320-a041-491e-98b3-04a0f59512cd None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:48.132263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c4320-a041-491e-98b3-04a0f59512cd None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:48.135451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 175/344] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:47 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:48.141092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373b4ae-dba9-4005-ba9b-71ee50809140 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:48.141369 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373b4ae-dba9-4005-ba9b-71ee50809140 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:48.141638 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373b4ae-dba9-4005-ba9b-71ee50809140 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:48.143595 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 176/345] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:48.145026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373b4ae-dba9-4005-ba9b-71ee50809140 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:48.204575 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93669af9-49ed-491a-8417-e625fad58164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:48.209727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93669af9-49ed-491a-8417-e625fad58164 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:48.320322 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373b4ae-dba9-4005-ba9b-71ee50809140 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:48.334491 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 170/346] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 17:28:48.336034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5edc4-e18a-4e67-a651-b58093ad0bbe None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:48.336325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5edc4-e18a-4e67-a651-b58093ad0bbe None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:48.336596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5edc4-e18a-4e67-a651-b58093ad0bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:48.353957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-f1b5edc4-e18a-4e67-a651-b58093ad0bbe None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:48.355255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f1b5edc4-e18a-4e67-a651-b58093ad0bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:48.375448 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff564b4-a2a6-46fc-ab94-33d917277bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:48.376326 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff564b4-a2a6-46fc-ab94-33d917277bde None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:48.376599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff564b4-a2a6-46fc-ab94-33d917277bde None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:48.376866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff564b4-a2a6-46fc-ab94-33d917277bde None admin] PATH_INFO: `/v3/groups/0281632eb3be42d18939444439d4b604` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:48.387380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff564b4-a2a6-46fc-ab94-33d917277bde None admin] RBAC: Authorizing `identity:get_group(group_id=0281632eb3be42d18939444439d4b604)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:48.388863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff564b4-a2a6-46fc-ab94-33d917277bde None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:48.390808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 177/347] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:28:48 2022] GET /identity/v3/groups/0281632eb3be42d18939444439d4b604 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:48.391376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff564b4-a2a6-46fc-ab94-33d917277bde None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:48.441688 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 171/348] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:48.442564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5edc4-e18a-4e67-a651-b58093ad0bbe None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:48.514528 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff564b4-a2a6-46fc-ab94-33d917277bde None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:48.548477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e16e7-d517-4c93-8938-1911bfe642dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:48.550112 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e16e7-d517-4c93-8938-1911bfe642dd None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:48.550876 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e16e7-d517-4c93-8938-1911bfe642dd None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:48.551159 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e16e7-d517-4c93-8938-1911bfe642dd None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:48.552531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e16e7-d517-4c93-8938-1911bfe642dd None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:48.553961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e16e7-d517-4c93-8938-1911bfe642dd None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:48.555846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 178/349] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:48 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:48.556766 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e16e7-d517-4c93-8938-1911bfe642dd None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:48.656640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5edc4-e18a-4e67-a651-b58093ad0bbe None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:48.672489 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e16e7-d517-4c93-8938-1911bfe642dd None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:48.716078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc70b6-6a01-4af8-8b69-0511826328a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:48.716949 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc70b6-6a01-4af8-8b69-0511826328a2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:48.717227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc70b6-6a01-4af8-8b69-0511826328a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:48.717496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc70b6-6a01-4af8-8b69-0511826328a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:48.732022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc70b6-6a01-4af8-8b69-0511826328a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:48.739532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23ef6a-b29a-42df-b992-5aa1998eede1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:48.740209 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ef6a-b29a-42df-b992-5aa1998eede1 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-9ccc70b6-6a01-4af8-8b69-0511826328a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:48.740404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:48.741280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:48.742104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:48.742104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:48.742104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:48.742104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:48.742104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:48.742104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:48.742104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:48.742104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:48.742104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:48.742104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:48.742104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:48.742104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:48.742745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ef6a-b29a-42df-b992-5aa1998eede1 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:48.742745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23ef6a-b29a-42df-b992-5aa1998eede1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:48.742894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 179/350] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:48.742970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23ef6a-b29a-42df-b992-5aa1998eede1 None admin] RBAC: Adding query filter params (group.id=0281632eb3be42d18939444439d4b604, role.id=aac74c237ff74c5199b863b81ced5058, scope.project.id=8cac096f50b74f85bd46506ce124b834) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:48.742970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23ef6a-b29a-42df-b992-5aa1998eede1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:48.743099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc70b6-6a01-4af8-8b69-0511826328a2 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:48.743713 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23ef6a-b29a-42df-b992-5aa1998eede1 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:48.753420 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 172/351] 10.222.0.76 () {56 vars in 1376 bytes} [Thu May 12 17:28:48 2022] GET /identity/v3/role_assignments?group.id=0281632eb3be42d18939444439d4b604&scope.project.id=8cac096f50b74f85bd46506ce124b834&role.id=aac74c237ff74c5199b863b81ced5058 => generated 260 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:48.765983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23ef6a-b29a-42df-b992-5aa1998eede1 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:48.863259 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc70b6-6a01-4af8-8b69-0511826328a2 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:48.901199 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c026d7-b34a-4964-b7a7-b08ec88b9722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:48.902118 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c026d7-b34a-4964-b7a7-b08ec88b9722 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:48.902446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c026d7-b34a-4964-b7a7-b08ec88b9722 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:48.902752 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c026d7-b34a-4964-b7a7-b08ec88b9722 None admin] PATH_INFO: `/v3/groups/0281632eb3be42d18939444439d4b604` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:48.904024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c026d7-b34a-4964-b7a7-b08ec88b9722 None admin] RBAC: Authorizing `identity:get_group(group_id=0281632eb3be42d18939444439d4b604)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:48.905495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c026d7-b34a-4964-b7a7-b08ec88b9722 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:48.907165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 180/352] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:28:48 2022] GET /identity/v3/groups/0281632eb3be42d18939444439d4b604 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:48.913701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c026d7-b34a-4964-b7a7-b08ec88b9722 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:48.938763 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23ef6a-b29a-42df-b992-5aa1998eede1 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:48.979004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e3fc-357e-488b-ab5e-0cce89a7434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:48.980069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e3fc-357e-488b-ab5e-0cce89a7434b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:48.980567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e3fc-357e-488b-ab5e-0cce89a7434b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:48.981069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e3fc-357e-488b-ab5e-0cce89a7434b None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:48.982048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7e3fc-357e-488b-ab5e-0cce89a7434b None admin] RBAC: Adding query filter params (name=member) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:48.982586 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7e3fc-357e-488b-ab5e-0cce89a7434b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:48.984249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7e3fc-357e-488b-ab5e-0cce89a7434b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:48.994636 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 173/353] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:48.996338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff089f0-8140-4ec8-b059-c96f7881ee51 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:48.996834 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff089f0-8140-4ec8-b059-c96f7881ee51 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:48.997336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff089f0-8140-4ec8-b059-c96f7881ee51 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:48.999181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 174/354] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:49.000613 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac4da3-e97b-45c7-b6d9-858b61493b3a None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:49.001104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac4da3-e97b-45c7-b6d9-858b61493b3a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:49.001576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac4da3-e97b-45c7-b6d9-858b61493b3a None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:49.003135 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 175/355] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:49.008397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ef74d-46be-4825-aad1-6e236d901a63 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:49.009034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ef74d-46be-4825-aad1-6e236d901a63 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:49.009511 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ef74d-46be-4825-aad1-6e236d901a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:49.028612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ee8ef74d-46be-4825-aad1-6e236d901a63 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:49.030158 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ee8ef74d-46be-4825-aad1-6e236d901a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:49.032614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c026d7-b34a-4964-b7a7-b08ec88b9722 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:49.077119 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e0d55-5cff-4f3d-b6a8-daad6906b98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:49.078119 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0d55-5cff-4f3d-b6a8-daad6906b98a None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:49.078660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0d55-5cff-4f3d-b6a8-daad6906b98a None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:49.078973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0d55-5cff-4f3d-b6a8-daad6906b98a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:49.081301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e0d55-5cff-4f3d-b6a8-daad6906b98a None admin] RBAC: Adding query filter params (group.id=0281632eb3be42d18939444439d4b604, role.id=b63d5637c42b47588880ae919eb7f448, scope.project.id=8cac096f50b74f85bd46506ce124b834) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:49.081301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e0d55-5cff-4f3d-b6a8-daad6906b98a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:49.082399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e0d55-5cff-4f3d-b6a8-daad6906b98a None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:49.090235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 181/356] 10.222.0.76 () {56 vars in 1376 bytes} [Thu May 12 17:28:48 2022] GET /identity/v3/role_assignments?group.id=0281632eb3be42d18939444439d4b604&scope.project.id=8cac096f50b74f85bd46506ce124b834&role.id=b63d5637c42b47588880ae919eb7f448 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:49.093742 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143e839-eca9-4deb-adb6-ffef700ed234 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:49.093742 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143e839-eca9-4deb-adb6-ffef700ed234 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:49.093742 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143e839-eca9-4deb-adb6-ffef700ed234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:49.116224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 176/357] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:49.117119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ef74d-46be-4825-aad1-6e236d901a63 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:49.119765 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-4143e839-eca9-4deb-adb6-ffef700ed234 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:49.122008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4143e839-eca9-4deb-adb6-ffef700ed234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:49.228591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 182/358] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:49.231051 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef583f-54b0-4b65-9882-71ab3a19866c None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:49.231558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef583f-54b0-4b65-9882-71ab3a19866c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:49.232030 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef583f-54b0-4b65-9882-71ab3a19866c None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:49.233600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 183/359] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:49.234610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef583f-54b0-4b65-9882-71ab3a19866c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:49.251063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ef74d-46be-4825-aad1-6e236d901a63 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:49.288968 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6eff1-f4c1-4bcb-b4e5-d48707b91040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:49.289541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6eff1-f4c1-4bcb-b4e5-d48707b91040 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:49.289867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6eff1-f4c1-4bcb-b4e5-d48707b91040 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:49.290088 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6eff1-f4c1-4bcb-b4e5-d48707b91040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:49.354961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef583f-54b0-4b65-9882-71ab3a19866c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:49.373904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6eff1-f4c1-4bcb-b4e5-d48707b91040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:49.375800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6eff1-f4c1-4bcb-b4e5-d48707b91040 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:49.391770 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c72204-f7a2-4452-97d2-8f3c583396d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:49.392772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c72204-f7a2-4452-97d2-8f3c583396d8 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:49.393521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c72204-f7a2-4452-97d2-8f3c583396d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:49.393675 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c72204-f7a2-4452-97d2-8f3c583396d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:49.404564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c72204-f7a2-4452-97d2-8f3c583396d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-80c72204-f7a2-4452-97d2-8f3c583396d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:49.413611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:49.414554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:49.415422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:49.415422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:49.415422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:49.415422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:49.415422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:49.415422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:49.415422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:49.415422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:49.415422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:49.415422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:49.415422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 17:28:49.415422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:49.415422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 184/360] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:49.416165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543402b-96e9-467e-8792-66c478547cfb None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:49.417031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543402b-96e9-467e-8792-66c478547cfb None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:49.417031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543402b-96e9-467e-8792-66c478547cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:49.434502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-3543402b-96e9-467e-8792-66c478547cfb None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:49.435716 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3543402b-96e9-467e-8792-66c478547cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:49.505098 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 185/361] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:49.505956 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543402b-96e9-467e-8792-66c478547cfb None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:49.513436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 177/362] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:49.514543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6eff1-f4c1-4bcb-b4e5-d48707b91040 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:49.632615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543402b-96e9-467e-8792-66c478547cfb None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:49.647396 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6eff1-f4c1-4bcb-b4e5-d48707b91040 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:49.669170 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394355e-52e4-44db-8eca-5e357e5d2062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:49.669986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394355e-52e4-44db-8eca-5e357e5d2062 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:49.670266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394355e-52e4-44db-8eca-5e357e5d2062 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:49.670538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394355e-52e4-44db-8eca-5e357e5d2062 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:49.682121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394355e-52e4-44db-8eca-5e357e5d2062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:49.689470 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf169e2-8754-4074-8b15-0f69cf60b84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-a394355e-52e4-44db-8eca-5e357e5d2062 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:49.690870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:49.691848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:49.692671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:49.692671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:49.692671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:49.692671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:49.692671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:49.692671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:49.692671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:49.692671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:49.692671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:49.692671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:49.692671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:49.692671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:49.692671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 186/363] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:28:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:49.693365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394355e-52e4-44db-8eca-5e357e5d2062 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:49.694371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf169e2-8754-4074-8b15-0f69cf60b84b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:49.694898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf169e2-8754-4074-8b15-0f69cf60b84b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:49.695418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf169e2-8754-4074-8b15-0f69cf60b84b None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:49.697099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf169e2-8754-4074-8b15-0f69cf60b84b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:49.698527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf169e2-8754-4074-8b15-0f69cf60b84b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:49.700334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf169e2-8754-4074-8b15-0f69cf60b84b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:49.714114 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 178/364] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:49.715890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf169e2-8754-4074-8b15-0f69cf60b84b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:49.818426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394355e-52e4-44db-8eca-5e357e5d2062 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:49.853567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf169e2-8754-4074-8b15-0f69cf60b84b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:49.863032 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72d530-09ad-48e2-b693-0f23e2825eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:49.863371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72d530-09ad-48e2-b693-0f23e2825eca None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:49.863649 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72d530-09ad-48e2-b693-0f23e2825eca None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:49.863921 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72d530-09ad-48e2-b693-0f23e2825eca None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:49.865415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72d530-09ad-48e2-b693-0f23e2825eca None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:49.867017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72d530-09ad-48e2-b693-0f23e2825eca None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:49.868817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 187/365] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:49 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:49.869643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72d530-09ad-48e2-b693-0f23e2825eca None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:49.898400 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea34284-186a-484f-82c2-214059d46af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:49.899934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea34284-186a-484f-82c2-214059d46af2 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:49.900680 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea34284-186a-484f-82c2-214059d46af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:49.901107 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea34284-186a-484f-82c2-214059d46af2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:49.914607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea34284-186a-484f-82c2-214059d46af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-eea34284-186a-484f-82c2-214059d46af2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:49.925389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:49.926414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:49.927441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:49.927441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:49.927441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:49.927441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:49.927441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:49.927441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:49.927441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:49.927441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:49.927441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:49.927441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:49.927441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:49.927441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:49.929795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 179/366] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:28:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:49.930747 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea34284-186a-484f-82c2-214059d46af2 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:49.985912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72d530-09ad-48e2-b693-0f23e2825eca None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:50.028803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ab558-a20c-46b6-81c7-93a48750121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:50.029748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ab558-a20c-46b6-81c7-93a48750121b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:50.030339 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ab558-a20c-46b6-81c7-93a48750121b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:50.030814 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ab558-a20c-46b6-81c7-93a48750121b None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:50.032224 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ab558-a20c-46b6-81c7-93a48750121b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:50.032815 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ab558-a20c-46b6-81c7-93a48750121b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:50.035570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ab558-a20c-46b6-81c7-93a48750121b None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:50.047146 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 188/367] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:28:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:50.048481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ab558-a20c-46b6-81c7-93a48750121b None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:50.050360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea34284-186a-484f-82c2-214059d46af2 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:50.099665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f959b14-cf5c-4406-991e-7d8f12d9c39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:50.101345 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f959b14-cf5c-4406-991e-7d8f12d9c39d None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:50.101782 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f959b14-cf5c-4406-991e-7d8f12d9c39d None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:50.102202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f959b14-cf5c-4406-991e-7d8f12d9c39d None admin] PATH_INFO: `/v3/users/55e106036bc34331820ee5b2b9f34772` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:50.104138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f959b14-cf5c-4406-991e-7d8f12d9c39d None admin] RBAC: Authorizing `identity:get_user(user_id=55e106036bc34331820ee5b2b9f34772)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:50.106388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f959b14-cf5c-4406-991e-7d8f12d9c39d None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:50.109000 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 180/368] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:28:49 2022] GET /identity/v3/users/55e106036bc34331820ee5b2b9f34772 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:50.110053 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f959b14-cf5c-4406-991e-7d8f12d9c39d None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:50.169622 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ab558-a20c-46b6-81c7-93a48750121b None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:50.204569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb4381-b2cf-479b-9b4f-5159275650db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:50.205671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4381-b2cf-479b-9b4f-5159275650db None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:50.206395 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4381-b2cf-479b-9b4f-5159275650db None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:50.206852 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4381-b2cf-479b-9b4f-5159275650db None admin] PATH_INFO: `/v3/groups/0281632eb3be42d18939444439d4b604` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:50.208607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb4381-b2cf-479b-9b4f-5159275650db None admin] RBAC: Authorizing `identity:get_group(group_id=0281632eb3be42d18939444439d4b604)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:50.210188 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb4381-b2cf-479b-9b4f-5159275650db None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:50.212445 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 189/369] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:28:50 2022] GET /identity/v3/groups/0281632eb3be42d18939444439d4b604 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:50.213371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb4381-b2cf-479b-9b4f-5159275650db None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:50.225153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f959b14-cf5c-4406-991e-7d8f12d9c39d None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:50.260599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60352afa-c17d-4078-b055-2d3439761781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:50.261491 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352afa-c17d-4078-b055-2d3439761781 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:50.261945 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352afa-c17d-4078-b055-2d3439761781 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:50.262367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352afa-c17d-4078-b055-2d3439761781 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:50.263381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352afa-c17d-4078-b055-2d3439761781 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:50.263832 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352afa-c17d-4078-b055-2d3439761781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:50.265360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352afa-c17d-4078-b055-2d3439761781 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:50.274291 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 181/370] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:50.275338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60352afa-c17d-4078-b055-2d3439761781 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:50.334871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb4381-b2cf-479b-9b4f-5159275650db None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:50.385249 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad2a16-c741-4eb2-b244-f51d19ec3504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:50.386335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad2a16-c741-4eb2-b244-f51d19ec3504 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:50.386782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad2a16-c741-4eb2-b244-f51d19ec3504 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:50.387168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad2a16-c741-4eb2-b244-f51d19ec3504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:50.396107 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60352afa-c17d-4078-b055-2d3439761781 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:50.444855 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da5449-702f-4e01-b7e9-41585124a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:50.446202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da5449-702f-4e01-b7e9-41585124a8fb None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:50.446739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da5449-702f-4e01-b7e9-41585124a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:50.447193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da5449-702f-4e01-b7e9-41585124a8fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:50.448543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da5449-702f-4e01-b7e9-41585124a8fb None admin] RBAC: Adding query filter params (role.id=b526c720d6b448189684bab16e2f425a, user.id=55e106036bc34331820ee5b2b9f34772, scope.system=all) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:50.449325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da5449-702f-4e01-b7e9-41585124a8fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:50.451445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da5449-702f-4e01-b7e9-41585124a8fb None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:50.468909 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 182/371] 10.222.0.76 () {56 vars in 1308 bytes} [Thu May 12 17:28:50 2022] GET /identity/v3/role_assignments?user.id=55e106036bc34331820ee5b2b9f34772&scope.system=all&role.id=b526c720d6b448189684bab16e2f425a => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:50.470275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da5449-702f-4e01-b7e9-41585124a8fb None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:50.503996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad2a16-c741-4eb2-b244-f51d19ec3504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:50.505485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad2a16-c741-4eb2-b244-f51d19ec3504 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:50.591469 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da5449-702f-4e01-b7e9-41585124a8fb None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:50.631143 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b27c5-aebc-4da9-96fc-cce4c677fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:50.632468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b27c5-aebc-4da9-96fc-cce4c677fcaa None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:50.633187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b27c5-aebc-4da9-96fc-cce4c677fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:50.633641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b27c5-aebc-4da9-96fc-cce4c677fcaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:50.634866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b27c5-aebc-4da9-96fc-cce4c677fcaa None admin] RBAC: Adding query filter params (group.id=0281632eb3be42d18939444439d4b604, role.id=aac74c237ff74c5199b863b81ced5058, scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:50.635388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b27c5-aebc-4da9-96fc-cce4c677fcaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:50.637107 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b27c5-aebc-4da9-96fc-cce4c677fcaa None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:50.644988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 183/372] 10.222.0.76 () {56 vars in 1376 bytes} [Thu May 12 17:28:50 2022] GET /identity/v3/role_assignments?group.id=0281632eb3be42d18939444439d4b604&scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e&role.id=aac74c237ff74c5199b863b81ced5058 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:50.646309 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b27c5-aebc-4da9-96fc-cce4c677fcaa None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:50.761652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 190/373] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:50.767410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad2a16-c741-4eb2-b244-f51d19ec3504 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:50.769820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b27c5-aebc-4da9-96fc-cce4c677fcaa None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:50.810958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923db61-e325-47c7-9854-bcee816af4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:50.812478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923db61-e325-47c7-9854-bcee816af4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:50.812986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923db61-e325-47c7-9854-bcee816af4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:50.813446 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923db61-e325-47c7-9854-bcee816af4a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:50.900056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923db61-e325-47c7-9854-bcee816af4a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:50.901866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923db61-e325-47c7-9854-bcee816af4a6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:50.925089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad2a16-c741-4eb2-b244-f51d19ec3504 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:50.968935 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf057cbe-2af0-41f8-a96f-fb8a7949c1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:50.970557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf057cbe-2af0-41f8-a96f-fb8a7949c1ca None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:50.971908 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf057cbe-2af0-41f8-a96f-fb8a7949c1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:50.972342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf057cbe-2af0-41f8-a96f-fb8a7949c1ca None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:50.974213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf057cbe-2af0-41f8-a96f-fb8a7949c1ca None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:50.976313 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf057cbe-2af0-41f8-a96f-fb8a7949c1ca None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:50.979185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 191/374] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:50 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:50.984240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf057cbe-2af0-41f8-a96f-fb8a7949c1ca None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:51.049953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 184/375] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:51.055447 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923db61-e325-47c7-9854-bcee816af4a6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:51.096557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf057cbe-2af0-41f8-a96f-fb8a7949c1ca None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:51.134599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103f172-0acc-45e9-9320-59f7f435d7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:51.136014 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103f172-0acc-45e9-9320-59f7f435d7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:51.136502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103f172-0acc-45e9-9320-59f7f435d7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:51.136982 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103f172-0acc-45e9-9320-59f7f435d7a9 None admin] PATH_INFO: `/v3/groups/0281632eb3be42d18939444439d4b604` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:51.138457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103f172-0acc-45e9-9320-59f7f435d7a9 None admin] RBAC: Authorizing `identity:get_group(group_id=0281632eb3be42d18939444439d4b604)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:51.140321 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103f172-0acc-45e9-9320-59f7f435d7a9 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:51.142333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 192/376] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:28:50 2022] GET /identity/v3/groups/0281632eb3be42d18939444439d4b604 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:51.149920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103f172-0acc-45e9-9320-59f7f435d7a9 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:51.262254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103f172-0acc-45e9-9320-59f7f435d7a9 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:51.280861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923db61-e325-47c7-9854-bcee816af4a6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:51.302207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851e186-c27c-403b-bbd5-aa4215e08f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:51.303199 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851e186-c27c-403b-bbd5-aa4215e08f5d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:51.303543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851e186-c27c-403b-bbd5-aa4215e08f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:51.303826 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851e186-c27c-403b-bbd5-aa4215e08f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:51.304679 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851e186-c27c-403b-bbd5-aa4215e08f5d None admin] RBAC: Adding query filter params (group.id=0281632eb3be42d18939444439d4b604, role.id=b63d5637c42b47588880ae919eb7f448, scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:51.304991 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851e186-c27c-403b-bbd5-aa4215e08f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:51.306458 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851e186-c27c-403b-bbd5-aa4215e08f5d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:51.313307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 193/377] 10.222.0.76 () {56 vars in 1376 bytes} [Thu May 12 17:28:51 2022] GET /identity/v3/role_assignments?group.id=0281632eb3be42d18939444439d4b604&scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e&role.id=b63d5637c42b47588880ae919eb7f448 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:51.352272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da59f2-b6f2-4db5-8aed-1ad2c6688ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:51.353159 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da59f2-b6f2-4db5-8aed-1ad2c6688ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:51.353439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da59f2-b6f2-4db5-8aed-1ad2c6688ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:51.353711 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da59f2-b6f2-4db5-8aed-1ad2c6688ca1 None admin] PATH_INFO: `/v3/projects/9ec5d27c457b4e7d87f61efe4927f51d` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:51.359659 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da59f2-b6f2-4db5-8aed-1ad2c6688ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=9ec5d27c457b4e7d87f61efe4927f51d)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:51.361171 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da59f2-b6f2-4db5-8aed-1ad2c6688ca1 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:51.363946 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 185/378] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:51 2022] GET /identity/v3/projects/9ec5d27c457b4e7d87f61efe4927f51d => generated 344 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:51.369585 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851e186-c27c-403b-bbd5-aa4215e08f5d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:51.496155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851e186-c27c-403b-bbd5-aa4215e08f5d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:51.545005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae683daf-3247-44a4-842b-9532325486de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:51.545871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae683daf-3247-44a4-842b-9532325486de None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:51.546157 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae683daf-3247-44a4-842b-9532325486de None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:51.546434 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae683daf-3247-44a4-842b-9532325486de None admin] PATH_INFO: `/v3/groups/01b724fbb3ec401bbe4e885c15a3955d` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:51.555621 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae683daf-3247-44a4-842b-9532325486de None admin] RBAC: Authorizing `identity:get_group(group_id=01b724fbb3ec401bbe4e885c15a3955d)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:51.557026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae683daf-3247-44a4-842b-9532325486de None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:51.559169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 194/379] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:28:51 2022] GET /identity/v3/groups/01b724fbb3ec401bbe4e885c15a3955d => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:51.564557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da59f2-b6f2-4db5-8aed-1ad2c6688ca1 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:51.699164 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da59f2-b6f2-4db5-8aed-1ad2c6688ca1 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:51.756688 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6d223-ce09-4377-801b-a974a22ec83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:51.757357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d223-ce09-4377-801b-a974a22ec83b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:51.757639 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d223-ce09-4377-801b-a974a22ec83b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:51.758164 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d223-ce09-4377-801b-a974a22ec83b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:51.759045 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6d223-ce09-4377-801b-a974a22ec83b None admin] RBAC: Adding query filter params (group.id=01b724fbb3ec401bbe4e885c15a3955d, role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=9ec5d27c457b4e7d87f61efe4927f51d) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:51.759352 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6d223-ce09-4377-801b-a974a22ec83b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:51.760791 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6d223-ce09-4377-801b-a974a22ec83b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:51.771366 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 186/380] 10.222.0.76 () {56 vars in 1376 bytes} [Thu May 12 17:28:51 2022] GET /identity/v3/role_assignments?group.id=01b724fbb3ec401bbe4e885c15a3955d&scope.project.id=9ec5d27c457b4e7d87f61efe4927f51d&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:51.815606 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182ee9-e156-4767-8323-a115858c670e None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:51.815889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182ee9-e156-4767-8323-a115858c670e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:51.816077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182ee9-e156-4767-8323-a115858c670e None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:51.817469 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 195/381] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:51.824500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327208d8-a77e-48fd-84d9-e833ee75998d None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:51.824787 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327208d8-a77e-48fd-84d9-e833ee75998d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:51.825071 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327208d8-a77e-48fd-84d9-e833ee75998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:51.849881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-327208d8-a77e-48fd-84d9-e833ee75998d None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:51.851140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-327208d8-a77e-48fd-84d9-e833ee75998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:51.923424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec965ba3-8126-4a25-856d-35295f029178 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:51.923739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec965ba3-8126-4a25-856d-35295f029178 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:51.923995 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec965ba3-8126-4a25-856d-35295f029178 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:51.927272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 196/382] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:51.933154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7a624-5dbc-4575-8473-1a083ca60466 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:51.933792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7a624-5dbc-4575-8473-1a083ca60466 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:51.934276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7a624-5dbc-4575-8473-1a083ca60466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:51.950153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 187/383] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:51.954049 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-37e7a624-5dbc-4575-8473-1a083ca60466 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:51.955688 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-37e7a624-5dbc-4575-8473-1a083ca60466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:51.993569 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327208d8-a77e-48fd-84d9-e833ee75998d None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:52.034777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 197/384] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:52.055012 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7a624-5dbc-4575-8473-1a083ca60466 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:52.104191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327208d8-a77e-48fd-84d9-e833ee75998d None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:52.145274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef80ac-8129-48dd-94a3-3023641662b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:52.146085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef80ac-8129-48dd-94a3-3023641662b7 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:52.146365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef80ac-8129-48dd-94a3-3023641662b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:52.146640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef80ac-8129-48dd-94a3-3023641662b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:52.157869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7a624-5dbc-4575-8473-1a083ca60466 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:52.164284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef80ac-8129-48dd-94a3-3023641662b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-6fef80ac-8129-48dd-94a3-3023641662b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:52.176254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:52.177175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:52.178591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:52.178591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:52.178591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:52.178591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:52.178591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:52.178591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:52.178591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:52.178591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:52.178591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:52.178591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:52.178591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:52.178591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:52.178591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 188/385] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:52.183169 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef80ac-8129-48dd-94a3-3023641662b7 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:52.208052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df3a63-8500-4eaf-9cc8-04149f9d3d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:52.209269 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df3a63-8500-4eaf-9cc8-04149f9d3d68 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:52.209765 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df3a63-8500-4eaf-9cc8-04149f9d3d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:52.210243 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df3a63-8500-4eaf-9cc8-04149f9d3d68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:52.234909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df3a63-8500-4eaf-9cc8-04149f9d3d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-96df3a63-8500-4eaf-9cc8-04149f9d3d68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:52.243255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:52.244183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:52.244979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:52.244979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:52.244979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:52.244979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:52.244979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:52.244979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:52.244979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:52.244979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:52.244979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:52.244979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:52.244979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:52.244979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:52.251272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 198/386] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:28:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:28:52.256828 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df3a63-8500-4eaf-9cc8-04149f9d3d68 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:52.327136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef80ac-8129-48dd-94a3-3023641662b7 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:52.387311 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df3a63-8500-4eaf-9cc8-04149f9d3d68 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:52.424886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddb7fd-507e-4a75-9994-da04c34332a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:52.425563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb7fd-507e-4a75-9994-da04c34332a3 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:52.425849 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb7fd-507e-4a75-9994-da04c34332a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:52.426122 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb7fd-507e-4a75-9994-da04c34332a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:52.426922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddb7fd-507e-4a75-9994-da04c34332a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:52.427226 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddb7fd-507e-4a75-9994-da04c34332a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:52.428610 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddb7fd-507e-4a75-9994-da04c34332a3 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:52.430549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728985e-4ca5-4703-9de7-17373d2f05f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:52.431451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728985e-4ca5-4703-9de7-17373d2f05f1 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:52.432275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728985e-4ca5-4703-9de7-17373d2f05f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:52.432732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728985e-4ca5-4703-9de7-17373d2f05f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:52.433678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728985e-4ca5-4703-9de7-17373d2f05f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:52.434163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728985e-4ca5-4703-9de7-17373d2f05f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:52.435731 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728985e-4ca5-4703-9de7-17373d2f05f1 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:52.450580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 199/387] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:28:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:52.452191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728985e-4ca5-4703-9de7-17373d2f05f1 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:52.453366 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 189/388] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:52.459259 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddb7fd-507e-4a75-9994-da04c34332a3 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:52.631017 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddb7fd-507e-4a75-9994-da04c34332a3 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:52.640899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728985e-4ca5-4703-9de7-17373d2f05f1 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:52.675174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ae144-785e-4981-88d2-2240cb4c4fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:52.676337 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae144-785e-4981-88d2-2240cb4c4fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:52.676796 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae144-785e-4981-88d2-2240cb4c4fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:52.677268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae144-785e-4981-88d2-2240cb4c4fc7 None admin] PATH_INFO: `/v3/groups/0281632eb3be42d18939444439d4b604` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:52.679630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ae144-785e-4981-88d2-2240cb4c4fc7 None admin] RBAC: Authorizing `identity:get_group(group_id=0281632eb3be42d18939444439d4b604)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:52.681258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ae144-785e-4981-88d2-2240cb4c4fc7 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:52.683155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 190/389] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:28:52 2022] GET /identity/v3/groups/0281632eb3be42d18939444439d4b604 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:52.690709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ae144-785e-4981-88d2-2240cb4c4fc7 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:52.711109 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707f87d-847d-4afe-8487-3773f0c01548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:52.712305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707f87d-847d-4afe-8487-3773f0c01548 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:52.712774 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707f87d-847d-4afe-8487-3773f0c01548 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:52.713223 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707f87d-847d-4afe-8487-3773f0c01548 None admin] PATH_INFO: `/v3/groups/0281632eb3be42d18939444439d4b604` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:52.715377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707f87d-847d-4afe-8487-3773f0c01548 None admin] RBAC: Authorizing `identity:get_group(group_id=0281632eb3be42d18939444439d4b604)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:52.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707f87d-847d-4afe-8487-3773f0c01548 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:52.720514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 200/390] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:28:52 2022] GET /identity/v3/groups/0281632eb3be42d18939444439d4b604 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:52.726909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707f87d-847d-4afe-8487-3773f0c01548 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:52.811867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ae144-785e-4981-88d2-2240cb4c4fc7 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:52.845798 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d3389-ba44-40e8-91ab-e164c144ba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:52.847094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d3389-ba44-40e8-91ab-e164c144ba91 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:52.847553 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d3389-ba44-40e8-91ab-e164c144ba91 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:52.848000 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d3389-ba44-40e8-91ab-e164c144ba91 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:52.849580 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d3389-ba44-40e8-91ab-e164c144ba91 None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:52.851296 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d3389-ba44-40e8-91ab-e164c144ba91 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:52.857896 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 191/391] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:52 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:52.859263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d3389-ba44-40e8-91ab-e164c144ba91 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:52.869199 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707f87d-847d-4afe-8487-3773f0c01548 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:52.925293 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cc295-01b1-4abe-8838-75f7c99301d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:52.926055 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cc295-01b1-4abe-8838-75f7c99301d4 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:52.926335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cc295-01b1-4abe-8838-75f7c99301d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:52.926613 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cc295-01b1-4abe-8838-75f7c99301d4 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:52.927876 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cc295-01b1-4abe-8838-75f7c99301d4 None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:52.929491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cc295-01b1-4abe-8838-75f7c99301d4 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:52.931393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 201/392] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:52 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:52.936672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cc295-01b1-4abe-8838-75f7c99301d4 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:52.964821 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d3389-ba44-40e8-91ab-e164c144ba91 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:53.014431 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38124b-b524-4971-9527-ef182bcccbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:53.015684 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38124b-b524-4971-9527-ef182bcccbed None admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:53.016145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38124b-b524-4971-9527-ef182bcccbed None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:53.016622 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38124b-b524-4971-9527-ef182bcccbed None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834/groups/0281632eb3be42d18939444439d4b604/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:53.022616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38124b-b524-4971-9527-ef182bcccbed None admin] RBAC: Authorizing `identity:create_grant(project_id=8cac096f50b74f85bd46506ce124b834, group_id=0281632eb3be42d18939444439d4b604, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:53.024313 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38124b-b524-4971-9527-ef182bcccbed None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:53.042810 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 192/393] 10.222.0.76 () {58 vars in 1442 bytes} [Thu May 12 17:28:52 2022] PUT /identity/v3/projects/8cac096f50b74f85bd46506ce124b834/groups/0281632eb3be42d18939444439d4b604/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:28:53.059021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cc295-01b1-4abe-8838-75f7c99301d4 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:53.100399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249cbc8-8609-444e-9518-3df005441f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:53.101305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249cbc8-8609-444e-9518-3df005441f4c None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:53.101588 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249cbc8-8609-444e-9518-3df005441f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:53.101865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249cbc8-8609-444e-9518-3df005441f4c None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834/groups/0281632eb3be42d18939444439d4b604/roles/b63d5637c42b47588880ae919eb7f448` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:53.104446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249cbc8-8609-444e-9518-3df005441f4c None admin] RBAC: Authorizing `identity:create_grant(project_id=8cac096f50b74f85bd46506ce124b834, group_id=0281632eb3be42d18939444439d4b604, role_id=b63d5637c42b47588880ae919eb7f448)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:53.105945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249cbc8-8609-444e-9518-3df005441f4c None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:53.122527 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 202/394] 10.222.0.76 () {58 vars in 1442 bytes} [Thu May 12 17:28:52 2022] PUT /identity/v3/projects/8cac096f50b74f85bd46506ce124b834/groups/0281632eb3be42d18939444439d4b604/roles/b63d5637c42b47588880ae919eb7f448 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:28:53.541847 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b10b0b-eee4-48ad-93d7-ecba738c4d02 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:53.542343 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b10b0b-eee4-48ad-93d7-ecba738c4d02 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:53.542343 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b10b0b-eee4-48ad-93d7-ecba738c4d02 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:53.544076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 193/395] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:53.549112 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a052abf-f543-4f97-8bd9-44c397ef216e None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:53.549612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a052abf-f543-4f97-8bd9-44c397ef216e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:53.549857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a052abf-f543-4f97-8bd9-44c397ef216e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:53.572970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-8a052abf-f543-4f97-8bd9-44c397ef216e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:53.574185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8a052abf-f543-4f97-8bd9-44c397ef216e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:53.661989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 203/396] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:53.686212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b10b0b-eee4-48ad-93d7-ecba738c4d02 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:53.831065 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b10b0b-eee4-48ad-93d7-ecba738c4d02 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:53.883654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccd28b-3c41-49a1-ab1f-9dee379a40c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:53.884452 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccd28b-3c41-49a1-ab1f-9dee379a40c7 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:53.884725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccd28b-3c41-49a1-ab1f-9dee379a40c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:53.884993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccd28b-3c41-49a1-ab1f-9dee379a40c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:53.899607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddccd28b-3c41-49a1-ab1f-9dee379a40c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-ddccd28b-3c41-49a1-ab1f-9dee379a40c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:53.907424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:53.908331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:53.909151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:53.909151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:53.909151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:53.909151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:53.909151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:53.909151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:53.909151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:53.909151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:53.909151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:53.909151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:53.909151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:53.909151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:53.910417 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 194/397] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:53.918735 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a052abf-f543-4f97-8bd9-44c397ef216e None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:54.058012 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a052abf-f543-4f97-8bd9-44c397ef216e None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:54.097483 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4780db-aedf-4dba-a94c-f962a2ccf7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:54.098080 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4780db-aedf-4dba-a94c-f962a2ccf7ca None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:54.098355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4780db-aedf-4dba-a94c-f962a2ccf7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:54.098630 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4780db-aedf-4dba-a94c-f962a2ccf7ca None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:54.099406 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4780db-aedf-4dba-a94c-f962a2ccf7ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:54.099706 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4780db-aedf-4dba-a94c-f962a2ccf7ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:54.101071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4780db-aedf-4dba-a94c-f962a2ccf7ca None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:54.109970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 204/398] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:54.116389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccd28b-3c41-49a1-ab1f-9dee379a40c7 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:54.269683 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccd28b-3c41-49a1-ab1f-9dee379a40c7 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:54.310154 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508394a-5e33-4f75-ab01-2b32d0b489cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:54.311039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508394a-5e33-4f75-ab01-2b32d0b489cd None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:54.311318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508394a-5e33-4f75-ab01-2b32d0b489cd None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:54.311591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508394a-5e33-4f75-ab01-2b32d0b489cd None admin] PATH_INFO: `/v3/groups/0281632eb3be42d18939444439d4b604` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:54.312778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508394a-5e33-4f75-ab01-2b32d0b489cd None admin] RBAC: Authorizing `identity:get_group(group_id=0281632eb3be42d18939444439d4b604)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:54.314210 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508394a-5e33-4f75-ab01-2b32d0b489cd None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:54.316313 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 195/399] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:28:54 2022] GET /identity/v3/groups/0281632eb3be42d18939444439d4b604 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:54.321415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4780db-aedf-4dba-a94c-f962a2ccf7ca None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:54.459155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4780db-aedf-4dba-a94c-f962a2ccf7ca None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:54.498338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a861f4c-e8ab-41e9-b4a1-3fe39e2d6e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:54.499236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a861f4c-e8ab-41e9-b4a1-3fe39e2d6e35 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:54.499513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a861f4c-e8ab-41e9-b4a1-3fe39e2d6e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:54.499782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a861f4c-e8ab-41e9-b4a1-3fe39e2d6e35 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:54.501011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a861f4c-e8ab-41e9-b4a1-3fe39e2d6e35 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:54.503276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a861f4c-e8ab-41e9-b4a1-3fe39e2d6e35 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:54.505380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 205/400] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:54 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:54.511286 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508394a-5e33-4f75-ab01-2b32d0b489cd None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:54.619791 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508394a-5e33-4f75-ab01-2b32d0b489cd None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:54.662521 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dada7-0cfa-4d0c-bb8d-61e653eefa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:54.663570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dada7-0cfa-4d0c-bb8d-61e653eefa74 None admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:54.663924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dada7-0cfa-4d0c-bb8d-61e653eefa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:54.664195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dada7-0cfa-4d0c-bb8d-61e653eefa74 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e/groups/0281632eb3be42d18939444439d4b604/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:54.666653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dada7-0cfa-4d0c-bb8d-61e653eefa74 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e, group_id=0281632eb3be42d18939444439d4b604, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:54.668256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dada7-0cfa-4d0c-bb8d-61e653eefa74 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:54.684893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 196/401] 10.222.0.76 () {58 vars in 1442 bytes} [Thu May 12 17:28:54 2022] PUT /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e/groups/0281632eb3be42d18939444439d4b604/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:28:54.749793 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed572ce-c5a2-41a3-a187-264b82ce6d46 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:54.750404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed572ce-c5a2-41a3-a187-264b82ce6d46 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:54.750404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed572ce-c5a2-41a3-a187-264b82ce6d46 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:54.752620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 206/402] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:54.758366 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b015a-6872-4995-8d16-a509e9b44af3 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:54.758689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b015a-6872-4995-8d16-a509e9b44af3 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:54.758942 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b015a-6872-4995-8d16-a509e9b44af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:54.778348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-714b015a-6872-4995-8d16-a509e9b44af3 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:54.781966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-714b015a-6872-4995-8d16-a509e9b44af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:54.857231 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 197/403] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:54.882627 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed572ce-c5a2-41a3-a187-264b82ce6d46 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:54.972662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5769c17-b31f-49d8-937f-5422ee5e735f None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:54.972997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5769c17-b31f-49d8-937f-5422ee5e735f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:54.973218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5769c17-b31f-49d8-937f-5422ee5e735f None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:54.981588 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 198/404] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:28:54.981588 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a174a-3941-46f5-baf7-de17df922a0f None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:54.981588 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a174a-3941-46f5-baf7-de17df922a0f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:54.981588 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a174a-3941-46f5-baf7-de17df922a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:55.007377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed572ce-c5a2-41a3-a187-264b82ce6d46 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:55.007684 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ad1a174a-3941-46f5-baf7-de17df922a0f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:55.008815 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ad1a174a-3941-46f5-baf7-de17df922a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:55.045103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e755d-fac3-4bae-8979-dd2d668dbbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:55.045915 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e755d-fac3-4bae-8979-dd2d668dbbdb None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:55.046198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e755d-fac3-4bae-8979-dd2d668dbbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:55.046471 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e755d-fac3-4bae-8979-dd2d668dbbdb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:55.066867 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e755d-fac3-4bae-8979-dd2d668dbbdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-b28e755d-fac3-4bae-8979-dd2d668dbbdb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:55.077823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:55.079998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:55.081692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:55.081692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:55.081692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:55.081692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:55.081692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:55.081692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:55.081692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:55.081692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:55.081692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:55.081692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:55.081692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:55.081692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:55.081692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 207/405] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:28:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:55.086157 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e755d-fac3-4bae-8979-dd2d668dbbdb None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:55.100599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 199/406] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:55.139568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a174a-3941-46f5-baf7-de17df922a0f None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:55.260595 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a174a-3941-46f5-baf7-de17df922a0f None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:55.299789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311db0ef-71f1-41dc-8f62-446e2796da5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:55.301197 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311db0ef-71f1-41dc-8f62-446e2796da5a None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:55.301479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311db0ef-71f1-41dc-8f62-446e2796da5a None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:55.301753 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311db0ef-71f1-41dc-8f62-446e2796da5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:55.310335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e755d-fac3-4bae-8979-dd2d668dbbdb None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:55.313623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311db0ef-71f1-41dc-8f62-446e2796da5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-311db0ef-71f1-41dc-8f62-446e2796da5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:55.323118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:55.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:55.325028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:55.325028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:55.325028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:55.325028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:55.325028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:55.325028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:55.325028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:55.325028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:55.325028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:55.325028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:55.325028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:55.325028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:55.325028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 200/407] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:28:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:55.331750 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311db0ef-71f1-41dc-8f62-446e2796da5a None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:55.357403 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152b59a-08cf-4907-b525-bc0aed8987ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:55.358794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b59a-08cf-4907-b525-bc0aed8987ea None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:55.359774 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b59a-08cf-4907-b525-bc0aed8987ea None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:55.360278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b59a-08cf-4907-b525-bc0aed8987ea None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:55.362350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152b59a-08cf-4907-b525-bc0aed8987ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:55.363328 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152b59a-08cf-4907-b525-bc0aed8987ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:55.365197 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152b59a-08cf-4907-b525-bc0aed8987ea None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:55.381760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 208/408] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:28:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:55.392085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152b59a-08cf-4907-b525-bc0aed8987ea None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:55.535585 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311db0ef-71f1-41dc-8f62-446e2796da5a None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:55.579931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152b59a-08cf-4907-b525-bc0aed8987ea None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:55.597567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906a2c5-98f5-4467-bee3-4f0dd7c562d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:55.598370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906a2c5-98f5-4467-bee3-4f0dd7c562d8 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:55.598570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906a2c5-98f5-4467-bee3-4f0dd7c562d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:55.598841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906a2c5-98f5-4467-bee3-4f0dd7c562d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:55.599594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906a2c5-98f5-4467-bee3-4f0dd7c562d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:55.599895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906a2c5-98f5-4467-bee3-4f0dd7c562d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:55.601267 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906a2c5-98f5-4467-bee3-4f0dd7c562d8 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:55.610192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 201/409] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:55.615457 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906a2c5-98f5-4467-bee3-4f0dd7c562d8 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:55.629273 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6daaa2-1c2d-42e6-a4d9-68444e8be2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:55.630466 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6daaa2-1c2d-42e6-a4d9-68444e8be2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:55.630983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6daaa2-1c2d-42e6-a4d9-68444e8be2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:55.631454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6daaa2-1c2d-42e6-a4d9-68444e8be2f7 None admin] PATH_INFO: `/v3/groups/0281632eb3be42d18939444439d4b604` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:55.635358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6daaa2-1c2d-42e6-a4d9-68444e8be2f7 None admin] RBAC: Authorizing `identity:get_group(group_id=0281632eb3be42d18939444439d4b604)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:55.637025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6daaa2-1c2d-42e6-a4d9-68444e8be2f7 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:55.639261 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 209/410] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:28:55 2022] GET /identity/v3/groups/0281632eb3be42d18939444439d4b604 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:55.664228 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6daaa2-1c2d-42e6-a4d9-68444e8be2f7 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:55.728867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906a2c5-98f5-4467-bee3-4f0dd7c562d8 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:55.764450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874867ee-eb6c-4309-89af-b5b1e7c86a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:55.765321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874867ee-eb6c-4309-89af-b5b1e7c86a8a None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:55.765582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874867ee-eb6c-4309-89af-b5b1e7c86a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:55.765852 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874867ee-eb6c-4309-89af-b5b1e7c86a8a None admin] PATH_INFO: `/v3/groups/01b724fbb3ec401bbe4e885c15a3955d` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:55.767144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874867ee-eb6c-4309-89af-b5b1e7c86a8a None admin] RBAC: Authorizing `identity:get_group(group_id=01b724fbb3ec401bbe4e885c15a3955d)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:55.768992 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874867ee-eb6c-4309-89af-b5b1e7c86a8a None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:55.770971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 202/411] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:28:55 2022] GET /identity/v3/groups/01b724fbb3ec401bbe4e885c15a3955d => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:55.779684 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874867ee-eb6c-4309-89af-b5b1e7c86a8a None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:55.788332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6daaa2-1c2d-42e6-a4d9-68444e8be2f7 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:55.833834 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ba89d-9de5-4ca5-afa5-2217490bc069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:55.835106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ba89d-9de5-4ca5-afa5-2217490bc069 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:55.835614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ba89d-9de5-4ca5-afa5-2217490bc069 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:55.836091 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ba89d-9de5-4ca5-afa5-2217490bc069 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:55.840806 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ba89d-9de5-4ca5-afa5-2217490bc069 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:55.842264 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ba89d-9de5-4ca5-afa5-2217490bc069 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:55.848920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 210/412] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:55 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:55.860316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ba89d-9de5-4ca5-afa5-2217490bc069 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:55.960451 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874867ee-eb6c-4309-89af-b5b1e7c86a8a None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:55.997865 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c878c40-cd53-4b5d-9e96-f88e2c573dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:55.998761 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c878c40-cd53-4b5d-9e96-f88e2c573dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:55.999049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c878c40-cd53-4b5d-9e96-f88e2c573dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:55.999321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c878c40-cd53-4b5d-9e96-f88e2c573dd8 None admin] PATH_INFO: `/v3/projects/9ec5d27c457b4e7d87f61efe4927f51d` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:56.000519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c878c40-cd53-4b5d-9e96-f88e2c573dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=9ec5d27c457b4e7d87f61efe4927f51d)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:56.001965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c878c40-cd53-4b5d-9e96-f88e2c573dd8 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:56.005003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 203/413] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:55 2022] GET /identity/v3/projects/9ec5d27c457b4e7d87f61efe4927f51d => generated 344 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:56.006227 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa845cd-3b46-438a-b44b-136f5abff74f None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:56.006510 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa845cd-3b46-438a-b44b-136f5abff74f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:56.006812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa845cd-3b46-438a-b44b-136f5abff74f None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:56.012758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 204/414] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:56.012758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa845cd-3b46-438a-b44b-136f5abff74f None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:56.036286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ba89d-9de5-4ca5-afa5-2217490bc069 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:56.073344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761d355-1708-4140-b88c-8d3f7404d879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:56.074609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761d355-1708-4140-b88c-8d3f7404d879 None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:56.075173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761d355-1708-4140-b88c-8d3f7404d879 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:56.075688 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761d355-1708-4140-b88c-8d3f7404d879 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e/groups/0281632eb3be42d18939444439d4b604/roles/b63d5637c42b47588880ae919eb7f448` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:56.078144 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761d355-1708-4140-b88c-8d3f7404d879 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e, group_id=0281632eb3be42d18939444439d4b604, role_id=b63d5637c42b47588880ae919eb7f448)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:56.079834 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761d355-1708-4140-b88c-8d3f7404d879 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:56.100141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 211/415] 10.222.0.76 () {58 vars in 1442 bytes} [Thu May 12 17:28:55 2022] PUT /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e/groups/0281632eb3be42d18939444439d4b604/roles/b63d5637c42b47588880ae919eb7f448 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:28:56.102384 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de378878-6491-4c34-be1e-04286ab2ea5f None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:56.103383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de378878-6491-4c34-be1e-04286ab2ea5f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:56.103873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de378878-6491-4c34-be1e-04286ab2ea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:56.126980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-de378878-6491-4c34-be1e-04286ab2ea5f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:56.129554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-de378878-6491-4c34-be1e-04286ab2ea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:56.135037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa845cd-3b46-438a-b44b-136f5abff74f None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:56.174628 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f42b5-0238-4c8c-b3ea-5b3f3672ad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:56.176233 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f42b5-0238-4c8c-b3ea-5b3f3672ad27 None admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:56.176746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f42b5-0238-4c8c-b3ea-5b3f3672ad27 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:56.177248 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f42b5-0238-4c8c-b3ea-5b3f3672ad27 None admin] PATH_INFO: `/v3/projects/9ec5d27c457b4e7d87f61efe4927f51d/groups/01b724fbb3ec401bbe4e885c15a3955d/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:56.179724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f42b5-0238-4c8c-b3ea-5b3f3672ad27 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ec5d27c457b4e7d87f61efe4927f51d, group_id=01b724fbb3ec401bbe4e885c15a3955d, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:56.181584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f42b5-0238-4c8c-b3ea-5b3f3672ad27 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:56.215549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 212/416] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:56.219611 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 205/417] 10.222.0.76 () {58 vars in 1442 bytes} [Thu May 12 17:28:56 2022] PUT /identity/v3/projects/9ec5d27c457b4e7d87f61efe4927f51d/groups/01b724fbb3ec401bbe4e885c15a3955d/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:28:56.250954 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de378878-6491-4c34-be1e-04286ab2ea5f None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:56.396365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de378878-6491-4c34-be1e-04286ab2ea5f None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:56.439431 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda0d41-4ed5-49c8-8b7b-019a4f50093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:56.441044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda0d41-4ed5-49c8-8b7b-019a4f50093e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:56.441393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda0d41-4ed5-49c8-8b7b-019a4f50093e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:56.441667 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda0d41-4ed5-49c8-8b7b-019a4f50093e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:56.454201 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda0d41-4ed5-49c8-8b7b-019a4f50093e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-dbda0d41-4ed5-49c8-8b7b-019a4f50093e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:56.463315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:56.464257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:56.465082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:56.465082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:56.465082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:56.465082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:56.465082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:56.465082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:56.465082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:56.465082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:56.465082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:56.465082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:56.465082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:56.465082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:56.467948 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 213/418] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:56.474845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f42b5-0238-4c8c-b3ea-5b3f3672ad27 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:56.487017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112c5af-81e8-4919-9867-956b1fff91a5 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:56.487537 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112c5af-81e8-4919-9867-956b1fff91a5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:56.487977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112c5af-81e8-4919-9867-956b1fff91a5 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:56.489790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 214/419] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:28:56.495962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58079c6-30d6-4cbe-984b-ad0a1d7b854c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:56.496254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58079c6-30d6-4cbe-984b-ad0a1d7b854c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:56.496535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58079c6-30d6-4cbe-984b-ad0a1d7b854c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:56.516388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-c58079c6-30d6-4cbe-984b-ad0a1d7b854c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:56.517652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c58079c6-30d6-4cbe-984b-ad0a1d7b854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:56.588872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 215/420] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:56.605982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f42b5-0238-4c8c-b3ea-5b3f3672ad27 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:56.633661 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58079c6-30d6-4cbe-984b-ad0a1d7b854c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:56.642765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7e5d1-1915-475a-b29d-8dbb1a7697a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:56.644052 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7e5d1-1915-475a-b29d-8dbb1a7697a1 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:56.644532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7e5d1-1915-475a-b29d-8dbb1a7697a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:56.644994 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7e5d1-1915-475a-b29d-8dbb1a7697a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:56.646346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7e5d1-1915-475a-b29d-8dbb1a7697a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:56.646948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7e5d1-1915-475a-b29d-8dbb1a7697a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:56.648514 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7e5d1-1915-475a-b29d-8dbb1a7697a1 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:56.662916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 206/421] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:56.664410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7e5d1-1915-475a-b29d-8dbb1a7697a1 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:56.770352 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7e5d1-1915-475a-b29d-8dbb1a7697a1 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:56.782335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58079c6-30d6-4cbe-984b-ad0a1d7b854c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:56.804155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb33c6-20ac-491c-8d36-32888c7be5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:56.805845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb33c6-20ac-491c-8d36-32888c7be5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:56.805845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb33c6-20ac-491c-8d36-32888c7be5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:56.805845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb33c6-20ac-491c-8d36-32888c7be5b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:56.831399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3de4d5-d09d-43f1-a6f8-324659a012a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:56.832215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3de4d5-d09d-43f1-a6f8-324659a012a0 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:56.832498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3de4d5-d09d-43f1-a6f8-324659a012a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:56.832770 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3de4d5-d09d-43f1-a6f8-324659a012a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:56.848513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3de4d5-d09d-43f1-a6f8-324659a012a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-4a3de4d5-d09d-43f1-a6f8-324659a012a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:56.860983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:56.863400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:56.865429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:56.865429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:56.865429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:56.865429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:56.865429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:56.865429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:56.865429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:56.865429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:56.865429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:56.865429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:56.865429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:56.865429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:56.871150 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 216/422] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:28:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:56.871884 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3de4d5-d09d-43f1-a6f8-324659a012a0 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:56.876364 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb33c6-20ac-491c-8d36-32888c7be5b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:56.878887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb33c6-20ac-491c-8d36-32888c7be5b9 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:57.043157 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3de4d5-d09d-43f1-a6f8-324659a012a0 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:57.071419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 207/423] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:57.079971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb33c6-20ac-491c-8d36-32888c7be5b9 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:57.080887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec293354-f8c7-4470-b91d-011648a024f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:57.085919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec293354-f8c7-4470-b91d-011648a024f0 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:57.086357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec293354-f8c7-4470-b91d-011648a024f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:57.086821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec293354-f8c7-4470-b91d-011648a024f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:57.087715 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec293354-f8c7-4470-b91d-011648a024f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:57.088164 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec293354-f8c7-4470-b91d-011648a024f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:57.089713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec293354-f8c7-4470-b91d-011648a024f0 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:57.104419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 217/424] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:28:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:57.112067 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec293354-f8c7-4470-b91d-011648a024f0 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:57.267365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb33c6-20ac-491c-8d36-32888c7be5b9 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:57.305719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3881a94-7879-49c5-bdc2-f48accb9034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:57.306500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3881a94-7879-49c5-bdc2-f48accb9034c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:57.306800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3881a94-7879-49c5-bdc2-f48accb9034c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:57.307068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3881a94-7879-49c5-bdc2-f48accb9034c None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:57.308830 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3881a94-7879-49c5-bdc2-f48accb9034c None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:57.310280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3881a94-7879-49c5-bdc2-f48accb9034c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:57.311998 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 208/425] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:57 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:57.320599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3881a94-7879-49c5-bdc2-f48accb9034c None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:57.327694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec293354-f8c7-4470-b91d-011648a024f0 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:57.415440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be27345-da0a-48c7-8d52-a1d6ca9cf802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:57.416562 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27345-da0a-48c7-8d52-a1d6ca9cf802 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:57.417057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27345-da0a-48c7-8d52-a1d6ca9cf802 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:57.417546 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27345-da0a-48c7-8d52-a1d6ca9cf802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:57.459877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3881a94-7879-49c5-bdc2-f48accb9034c None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:57.504348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01301c57-d527-441c-af49-37df483ba27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:57.505178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01301c57-d527-441c-af49-37df483ba27c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:57.505461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01301c57-d527-441c-af49-37df483ba27c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:57.505784 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01301c57-d527-441c-af49-37df483ba27c None admin] PATH_INFO: `/v3/groups/0281632eb3be42d18939444439d4b604` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:57.506952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01301c57-d527-441c-af49-37df483ba27c None admin] RBAC: Authorizing `identity:get_group(group_id=0281632eb3be42d18939444439d4b604)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:57.508659 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01301c57-d527-441c-af49-37df483ba27c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:57.516476 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 209/426] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:28:57 2022] GET /identity/v3/groups/0281632eb3be42d18939444439d4b604 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:57.519060 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be27345-da0a-48c7-8d52-a1d6ca9cf802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:57.520725 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be27345-da0a-48c7-8d52-a1d6ca9cf802 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:57.522819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01301c57-d527-441c-af49-37df483ba27c None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:57.624901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 218/427] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:57.632451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b5be-9911-4c56-ba13-523120fed978 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:57.633279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b5be-9911-4c56-ba13-523120fed978 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:57.633736 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b5be-9911-4c56-ba13-523120fed978 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:57.635535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 219/428] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:28:57.636397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1b5be-9911-4c56-ba13-523120fed978 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:57.694702 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01301c57-d527-441c-af49-37df483ba27c None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:57.729971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144400d-d17e-4c4f-adf6-fc4946a72fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:57.731192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144400d-d17e-4c4f-adf6-fc4946a72fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:57.731673 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144400d-d17e-4c4f-adf6-fc4946a72fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:57.732170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144400d-d17e-4c4f-adf6-fc4946a72fe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:57.733191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144400d-d17e-4c4f-adf6-fc4946a72fe6 None admin] RBAC: Adding query filter params (group.id=0281632eb3be42d18939444439d4b604, role.id=aac74c237ff74c5199b863b81ced5058, scope.project.id=8cac096f50b74f85bd46506ce124b834) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:57.733699 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144400d-d17e-4c4f-adf6-fc4946a72fe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:57.735520 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144400d-d17e-4c4f-adf6-fc4946a72fe6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:57.745643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 210/429] 10.222.0.76 () {56 vars in 1376 bytes} [Thu May 12 17:28:57 2022] GET /identity/v3/role_assignments?group.id=0281632eb3be42d18939444439d4b604&scope.project.id=8cac096f50b74f85bd46506ce124b834&role.id=aac74c237ff74c5199b863b81ced5058 => generated 611 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:57.747432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa00c9-6b48-44d9-9f0b-262921ebf0fc None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:57.747725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa00c9-6b48-44d9-9f0b-262921ebf0fc None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:57.748005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa00c9-6b48-44d9-9f0b-262921ebf0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:57.758903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1b5be-9911-4c56-ba13-523120fed978 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:57.770765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-53fa00c9-6b48-44d9-9f0b-262921ebf0fc None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:57.772404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-53fa00c9-6b48-44d9-9f0b-262921ebf0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:57.800458 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24750d03-1af3-49e7-b7bd-b66813a2bfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:57.801719 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750d03-1af3-49e7-b7bd-b66813a2bfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:57.802233 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750d03-1af3-49e7-b7bd-b66813a2bfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:57.802742 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750d03-1af3-49e7-b7bd-b66813a2bfa0 None admin] PATH_INFO: `/v3/projects/8cac096f50b74f85bd46506ce124b834` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:57.804407 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24750d03-1af3-49e7-b7bd-b66813a2bfa0 None admin] RBAC: Authorizing `identity:get_project(project_id=8cac096f50b74f85bd46506ce124b834)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:57.806348 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24750d03-1af3-49e7-b7bd-b66813a2bfa0 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:57.810472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 220/430] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:57 2022] GET /identity/v3/projects/8cac096f50b74f85bd46506ce124b834 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:57.820746 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24750d03-1af3-49e7-b7bd-b66813a2bfa0 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:57.913598 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 211/431] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:57.949332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa00c9-6b48-44d9-9f0b-262921ebf0fc None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:57.971378 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24750d03-1af3-49e7-b7bd-b66813a2bfa0 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:58.010609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b891f-6b93-46e3-bea9-bbbb3787f281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:58.011492 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b891f-6b93-46e3-bea9-bbbb3787f281 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:58.011770 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b891f-6b93-46e3-bea9-bbbb3787f281 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:58.012045 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b891f-6b93-46e3-bea9-bbbb3787f281 None admin] PATH_INFO: `/v3/groups/0281632eb3be42d18939444439d4b604` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:58.013276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b891f-6b93-46e3-bea9-bbbb3787f281 None admin] RBAC: Authorizing `identity:get_group(group_id=0281632eb3be42d18939444439d4b604)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:58.014872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b891f-6b93-46e3-bea9-bbbb3787f281 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:58.016813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 221/432] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:28:57 2022] GET /identity/v3/groups/0281632eb3be42d18939444439d4b604 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:58.023082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b891f-6b93-46e3-bea9-bbbb3787f281 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:58.104571 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa00c9-6b48-44d9-9f0b-262921ebf0fc None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:58.143450 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b891f-6b93-46e3-bea9-bbbb3787f281 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:58.146558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424b866-69d5-4398-b30c-a42a4bf77966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:58.147380 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424b866-69d5-4398-b30c-a42a4bf77966 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:58.147658 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424b866-69d5-4398-b30c-a42a4bf77966 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:58.147935 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424b866-69d5-4398-b30c-a42a4bf77966 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:58.159526 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424b866-69d5-4398-b30c-a42a4bf77966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-6424b866-69d5-4398-b30c-a42a4bf77966 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:58.167384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:58.168256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:58.169049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:58.169049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:58.169049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:58.169049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:58.169049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:58.169049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:58.169049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:58.169049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:58.169049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:58.169049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:58.169049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 17:28:58.169049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:58.169049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 212/433] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:28:58.178286 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424b866-69d5-4398-b30c-a42a4bf77966 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:58.185809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d846f-7164-4a8b-a292-f47c71b9d2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:58.186467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d846f-7164-4a8b-a292-f47c71b9d2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:58.186778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d846f-7164-4a8b-a292-f47c71b9d2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:58.187056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d846f-7164-4a8b-a292-f47c71b9d2f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:58.187891 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d846f-7164-4a8b-a292-f47c71b9d2f4 None admin] RBAC: Adding query filter params (group.id=0281632eb3be42d18939444439d4b604, role.id=b63d5637c42b47588880ae919eb7f448, scope.project.id=8cac096f50b74f85bd46506ce124b834) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:58.188200 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d846f-7164-4a8b-a292-f47c71b9d2f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:58.190658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d846f-7164-4a8b-a292-f47c71b9d2f4 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:58.199278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 222/434] 10.222.0.76 () {56 vars in 1376 bytes} [Thu May 12 17:28:58 2022] GET /identity/v3/role_assignments?group.id=0281632eb3be42d18939444439d4b604&scope.project.id=8cac096f50b74f85bd46506ce124b834&role.id=b63d5637c42b47588880ae919eb7f448 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:58.305223 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424b866-69d5-4398-b30c-a42a4bf77966 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:58.345803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9f873-001c-4f92-8755-bbd8ab97d172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:58.348056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9f873-001c-4f92-8755-bbd8ab97d172 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:58.348535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9f873-001c-4f92-8755-bbd8ab97d172 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:58.348999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9f873-001c-4f92-8755-bbd8ab97d172 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:58.349955 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9f873-001c-4f92-8755-bbd8ab97d172 None admin] RBAC: Adding query filter params (name=member) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:58.350480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9f873-001c-4f92-8755-bbd8ab97d172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:58.352106 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9f873-001c-4f92-8755-bbd8ab97d172 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:58.365278 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 213/435] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:28:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:58.368838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d846f-7164-4a8b-a292-f47c71b9d2f4 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:58.484672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d846f-7164-4a8b-a292-f47c71b9d2f4 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:58.521322 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903306c2-ecd3-4f77-8e39-da8c89277d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:58.522318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903306c2-ecd3-4f77-8e39-da8c89277d58 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:58.522856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903306c2-ecd3-4f77-8e39-da8c89277d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:58.523330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903306c2-ecd3-4f77-8e39-da8c89277d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:58.592864 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903306c2-ecd3-4f77-8e39-da8c89277d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:58.594687 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903306c2-ecd3-4f77-8e39-da8c89277d58 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:58.703416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 223/436] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:28:58.709262 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9f873-001c-4f92-8755-bbd8ab97d172 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:58.808335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff129cd1-6256-4600-ab46-7ddd0644cdd4 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:58.808542 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff129cd1-6256-4600-ab46-7ddd0644cdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:58.808817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff129cd1-6256-4600-ab46-7ddd0644cdd4 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:58.810458 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 224/437] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:28:58.815707 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9f873-001c-4f92-8755-bbd8ab97d172 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:58.818218 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9c550-26e7-4a03-af69-a2ca8b3dd939 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:58.818506 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9c550-26e7-4a03-af69-a2ca8b3dd939 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:58.818832 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9c550-26e7-4a03-af69-a2ca8b3dd939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:58.838117 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-7ab9c550-26e7-4a03-af69-a2ca8b3dd939 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:58.839389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-7ab9c550-26e7-4a03-af69-a2ca8b3dd939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:58.858162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629adf4-50de-48b3-afed-1c3d2bd5764e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:58.859078 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629adf4-50de-48b3-afed-1c3d2bd5764e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:58.859360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629adf4-50de-48b3-afed-1c3d2bd5764e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:58.859634 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629adf4-50de-48b3-afed-1c3d2bd5764e None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:58.860862 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629adf4-50de-48b3-afed-1c3d2bd5764e None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:58.862965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629adf4-50de-48b3-afed-1c3d2bd5764e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:58.864721 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 214/438] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:58 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:58.870506 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629adf4-50de-48b3-afed-1c3d2bd5764e None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:58.908527 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 225/439] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:28:58.932467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9c550-26e7-4a03-af69-a2ca8b3dd939 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:58.970097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629adf4-50de-48b3-afed-1c3d2bd5764e None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:59.003485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329546f-8a9a-47ed-923d-98dacac041dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:59.004343 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329546f-8a9a-47ed-923d-98dacac041dd None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:59.004623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329546f-8a9a-47ed-923d-98dacac041dd None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:59.004897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329546f-8a9a-47ed-923d-98dacac041dd None admin] PATH_INFO: `/v3/groups/0281632eb3be42d18939444439d4b604` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:59.006089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329546f-8a9a-47ed-923d-98dacac041dd None admin] RBAC: Authorizing `identity:get_group(group_id=0281632eb3be42d18939444439d4b604)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:59.007583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329546f-8a9a-47ed-923d-98dacac041dd None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:59.009629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 215/440] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:28:58 2022] GET /identity/v3/groups/0281632eb3be42d18939444439d4b604 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:59.015223 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329546f-8a9a-47ed-923d-98dacac041dd None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:59.031713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9c550-26e7-4a03-af69-a2ca8b3dd939 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:59.065623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1649a7-86b6-4bfa-99b6-024ec2599430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:59.065871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1649a7-86b6-4bfa-99b6-024ec2599430 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:59.066141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1649a7-86b6-4bfa-99b6-024ec2599430 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:59.066407 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1649a7-86b6-4bfa-99b6-024ec2599430 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:59.075913 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1649a7-86b6-4bfa-99b6-024ec2599430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-3e1649a7-86b6-4bfa-99b6-024ec2599430 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:59.083809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:59.084863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:59.085681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:59.085681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:59.085681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:59.085681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:59.085681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:59.085681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:59.085681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:59.085681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:59.085681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:59.085681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:59.085681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:28:59.085681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:28:59.085681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 226/441] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:28:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:28:59.086570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3264e-2446-4f9e-bdf7-f904ca57f620 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:59.086811 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3264e-2446-4f9e-bdf7-f904ca57f620 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:59.087078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3264e-2446-4f9e-bdf7-f904ca57f620 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:59.088328 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 227/442] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:28:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:28:59.090521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3264e-2446-4f9e-bdf7-f904ca57f620 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:59.111207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329546f-8a9a-47ed-923d-98dacac041dd None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:59.144252 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69547c06-9085-4fe3-aacb-9d2e75c47477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:59.144894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69547c06-9085-4fe3-aacb-9d2e75c47477 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:59.145174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69547c06-9085-4fe3-aacb-9d2e75c47477 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:59.145440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69547c06-9085-4fe3-aacb-9d2e75c47477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:59.146251 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69547c06-9085-4fe3-aacb-9d2e75c47477 None admin] RBAC: Adding query filter params (group.id=0281632eb3be42d18939444439d4b604, role.id=aac74c237ff74c5199b863b81ced5058, scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:59.146551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69547c06-9085-4fe3-aacb-9d2e75c47477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:59.148042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69547c06-9085-4fe3-aacb-9d2e75c47477 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:59.153591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 216/443] 10.222.0.76 () {56 vars in 1376 bytes} [Thu May 12 17:28:59 2022] GET /identity/v3/role_assignments?group.id=0281632eb3be42d18939444439d4b604&scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e&role.id=aac74c237ff74c5199b863b81ced5058 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:59.154736 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e088748-9825-4948-8b5d-d11457ac8e98 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:59.155018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e088748-9825-4948-8b5d-d11457ac8e98 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:59.155296 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e088748-9825-4948-8b5d-d11457ac8e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:59.174520 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-7e088748-9825-4948-8b5d-d11457ac8e98 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:28:59.176558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-7e088748-9825-4948-8b5d-d11457ac8e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:28:59.192651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3264e-2446-4f9e-bdf7-f904ca57f620 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:59.228955 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8beb8-513c-42b2-96dc-7777160c6241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:59.229619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8beb8-513c-42b2-96dc-7777160c6241 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:59.229896 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8beb8-513c-42b2-96dc-7777160c6241 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:59.230168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8beb8-513c-42b2-96dc-7777160c6241 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:59.230955 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8beb8-513c-42b2-96dc-7777160c6241 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:59.231287 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8beb8-513c-42b2-96dc-7777160c6241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:59.232693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8beb8-513c-42b2-96dc-7777160c6241 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:59.243433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 228/444] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:28:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:59.248969 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8beb8-513c-42b2-96dc-7777160c6241 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:59.251809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 217/445] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:28:59.276275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e088748-9825-4948-8b5d-d11457ac8e98 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:59.372891 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8beb8-513c-42b2-96dc-7777160c6241 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:59.381084 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e088748-9825-4948-8b5d-d11457ac8e98 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:59.416097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dd7ef-fab8-40c8-b82d-3d0523708f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:59.416970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dd7ef-fab8-40c8-b82d-3d0523708f54 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:59.417389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dd7ef-fab8-40c8-b82d-3d0523708f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:59.417808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dd7ef-fab8-40c8-b82d-3d0523708f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:59.419006 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f550a2e-ce1a-43ef-ba9a-37545fa1dc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:59.419847 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f550a2e-ce1a-43ef-ba9a-37545fa1dc8c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:59.420139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f550a2e-ce1a-43ef-ba9a-37545fa1dc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:59.420414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f550a2e-ce1a-43ef-ba9a-37545fa1dc8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:59.432276 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f550a2e-ce1a-43ef-ba9a-37545fa1dc8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-0f550a2e-ce1a-43ef-ba9a-37545fa1dc8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:28:59.442336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:28:59.443492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:28:59.444472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:28:59.444472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:28:59.444472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:28:59.444472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:28:59.444472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:28:59.444472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:28:59.444472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:28:59.444472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:28:59.444472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:28:59.444472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:28:59.444472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:28:59.444472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:28:59.444472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 218/446] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:28:59.449443 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f550a2e-ce1a-43ef-ba9a-37545fa1dc8c None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:59.493449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03dd7ef-fab8-40c8-b82d-3d0523708f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:59.494943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03dd7ef-fab8-40c8-b82d-3d0523708f54 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:59.559398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f550a2e-ce1a-43ef-ba9a-37545fa1dc8c None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:59.591486 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de389abe-9a96-459c-8220-67b39a45ffbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:59.592141 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389abe-9a96-459c-8220-67b39a45ffbb None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:59.592416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389abe-9a96-459c-8220-67b39a45ffbb None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:59.592684 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389abe-9a96-459c-8220-67b39a45ffbb None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:59.593417 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de389abe-9a96-459c-8220-67b39a45ffbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:28:59.593717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de389abe-9a96-459c-8220-67b39a45ffbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:59.595115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de389abe-9a96-459c-8220-67b39a45ffbb None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:59.602809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 229/447] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 17:28:59.603568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 219/448] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:28:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:59.608330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dd7ef-fab8-40c8-b82d-3d0523708f54 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:59.608911 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de389abe-9a96-459c-8220-67b39a45ffbb None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:59.701364 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dd7ef-fab8-40c8-b82d-3d0523708f54 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:59.704026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de389abe-9a96-459c-8220-67b39a45ffbb None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:59.732432 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ca958-f03d-41e0-8a04-d9c98686e437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:59.733428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ca958-f03d-41e0-8a04-d9c98686e437 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:59.733702 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ca958-f03d-41e0-8a04-d9c98686e437 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:59.733981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ca958-f03d-41e0-8a04-d9c98686e437 None admin] PATH_INFO: `/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:59.735049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4792630-f747-48ea-8db9-fa284411f0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:59.735190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ca958-f03d-41e0-8a04-d9c98686e437 None admin] RBAC: Authorizing `identity:get_project(project_id=1ae1652ccf5142c58f4bef2e4bac5f4e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:59.735687 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4792630-f747-48ea-8db9-fa284411f0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:59.735964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4792630-f747-48ea-8db9-fa284411f0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:59.736235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4792630-f747-48ea-8db9-fa284411f0f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:59.737177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ca958-f03d-41e0-8a04-d9c98686e437 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:59.739002 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 230/449] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:59 2022] GET /identity/v3/projects/1ae1652ccf5142c58f4bef2e4bac5f4e => generated 302 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:28:59.744288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ca958-f03d-41e0-8a04-d9c98686e437 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:59.800626 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4792630-f747-48ea-8db9-fa284411f0f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:59.802537 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4792630-f747-48ea-8db9-fa284411f0f1 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:59.837876 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ca958-f03d-41e0-8a04-d9c98686e437 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:28:59.871057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56b7e1-d287-411f-ab8c-80c563299030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:28:59.871887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56b7e1-d287-411f-ab8c-80c563299030 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:28:59.872157 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56b7e1-d287-411f-ab8c-80c563299030 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:28:59.872421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56b7e1-d287-411f-ab8c-80c563299030 None admin] PATH_INFO: `/v3/groups/0281632eb3be42d18939444439d4b604` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:28:59.873580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56b7e1-d287-411f-ab8c-80c563299030 None admin] RBAC: Authorizing `identity:get_group(group_id=0281632eb3be42d18939444439d4b604)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:28:59.875040 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56b7e1-d287-411f-ab8c-80c563299030 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:28:59.876640 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 231/450] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:28:59 2022] GET /identity/v3/groups/0281632eb3be42d18939444439d4b604 => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:28:59.883724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56b7e1-d287-411f-ab8c-80c563299030 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:59.902930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 220/451] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:28:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 17:28:59.909429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4792630-f747-48ea-8db9-fa284411f0f1 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:28:59.978031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56b7e1-d287-411f-ab8c-80c563299030 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:00.002027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4792630-f747-48ea-8db9-fa284411f0f1 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:00.010146 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c0db2-9532-4324-a4be-14beae756e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:00.010811 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c0db2-9532-4324-a4be-14beae756e56 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:00.011085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c0db2-9532-4324-a4be-14beae756e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:00.011351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c0db2-9532-4324-a4be-14beae756e56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:00.012163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c0db2-9532-4324-a4be-14beae756e56 None admin] RBAC: Adding query filter params (group.id=0281632eb3be42d18939444439d4b604, role.id=b63d5637c42b47588880ae919eb7f448, scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:00.012463 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c0db2-9532-4324-a4be-14beae756e56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:00.013883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c0db2-9532-4324-a4be-14beae756e56 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:00.019761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 232/452] 10.222.0.76 () {56 vars in 1376 bytes} [Thu May 12 17:28:59 2022] GET /identity/v3/role_assignments?group.id=0281632eb3be42d18939444439d4b604&scope.project.id=1ae1652ccf5142c58f4bef2e4bac5f4e&role.id=b63d5637c42b47588880ae919eb7f448 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:00.036607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608d015-7762-4a71-a923-3d7245b07a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:00.037484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608d015-7762-4a71-a923-3d7245b07a0b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:00.037758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608d015-7762-4a71-a923-3d7245b07a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:00.038026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608d015-7762-4a71-a923-3d7245b07a0b None admin] PATH_INFO: `/v3/projects/9ec5d27c457b4e7d87f61efe4927f51d` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:00.039512 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608d015-7762-4a71-a923-3d7245b07a0b None admin] RBAC: Authorizing `identity:get_project(project_id=9ec5d27c457b4e7d87f61efe4927f51d)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:00.040992 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608d015-7762-4a71-a923-3d7245b07a0b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:00.042783 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 221/453] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:28:59 2022] GET /identity/v3/projects/9ec5d27c457b4e7d87f61efe4927f51d => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:00.048483 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c0db2-9532-4324-a4be-14beae756e56 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:00.149915 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c0db2-9532-4324-a4be-14beae756e56 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:00.184082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfe7b0-5c39-4449-8790-31be8ca6115a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:00.184934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfe7b0-5c39-4449-8790-31be8ca6115a None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:00.185208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfe7b0-5c39-4449-8790-31be8ca6115a None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:00.185478 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfe7b0-5c39-4449-8790-31be8ca6115a None admin] PATH_INFO: `/v3/groups/01b724fbb3ec401bbe4e885c15a3955d` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:00.186655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfe7b0-5c39-4449-8790-31be8ca6115a None admin] RBAC: Authorizing `identity:get_group(group_id=01b724fbb3ec401bbe4e885c15a3955d)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:00.188118 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfe7b0-5c39-4449-8790-31be8ca6115a None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:00.190278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 233/454] 10.222.0.76 () {56 vars in 1180 bytes} [Thu May 12 17:29:00 2022] GET /identity/v3/groups/01b724fbb3ec401bbe4e885c15a3955d => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:00.196782 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608d015-7762-4a71-a923-3d7245b07a0b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:00.302351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608d015-7762-4a71-a923-3d7245b07a0b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:00.337317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff916b-b050-443a-b69a-4b22b808b0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:00.337975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff916b-b050-443a-b69a-4b22b808b0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:00.338250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff916b-b050-443a-b69a-4b22b808b0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:00.338517 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff916b-b050-443a-b69a-4b22b808b0f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:00.339401 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff916b-b050-443a-b69a-4b22b808b0f5 None admin] RBAC: Adding query filter params (group.id=01b724fbb3ec401bbe4e885c15a3955d, role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=9ec5d27c457b4e7d87f61efe4927f51d) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:00.339718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff916b-b050-443a-b69a-4b22b808b0f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:00.341131 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff916b-b050-443a-b69a-4b22b808b0f5 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:00.347060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 222/455] 10.222.0.76 () {56 vars in 1376 bytes} [Thu May 12 17:29:00 2022] GET /identity/v3/role_assignments?group.id=01b724fbb3ec401bbe4e885c15a3955d&scope.project.id=9ec5d27c457b4e7d87f61efe4927f51d&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:02.934664 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e042553-fe2c-47c0-99ab-0a73acd0fd7f None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:02.935241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e042553-fe2c-47c0-99ab-0a73acd0fd7f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:02.935241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e042553-fe2c-47c0-99ab-0a73acd0fd7f None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:02.936836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 234/456] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:02.942454 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2ae15-50dc-4bf4-a6f8-e840f71b9c7e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:02.942894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2ae15-50dc-4bf4-a6f8-e840f71b9c7e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:02.943086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2ae15-50dc-4bf4-a6f8-e840f71b9c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:02.967760 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-b9c2ae15-50dc-4bf4-a6f8-e840f71b9c7e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:02.969010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b9c2ae15-50dc-4bf4-a6f8-e840f71b9c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:03.061432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 223/457] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:29:03.102989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e042553-fe2c-47c0-99ab-0a73acd0fd7f None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:03.198127 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a11cf-d11c-42a7-8788-151a1fc44af5 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:03.198419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a11cf-d11c-42a7-8788-151a1fc44af5 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:03.198585 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a11cf-d11c-42a7-8788-151a1fc44af5 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:03.200213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 224/458] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:03.223846 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df252e-bc05-4404-bf89-147343dc0166 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:03.224175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df252e-bc05-4404-bf89-147343dc0166 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:03.224388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df252e-bc05-4404-bf89-147343dc0166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:03.231822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e042553-fe2c-47c0-99ab-0a73acd0fd7f None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:03.258394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-60df252e-bc05-4404-bf89-147343dc0166 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:03.259622 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-60df252e-bc05-4404-bf89-147343dc0166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:03.300893 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca1ee8-ce9c-45ef-bdfc-36420c4dd2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:03.301686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca1ee8-ce9c-45ef-bdfc-36420c4dd2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:03.301965 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca1ee8-ce9c-45ef-bdfc-36420c4dd2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:03.302241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca1ee8-ce9c-45ef-bdfc-36420c4dd2a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:03.314296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca1ee8-ce9c-45ef-bdfc-36420c4dd2a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:03.315902 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca1ee8-ce9c-45ef-bdfc-36420c4dd2a2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-96ca1ee8-ce9c-45ef-bdfc-36420c4dd2a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:03.335070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:03.335974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:03.336849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:03.336849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:03.336849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:03.336849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:03.336849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 235/459] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:03.342125 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca58e4-8a12-4a19-8faa-e1a684c9a08d None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:03.342125 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca58e4-8a12-4a19-8faa-e1a684c9a08d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:03.342125 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca58e4-8a12-4a19-8faa-e1a684c9a08d None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:03.342125 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 236/460] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:03.343456 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca58e4-8a12-4a19-8faa-e1a684c9a08d None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:03.373256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 225/461] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:03.380013 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed0a27-7a83-4752-ac6e-d16e6f295154 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:03.380302 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed0a27-7a83-4752-ac6e-d16e6f295154 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:03.380580 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed0a27-7a83-4752-ac6e-d16e6f295154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:03.409320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-99ed0a27-7a83-4752-ac6e-d16e6f295154 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:03.410507 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-99ed0a27-7a83-4752-ac6e-d16e6f295154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:03.467360 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca58e4-8a12-4a19-8faa-e1a684c9a08d None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:03.490762 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 226/462] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:03.491947 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed0a27-7a83-4752-ac6e-d16e6f295154 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:03.522569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62667daf-f8b7-4f91-bb59-74175600c6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:03.523274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62667daf-f8b7-4f91-bb59-74175600c6cf None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:03.523550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62667daf-f8b7-4f91-bb59-74175600c6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:03.523827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62667daf-f8b7-4f91-bb59-74175600c6cf None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:03.524563 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62667daf-f8b7-4f91-bb59-74175600c6cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:03.524869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62667daf-f8b7-4f91-bb59-74175600c6cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:03.526305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62667daf-f8b7-4f91-bb59-74175600c6cf None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:03.546216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 237/463] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:03.547123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62667daf-f8b7-4f91-bb59-74175600c6cf None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:03.615341 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed0a27-7a83-4752-ac6e-d16e6f295154 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:03.651201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea8f9a-0027-4064-bb2c-5db2102e7972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:03.652392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea8f9a-0027-4064-bb2c-5db2102e7972 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:03.652502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62667daf-f8b7-4f91-bb59-74175600c6cf None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:03.653003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea8f9a-0027-4064-bb2c-5db2102e7972 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:03.653477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea8f9a-0027-4064-bb2c-5db2102e7972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:03.664446 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea8f9a-0027-4064-bb2c-5db2102e7972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:03.666318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea8f9a-0027-4064-bb2c-5db2102e7972 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-e9ea8f9a-0027-4064-bb2c-5db2102e7972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:03.685635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:03.686584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:03.687527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:03.687527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:03.687527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:03.687527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:03.690748 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 227/464] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:03.691754 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea8f9a-0027-4064-bb2c-5db2102e7972 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:03.695021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e9a65-ec15-4ea3-8293-a6366e42e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:03.695657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e9a65-ec15-4ea3-8293-a6366e42e615 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:03.695933 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e9a65-ec15-4ea3-8293-a6366e42e615 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:03.696204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e9a65-ec15-4ea3-8293-a6366e42e615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:03.708669 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e9a65-ec15-4ea3-8293-a6366e42e615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:03.710196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e9a65-ec15-4ea3-8293-a6366e42e615 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-285e9a65-ec15-4ea3-8293-a6366e42e615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:03.729336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:03.730204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:03.731165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:03.731165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:03.731165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:03.731165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:03.734980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 238/465] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:03.735894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e9a65-ec15-4ea3-8293-a6366e42e615 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:03.804454 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea8f9a-0027-4064-bb2c-5db2102e7972 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:03.840387 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607415-4e9e-4ffe-b073-9a13686856b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:03.841436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607415-4e9e-4ffe-b073-9a13686856b2 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:03.841787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e9a65-ec15-4ea3-8293-a6366e42e615 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:03.842142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607415-4e9e-4ffe-b073-9a13686856b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:03.842615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607415-4e9e-4ffe-b073-9a13686856b2 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:03.843540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47607415-4e9e-4ffe-b073-9a13686856b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:03.845221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47607415-4e9e-4ffe-b073-9a13686856b2 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:03.871369 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 228/466] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:29:03 2022] POST /identity/v3/users => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:29:03.873544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607415-4e9e-4ffe-b073-9a13686856b2 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:03.900198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052e614-e9ec-4366-933a-ca3c16666380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:03.900889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052e614-e9ec-4366-933a-ca3c16666380 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:03.901153 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052e614-e9ec-4366-933a-ca3c16666380 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:03.901426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052e614-e9ec-4366-933a-ca3c16666380 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:03.902155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052e614-e9ec-4366-933a-ca3c16666380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:03.902749 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052e614-e9ec-4366-933a-ca3c16666380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:03.903879 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052e614-e9ec-4366-933a-ca3c16666380 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:03.924891 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 239/467] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:03.930063 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052e614-e9ec-4366-933a-ca3c16666380 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:03.996784 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607415-4e9e-4ffe-b073-9a13686856b2 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:04.035809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3eabe8-e3e8-40df-9095-8d4b2014fa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:04.036886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eabe8-e3e8-40df-9095-8d4b2014fa37 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:04.037446 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eabe8-e3e8-40df-9095-8d4b2014fa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:04.037921 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eabe8-e3e8-40df-9095-8d4b2014fa37 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:04.038890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3eabe8-e3e8-40df-9095-8d4b2014fa37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:04.039411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3eabe8-e3e8-40df-9095-8d4b2014fa37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:04.041041 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3eabe8-e3e8-40df-9095-8d4b2014fa37 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:04.041862 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052e614-e9ec-4366-933a-ca3c16666380 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:04.056444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 229/468] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:04.058188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634bc46-4bf7-4ce2-be1c-5453f7af6554 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:04.058743 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634bc46-4bf7-4ce2-be1c-5453f7af6554 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:04.059231 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634bc46-4bf7-4ce2-be1c-5453f7af6554 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:04.060888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 230/469] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:04.062018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634bc46-4bf7-4ce2-be1c-5453f7af6554 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:04.084077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfde81-5bc9-4641-bded-0ea64479720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:04.084759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfde81-5bc9-4641-bded-0ea64479720e None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:04.085038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfde81-5bc9-4641-bded-0ea64479720e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:04.085312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfde81-5bc9-4641-bded-0ea64479720e None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:04.086038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfde81-5bc9-4641-bded-0ea64479720e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:04.087560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfde81-5bc9-4641-bded-0ea64479720e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:04.112296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 240/470] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:29:03 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:29:04.113617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab6391-9879-444f-abb6-c6d53857dad9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:04.113872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab6391-9879-444f-abb6-c6d53857dad9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:04.114148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab6391-9879-444f-abb6-c6d53857dad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:04.145968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-e2ab6391-9879-444f-abb6-c6d53857dad9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:04.147758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e2ab6391-9879-444f-abb6-c6d53857dad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:04.192793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634bc46-4bf7-4ce2-be1c-5453f7af6554 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:04.232103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b36cb-f79a-455b-b81c-d784c2fd833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:04.233254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b36cb-f79a-455b-b81c-d784c2fd833c None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:04.233738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b36cb-f79a-455b-b81c-d784c2fd833c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:04.234223 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b36cb-f79a-455b-b81c-d784c2fd833c None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:04.236316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b36cb-f79a-455b-b81c-d784c2fd833c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:04.238766 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b36cb-f79a-455b-b81c-d784c2fd833c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:04.240632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 241/471] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:04.269769 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 231/472] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:29:04 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:29:04.273035 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab6391-9879-444f-abb6-c6d53857dad9 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:04.390734 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab6391-9879-444f-abb6-c6d53857dad9 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:04.429357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299a957-bb2d-405d-9dfa-6eb08e03a040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:04.430169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299a957-bb2d-405d-9dfa-6eb08e03a040 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:04.430448 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299a957-bb2d-405d-9dfa-6eb08e03a040 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:04.430775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299a957-bb2d-405d-9dfa-6eb08e03a040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:04.442786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299a957-bb2d-405d-9dfa-6eb08e03a040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:04.444265 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299a957-bb2d-405d-9dfa-6eb08e03a040 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-c299a957-bb2d-405d-9dfa-6eb08e03a040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:04.463033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:04.463959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:04.464829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:04.464829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:04.464829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:04.464829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:04.464829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 242/473] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:04.472514 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b36cb-f79a-455b-b81c-d784c2fd833c None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:04.587066 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b36cb-f79a-455b-b81c-d784c2fd833c None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:04.619907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb581bc-8ad0-4f53-bd1f-a7ef7a69a623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:04.620630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb581bc-8ad0-4f53-bd1f-a7ef7a69a623 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:04.620911 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb581bc-8ad0-4f53-bd1f-a7ef7a69a623 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:04.621233 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb581bc-8ad0-4f53-bd1f-a7ef7a69a623 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:04.621962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb581bc-8ad0-4f53-bd1f-a7ef7a69a623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:04.622263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb581bc-8ad0-4f53-bd1f-a7ef7a69a623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:04.623670 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb581bc-8ad0-4f53-bd1f-a7ef7a69a623 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:04.636682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 232/474] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:04.642074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299a957-bb2d-405d-9dfa-6eb08e03a040 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:04.709930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b0248-06b1-4a19-b5d5-95ede96713e3 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:04.710269 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b0248-06b1-4a19-b5d5-95ede96713e3 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:04.710479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b0248-06b1-4a19-b5d5-95ede96713e3 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:04.712194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 233/475] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:04.717376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c681a-b951-4670-b931-4f997b11bc6a None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:04.717657 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c681a-b951-4670-b931-4f997b11bc6a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:04.717927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c681a-b951-4670-b931-4f997b11bc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:04.736137 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-867c681a-b951-4670-b931-4f997b11bc6a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:04.737564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-867c681a-b951-4670-b931-4f997b11bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:04.768533 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299a957-bb2d-405d-9dfa-6eb08e03a040 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:04.810210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c0203-abd8-4295-8ce1-04fa832774e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:04.812079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c0203-abd8-4295-8ce1-04fa832774e5 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:04.813096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c0203-abd8-4295-8ce1-04fa832774e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:04.814104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c0203-abd8-4295-8ce1-04fa832774e5 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:04.815504 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c0203-abd8-4295-8ce1-04fa832774e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:04.817711 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c0203-abd8-4295-8ce1-04fa832774e5 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:04.858496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 243/476] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:29:04 2022] POST /identity/v3/users => generated 249 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:29:04.877563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 234/477] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:04.917271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c0203-abd8-4295-8ce1-04fa832774e5 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:05.029443 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c0203-abd8-4295-8ce1-04fa832774e5 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:05.072163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6164ae-5e21-439d-a2f4-550a0b0ab3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:05.073672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6164ae-5e21-439d-a2f4-550a0b0ab3a0 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:05.074164 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6164ae-5e21-439d-a2f4-550a0b0ab3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:05.074696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6164ae-5e21-439d-a2f4-550a0b0ab3a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:05.075686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6164ae-5e21-439d-a2f4-550a0b0ab3a0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:05.077339 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6164ae-5e21-439d-a2f4-550a0b0ab3a0 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:05.088095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.sql.core [None req-5e6164ae-5e21-439d-a2f4-550a0b0ab3a0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 17:29:05.088095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 17:29:05.088095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [parameters: {'id': '9c997501fd6e449f8a9cc2b60c15e600', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 17:29:05.088095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80138) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-5e6164ae-5e21-439d-a2f4-550a0b0ab3a0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application result = self._query(query) May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application conn.query(q) May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application result.read() May 12 17:29:05.110427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return ref.to_dict() May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 17:29:05.111420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application next(self.gen) May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application yield resource May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application next(self.gen) May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self.session.rollback() May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self.force_reraise() May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise self.value May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application session.commit() May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 17:29:05.112335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._prepare_impl() May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self.session.flush() May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._flush(objects) May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application compat.raise_( May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application flush_context.execute() May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rec.execute(self) May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 17:29:05.113288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 17:29:05.114178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application result = self._query(query) May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application conn.query(q) May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application result.read() May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 17:29:05.115054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [parameters: {'id': '9c997501fd6e449f8a9cc2b60c15e600', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:05.117435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 17:29:05.119477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:05.121492 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 244/478] 10.222.0.76 () {60 vars in 1131 bytes} [Thu May 12 17:29:04 2022] POST /identity/v3/roles => generated 144 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:05.128093 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c681a-b951-4670-b931-4f997b11bc6a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:05.232135 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c681a-b951-4670-b931-4f997b11bc6a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:05.271113 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af7c7c-fd27-4e0b-ae03-16e2e7bbcf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:05.271919 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af7c7c-fd27-4e0b-ae03-16e2e7bbcf48 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:05.272199 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af7c7c-fd27-4e0b-ae03-16e2e7bbcf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:05.272468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af7c7c-fd27-4e0b-ae03-16e2e7bbcf48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:05.283104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af7c7c-fd27-4e0b-ae03-16e2e7bbcf48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-d7af7c7c-fd27-4e0b-ae03-16e2e7bbcf48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:05.292074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:05.293007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:05.293812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:05.293812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:05.293812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:05.293812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:05.293812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:05.293812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:05.293812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:05.293812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:05.293812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:05.293812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:05.293812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 17:29:05.293812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:05.293812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 235/479] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:29:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:05.299185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6164ae-5e21-439d-a2f4-550a0b0ab3a0 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:05.411708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6164ae-5e21-439d-a2f4-550a0b0ab3a0 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:05.447838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84702c07-d873-4b2f-8883-b78d1b4473da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:05.448511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84702c07-d873-4b2f-8883-b78d1b4473da None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:05.448794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84702c07-d873-4b2f-8883-b78d1b4473da None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:05.449071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84702c07-d873-4b2f-8883-b78d1b4473da None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:05.449834 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84702c07-d873-4b2f-8883-b78d1b4473da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:05.450145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84702c07-d873-4b2f-8883-b78d1b4473da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:05.451590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84702c07-d873-4b2f-8883-b78d1b4473da None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:05.466870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 245/480] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:06.662732 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be248d1-f9a8-4ed1-8ed2-f2fec089a269 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:06.663250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be248d1-f9a8-4ed1-8ed2-f2fec089a269 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:06.663324 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be248d1-f9a8-4ed1-8ed2-f2fec089a269 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:06.664951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 236/481] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:06.670295 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6477db-7ba3-4e95-83a2-e60195be052e None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:06.670737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6477db-7ba3-4e95-83a2-e60195be052e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:06.670915 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6477db-7ba3-4e95-83a2-e60195be052e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:06.695708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-8e6477db-7ba3-4e95-83a2-e60195be052e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:06.697271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8e6477db-7ba3-4e95-83a2-e60195be052e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:06.785301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 246/482] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:06.824210 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be248d1-f9a8-4ed1-8ed2-f2fec089a269 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:06.927950 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a62a8d-ae9b-4055-b6af-895ff9cd9439 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:06.928242 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a62a8d-ae9b-4055-b6af-895ff9cd9439 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:06.928428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a62a8d-ae9b-4055-b6af-895ff9cd9439 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:06.934824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 247/483] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:06.938976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0d516-11b5-42ef-8839-021a61d18685 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:06.939272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0d516-11b5-42ef-8839-021a61d18685 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:06.940163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0d516-11b5-42ef-8839-021a61d18685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:06.962395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be248d1-f9a8-4ed1-8ed2-f2fec089a269 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:06.977604 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-4ac0d516-11b5-42ef-8839-021a61d18685 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:06.978963 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4ac0d516-11b5-42ef-8839-021a61d18685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:07.031151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2f16f-4b78-4b12-a296-38a9d5686e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:07.031998 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2f16f-4b78-4b12-a296-38a9d5686e06 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:07.032276 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2f16f-4b78-4b12-a296-38a9d5686e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:07.033314 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2f16f-4b78-4b12-a296-38a9d5686e06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:07.055268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2f16f-4b78-4b12-a296-38a9d5686e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-49a2f16f-4b78-4b12-a296-38a9d5686e06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:07.065629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:07.066515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:07.067346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:07.067346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:07.067346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:07.067346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:07.067346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:07.067346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:07.067346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:07.067346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:07.067346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:07.067346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:07.067346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:07.067346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:07.071667 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 237/484] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:07.078060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2f16f-4b78-4b12-a296-38a9d5686e06 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:07.090752 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 248/485] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:07.154013 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855e3e8-9a26-4477-b393-b49c8c35424a None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:07.154321 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855e3e8-9a26-4477-b393-b49c8c35424a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:07.154622 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855e3e8-9a26-4477-b393-b49c8c35424a None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:07.156298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 249/486] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:07.161596 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb78a-22ea-48da-a64c-84fdb0889987 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:07.162484 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb78a-22ea-48da-a64c-84fdb0889987 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:07.163290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb78a-22ea-48da-a64c-84fdb0889987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:07.184225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-c1fbb78a-22ea-48da-a64c-84fdb0889987 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:07.186288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c1fbb78a-22ea-48da-a64c-84fdb0889987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:07.206832 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2f16f-4b78-4b12-a296-38a9d5686e06 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:07.248725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b17adf-9dbc-4049-b072-b391aa4a2059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:07.249539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b17adf-9dbc-4049-b072-b391aa4a2059 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:07.250010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b17adf-9dbc-4049-b072-b391aa4a2059 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:07.250701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b17adf-9dbc-4049-b072-b391aa4a2059 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:07.251594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b17adf-9dbc-4049-b072-b391aa4a2059 None admin] RBAC: Adding query filter params (name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:07.253282 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b17adf-9dbc-4049-b072-b391aa4a2059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:07.255628 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b17adf-9dbc-4049-b072-b391aa4a2059 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:07.266481 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 238/487] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:07.267722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b17adf-9dbc-4049-b072-b391aa4a2059 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:07.274748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 250/488] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:07.276082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbb78a-22ea-48da-a64c-84fdb0889987 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:07.387047 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b17adf-9dbc-4049-b072-b391aa4a2059 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:07.393529 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbb78a-22ea-48da-a64c-84fdb0889987 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:07.421279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5babc-71c2-4506-a868-272eaadc2a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:07.422075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5babc-71c2-4506-a868-272eaadc2a20 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:07.422366 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5babc-71c2-4506-a868-272eaadc2a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:07.422624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5babc-71c2-4506-a868-272eaadc2a20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:07.430501 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73141c3-2aa0-45a4-ae55-4a5ebfadfd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:07.431597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73141c3-2aa0-45a4-ae55-4a5ebfadfd52 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:07.432077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73141c3-2aa0-45a4-ae55-4a5ebfadfd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:07.432553 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73141c3-2aa0-45a4-ae55-4a5ebfadfd52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:07.433891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5babc-71c2-4506-a868-272eaadc2a20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-34c5babc-71c2-4506-a868-272eaadc2a20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:07.442376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:07.443372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:07.444162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:07.444162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:07.444162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:07.444162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:07.444162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:07.444162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:07.444162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:07.444162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:07.444162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:07.444162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:07.444162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:07.444162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:07.447295 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73141c3-2aa0-45a4-ae55-4a5ebfadfd52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:07.448389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 239/489] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:07.449219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73141c3-2aa0-45a4-ae55-4a5ebfadfd52 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:07.449342 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5babc-71c2-4506-a868-272eaadc2a20 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-e73141c3-2aa0-45a4-ae55-4a5ebfadfd52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:07.469380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:07.470274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:07.471912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:07.471912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:07.471912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:07.471912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:07.474152 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 251/490] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:07.475261 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73141c3-2aa0-45a4-ae55-4a5ebfadfd52 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:07.552919 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5babc-71c2-4506-a868-272eaadc2a20 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:07.578041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73141c3-2aa0-45a4-ae55-4a5ebfadfd52 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:07.587506 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02e1bf-1c16-47da-8c15-f0f169a63f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:07.588303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02e1bf-1c16-47da-8c15-f0f169a63f55 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:07.588584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02e1bf-1c16-47da-8c15-f0f169a63f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:07.588859 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02e1bf-1c16-47da-8c15-f0f169a63f55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:07.599497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02e1bf-1c16-47da-8c15-f0f169a63f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-da02e1bf-1c16-47da-8c15-f0f169a63f55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:07.607398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:07.608272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:07.609060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:07.609060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:07.609060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:07.609060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:07.609060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:07.609060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:07.609060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:07.609060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:07.609060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:07.609060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:07.609060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:07.609060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:07.613618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 240/491] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:07.614418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02e1bf-1c16-47da-8c15-f0f169a63f55 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:07.618587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec2cd5-29c6-431a-a28c-6d0a6fd33f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:07.619512 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec2cd5-29c6-431a-a28c-6d0a6fd33f80 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:07.620000 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec2cd5-29c6-431a-a28c-6d0a6fd33f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:07.620460 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec2cd5-29c6-431a-a28c-6d0a6fd33f80 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:07.621391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec2cd5-29c6-431a-a28c-6d0a6fd33f80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:07.621885 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec2cd5-29c6-431a-a28c-6d0a6fd33f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:07.623479 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec2cd5-29c6-431a-a28c-6d0a6fd33f80 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:07.633672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 252/492] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:07.634772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec2cd5-29c6-431a-a28c-6d0a6fd33f80 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:07.722329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02e1bf-1c16-47da-8c15-f0f169a63f55 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:07.739823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec2cd5-29c6-431a-a28c-6d0a6fd33f80 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:07.758424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a459c53-b9d1-4e8a-ac01-1d2f1ab5475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:07.759144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a459c53-b9d1-4e8a-ac01-1d2f1ab5475f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:07.759428 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a459c53-b9d1-4e8a-ac01-1d2f1ab5475f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:07.759703 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a459c53-b9d1-4e8a-ac01-1d2f1ab5475f None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:07.760447 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a459c53-b9d1-4e8a-ac01-1d2f1ab5475f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:07.760754 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a459c53-b9d1-4e8a-ac01-1d2f1ab5475f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:07.762178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a459c53-b9d1-4e8a-ac01-1d2f1ab5475f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:07.777115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 241/493] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:07.778132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a459c53-b9d1-4e8a-ac01-1d2f1ab5475f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:07.781697 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3789ac5-3504-455a-9856-08571c84e121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:07.782656 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3789ac5-3504-455a-9856-08571c84e121 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:07.783227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3789ac5-3504-455a-9856-08571c84e121 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:07.784355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3789ac5-3504-455a-9856-08571c84e121 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:07.785385 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3789ac5-3504-455a-9856-08571c84e121 None admin] RBAC: Adding query filter params (name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:07.785887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3789ac5-3504-455a-9856-08571c84e121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:07.787541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3789ac5-3504-455a-9856-08571c84e121 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:07.796737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 253/494] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:07.797861 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3789ac5-3504-455a-9856-08571c84e121 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:07.883966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a459c53-b9d1-4e8a-ac01-1d2f1ab5475f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:07.905989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3789ac5-3504-455a-9856-08571c84e121 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:07.920563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e6894-6ebe-4359-bca8-d72960dd4ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:07.921353 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e6894-6ebe-4359-bca8-d72960dd4ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:07.921635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e6894-6ebe-4359-bca8-d72960dd4ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:07.921909 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e6894-6ebe-4359-bca8-d72960dd4ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:07.932595 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e6894-6ebe-4359-bca8-d72960dd4ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:07.934070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e6894-6ebe-4359-bca8-d72960dd4ff2 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:07.944413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba8973-e920-41e3-97eb-d2ac7b910573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:07.945488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8973-e920-41e3-97eb-d2ac7b910573 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:07.946012 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8973-e920-41e3-97eb-d2ac7b910573 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:07.946480 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8973-e920-41e3-97eb-d2ac7b910573 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-7f3e6894-6ebe-4359-bca8-d72960dd4ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:07.951910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:07.952888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:07.953745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:07.953745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:07.953745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:07.953745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:07.953745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 242/495] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:07.956580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba8973-e920-41e3-97eb-d2ac7b910573 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:07.958053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba8973-e920-41e3-97eb-d2ac7b910573 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:07.959102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e6894-6ebe-4359-bca8-d72960dd4ff2 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-84ba8973-e920-41e3-97eb-d2ac7b910573 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:07.974750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:07.975659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:07.976557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:07.976557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:07.976557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:07.976557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:07.976557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:07.976557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:07.976557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:07.976557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:07.976557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 17:29:07.976557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:07.976557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 254/496] 10.222.0.76 () {56 vars in 1093 bytes} [Thu May 12 17:29:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:07.977128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743da8b-f12d-40e1-8c46-d3f8af7ce8ae None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:07.978085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743da8b-f12d-40e1-8c46-d3f8af7ce8ae None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:07.978085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743da8b-f12d-40e1-8c46-d3f8af7ce8ae None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:07.978872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 255/497] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:07.982951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743da8b-f12d-40e1-8c46-d3f8af7ce8ae None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:08.067676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e6894-6ebe-4359-bca8-d72960dd4ff2 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:08.087517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743da8b-f12d-40e1-8c46-d3f8af7ce8ae None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:08.101518 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609aac0-0754-4b36-823c-0f5326ce84ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:08.102336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609aac0-0754-4b36-823c-0f5326ce84ec None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:08.102617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609aac0-0754-4b36-823c-0f5326ce84ec None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:08.102921 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609aac0-0754-4b36-823c-0f5326ce84ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:08.112752 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609aac0-0754-4b36-823c-0f5326ce84ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:08.114212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609aac0-0754-4b36-823c-0f5326ce84ec None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:08.121676 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2ef43-3035-46f8-a8aa-f79cb5d6570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:08.122337 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ef43-3035-46f8-a8aa-f79cb5d6570e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:08.122619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ef43-3035-46f8-a8aa-f79cb5d6570e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:08.122939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ef43-3035-46f8-a8aa-f79cb5d6570e None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:08.123637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2ef43-3035-46f8-a8aa-f79cb5d6570e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:08.123959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2ef43-3035-46f8-a8aa-f79cb5d6570e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:08.125326 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2ef43-3035-46f8-a8aa-f79cb5d6570e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-9609aac0-0754-4b36-823c-0f5326ce84ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:08.133156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:08.134257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:08.135129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:08.135129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:08.135129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:08.135129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:08.135129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 243/498] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:08.135415 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609aac0-0754-4b36-823c-0f5326ce84ec None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:08.142066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 256/499] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:08.146420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0c626-e91a-453e-996e-3b775dba048c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:08.146420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0c626-e91a-453e-996e-3b775dba048c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:08.146420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0c626-e91a-453e-996e-3b775dba048c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:08.161960 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-99e0c626-e91a-453e-996e-3b775dba048c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:08.163574 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-99e0c626-e91a-453e-996e-3b775dba048c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:08.230380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 257/500] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:08.231272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0c626-e91a-453e-996e-3b775dba048c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:08.256027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609aac0-0754-4b36-823c-0f5326ce84ec None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:08.292592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a387e35-ce10-49f2-bff5-b7f557c50e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:08.293260 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a387e35-ce10-49f2-bff5-b7f557c50e09 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:08.293539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a387e35-ce10-49f2-bff5-b7f557c50e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:08.293812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a387e35-ce10-49f2-bff5-b7f557c50e09 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:08.294649 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a387e35-ce10-49f2-bff5-b7f557c50e09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:08.294995 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a387e35-ce10-49f2-bff5-b7f557c50e09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:08.296411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a387e35-ce10-49f2-bff5-b7f557c50e09 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:08.340488 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 244/501] 10.222.0.76 () {56 vars in 1133 bytes} [Thu May 12 17:29:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:08.340488 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a387e35-ce10-49f2-bff5-b7f557c50e09 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:08.351004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0c626-e91a-453e-996e-3b775dba048c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:08.387044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e79fcf-9227-48ea-8c7a-fe23f50b7a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:08.387697 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e79fcf-9227-48ea-8c7a-fe23f50b7a3c None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:08.387977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e79fcf-9227-48ea-8c7a-fe23f50b7a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:08.388248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e79fcf-9227-48ea-8c7a-fe23f50b7a3c None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:08.388961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e79fcf-9227-48ea-8c7a-fe23f50b7a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:08.389256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e79fcf-9227-48ea-8c7a-fe23f50b7a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:08.390616 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e79fcf-9227-48ea-8c7a-fe23f50b7a3c None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:08.401938 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 258/502] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:08.403805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e79fcf-9227-48ea-8c7a-fe23f50b7a3c None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:08.441934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a387e35-ce10-49f2-bff5-b7f557c50e09 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:08.477268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de649d48-b8d3-4bdb-a119-daf16bfe16e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:08.478348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de649d48-b8d3-4bdb-a119-daf16bfe16e7 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:08.483285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de649d48-b8d3-4bdb-a119-daf16bfe16e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:08.483502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de649d48-b8d3-4bdb-a119-daf16bfe16e7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:08.492151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de649d48-b8d3-4bdb-a119-daf16bfe16e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:08.493599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de649d48-b8d3-4bdb-a119-daf16bfe16e7 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:08.507428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e79fcf-9227-48ea-8c7a-fe23f50b7a3c None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-de649d48-b8d3-4bdb-a119-daf16bfe16e7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:08.509411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:08.510316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:08.511572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:08.511572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:08.511572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:08.511572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:08.511572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:08.511572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:08.511572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:08.511572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:08.511572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 17:29:08.511572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:08.511572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 245/503] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:29:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:08.512133 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de649d48-b8d3-4bdb-a119-daf16bfe16e7 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:08.544165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bfd28-b199-45b7-a7ae-b23a7167e5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:08.544953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bfd28-b199-45b7-a7ae-b23a7167e5bd None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:08.545233 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bfd28-b199-45b7-a7ae-b23a7167e5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:08.545505 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bfd28-b199-45b7-a7ae-b23a7167e5bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:08.555346 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887bfd28-b199-45b7-a7ae-b23a7167e5bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-887bfd28-b199-45b7-a7ae-b23a7167e5bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:08.563034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:08.564031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:08.565380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:08.565380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:08.565380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:08.565380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:08.565380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:08.565380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:08.565380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:08.565380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:08.565380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:08.565380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:08.565380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:08.565380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:08.565380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 259/504] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:08.565380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bfd28-b199-45b7-a7ae-b23a7167e5bd None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:08.608296 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de649d48-b8d3-4bdb-a119-daf16bfe16e7 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:08.640114 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04408440-ced9-4738-96d9-176a03a1eb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:08.640756 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04408440-ced9-4738-96d9-176a03a1eb4a None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:08.641035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04408440-ced9-4738-96d9-176a03a1eb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:08.641304 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04408440-ced9-4738-96d9-176a03a1eb4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:08.660114 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bfd28-b199-45b7-a7ae-b23a7167e5bd None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:08.691717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e811be-135c-491c-900a-fbd75e64921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:08.692499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e811be-135c-491c-900a-fbd75e64921d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:08.692782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e811be-135c-491c-900a-fbd75e64921d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:08.693065 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e811be-135c-491c-900a-fbd75e64921d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:08.700321 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e811be-135c-491c-900a-fbd75e64921d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:08.701760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e811be-135c-491c-900a-fbd75e64921d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:08.705870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04408440-ced9-4738-96d9-176a03a1eb4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:08.707447 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04408440-ced9-4738-96d9-176a03a1eb4a None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-05e811be-135c-491c-900a-fbd75e64921d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:08.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:08.717038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:08.717942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:08.717942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:08.717942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:08.717942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:08.717942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:08.717942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:08.717942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:08.717942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:08.717942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 17:29:08.717942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:08.717942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 260/505] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:29:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:08.718775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107a589-272e-402a-8410-ddf532ac0d68 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:08.718961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107a589-272e-402a-8410-ddf532ac0d68 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:08.719235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107a589-272e-402a-8410-ddf532ac0d68 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:08.720657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 261/506] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:08.721818 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107a589-272e-402a-8410-ddf532ac0d68 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:08.803255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 246/507] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:29:08.804012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04408440-ced9-4738-96d9-176a03a1eb4a None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:08.818424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107a589-272e-402a-8410-ddf532ac0d68 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:08.850626 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96553b-0fcc-4dfe-8f65-ab1aceafaddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:08.851307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96553b-0fcc-4dfe-8f65-ab1aceafaddf None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:08.851587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96553b-0fcc-4dfe-8f65-ab1aceafaddf None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:08.851860 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96553b-0fcc-4dfe-8f65-ab1aceafaddf None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:08.852685 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96553b-0fcc-4dfe-8f65-ab1aceafaddf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:08.852990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96553b-0fcc-4dfe-8f65-ab1aceafaddf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:08.854421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96553b-0fcc-4dfe-8f65-ab1aceafaddf None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:08.890047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 262/508] 10.222.0.76 () {56 vars in 1137 bytes} [Thu May 12 17:29:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:08.890887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96553b-0fcc-4dfe-8f65-ab1aceafaddf None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:08.899182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04408440-ced9-4738-96d9-176a03a1eb4a None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:08.931173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b3050-f3cc-41df-860c-cfd0b3edba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:08.931821 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b3050-f3cc-41df-860c-cfd0b3edba3b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:08.932105 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b3050-f3cc-41df-860c-cfd0b3edba3b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:08.932379 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b3050-f3cc-41df-860c-cfd0b3edba3b None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:08.933108 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b3050-f3cc-41df-860c-cfd0b3edba3b None admin] RBAC: Adding query filter params (name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:08.933409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b3050-f3cc-41df-860c-cfd0b3edba3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:08.934785 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b3050-f3cc-41df-860c-cfd0b3edba3b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:08.942931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 247/509] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:08.944094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8892e09-4f02-461b-aa4a-14c0f1a88a5b None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:08.944378 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8892e09-4f02-461b-aa4a-14c0f1a88a5b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:08.944651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8892e09-4f02-461b-aa4a-14c0f1a88a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:08.960546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-f8892e09-4f02-461b-aa4a-14c0f1a88a5b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:08.961720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f8892e09-4f02-461b-aa4a-14c0f1a88a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:08.984942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96553b-0fcc-4dfe-8f65-ab1aceafaddf None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:09.018644 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895fb20-1fa2-46a9-ad8d-0a754a3e9a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:09.019330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895fb20-1fa2-46a9-ad8d-0a754a3e9a0d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:09.019606 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895fb20-1fa2-46a9-ad8d-0a754a3e9a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:09.019875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895fb20-1fa2-46a9-ad8d-0a754a3e9a0d None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:09.020702 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895fb20-1fa2-46a9-ad8d-0a754a3e9a0d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:09.020999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895fb20-1fa2-46a9-ad8d-0a754a3e9a0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:09.022436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895fb20-1fa2-46a9-ad8d-0a754a3e9a0d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:09.024468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 248/510] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:09.025287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8892e09-4f02-461b-aa4a-14c0f1a88a5b None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:09.041464 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 263/511] 10.222.0.76 () {56 vars in 1137 bytes} [Thu May 12 17:29:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:09.042285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895fb20-1fa2-46a9-ad8d-0a754a3e9a0d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:09.122681 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8892e09-4f02-461b-aa4a-14c0f1a88a5b None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:09.137557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895fb20-1fa2-46a9-ad8d-0a754a3e9a0d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:09.156420 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7632a98-8dee-43e1-849c-9fd1530025bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:09.157189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7632a98-8dee-43e1-849c-9fd1530025bf None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:09.157464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7632a98-8dee-43e1-849c-9fd1530025bf None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:09.157729 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7632a98-8dee-43e1-849c-9fd1530025bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:09.167594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7632a98-8dee-43e1-849c-9fd1530025bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:09.169035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7632a98-8dee-43e1-849c-9fd1530025bf None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:09.169602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd147ee-91ee-43e3-8fec-456ef783bfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:09.170240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd147ee-91ee-43e3-8fec-456ef783bfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:09.170523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd147ee-91ee-43e3-8fec-456ef783bfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:09.170822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd147ee-91ee-43e3-8fec-456ef783bfa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-d7632a98-8dee-43e1-849c-9fd1530025bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:09.186279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:09.187174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:09.188031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:09.188031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:09.188031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:09.188031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:09.188031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 249/512] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:09.188294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7632a98-8dee-43e1-849c-9fd1530025bf None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:09.240699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd147ee-91ee-43e3-8fec-456ef783bfa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:09.242165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd147ee-91ee-43e3-8fec-456ef783bfa1 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:09.283477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7632a98-8dee-43e1-849c-9fd1530025bf None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:09.316665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4dd40-ecf2-4dab-bb60-0d3cc5339b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:09.317449 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4dd40-ecf2-4dab-bb60-0d3cc5339b2c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:09.317727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4dd40-ecf2-4dab-bb60-0d3cc5339b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:09.317997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4dd40-ecf2-4dab-bb60-0d3cc5339b2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:09.327555 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4dd40-ecf2-4dab-bb60-0d3cc5339b2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:09.328988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4dd40-ecf2-4dab-bb60-0d3cc5339b2c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:09.336741 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 264/513] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:29:09.337662 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd147ee-91ee-43e3-8fec-456ef783bfa1 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-89b4dd40-ecf2-4dab-bb60-0d3cc5339b2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:09.346621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:09.347540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:09.348381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:09.348381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:09.348381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:09.348381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:09.348381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 250/514] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:09.348713 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4dd40-ecf2-4dab-bb60-0d3cc5339b2c None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:09.440540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd147ee-91ee-43e3-8fec-456ef783bfa1 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:09.446539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4dd40-ecf2-4dab-bb60-0d3cc5339b2c None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:09.472479 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e37899-f0b9-4bf0-b1a8-a6f2a8a04451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:09.473116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e37899-f0b9-4bf0-b1a8-a6f2a8a04451 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:09.473397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e37899-f0b9-4bf0-b1a8-a6f2a8a04451 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:09.473673 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e37899-f0b9-4bf0-b1a8-a6f2a8a04451 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:09.478243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd37e6c-80f1-4e23-8cea-56424afd1923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:09.479044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd37e6c-80f1-4e23-8cea-56424afd1923 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:09.479326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd37e6c-80f1-4e23-8cea-56424afd1923 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:09.479599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd37e6c-80f1-4e23-8cea-56424afd1923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:09.489700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd37e6c-80f1-4e23-8cea-56424afd1923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:09.491265 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd37e6c-80f1-4e23-8cea-56424afd1923 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-dfd37e6c-80f1-4e23-8cea-56424afd1923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:09.508944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:09.509808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:09.510690 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:09.510690 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:09.510690 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:09.510690 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:09.510690 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 251/515] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:09.511222 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd37e6c-80f1-4e23-8cea-56424afd1923 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:09.539381 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e37899-f0b9-4bf0-b1a8-a6f2a8a04451 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:09.540849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e37899-f0b9-4bf0-b1a8-a6f2a8a04451 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:09.607445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd37e6c-80f1-4e23-8cea-56424afd1923 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:09.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 265/516] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:29:09.634741 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e37899-f0b9-4bf0-b1a8-a6f2a8a04451 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:09.640773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d52282-9033-4e6d-b45a-bb8b48857056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:09.641429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d52282-9033-4e6d-b45a-bb8b48857056 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:09.641710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d52282-9033-4e6d-b45a-bb8b48857056 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:09.641985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d52282-9033-4e6d-b45a-bb8b48857056 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:09.642790 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d52282-9033-4e6d-b45a-bb8b48857056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:09.643093 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d52282-9033-4e6d-b45a-bb8b48857056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:09.644469 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d52282-9033-4e6d-b45a-bb8b48857056 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:09.655562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 252/517] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:09.656181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d52282-9033-4e6d-b45a-bb8b48857056 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:09.727520 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e37899-f0b9-4bf0-b1a8-a6f2a8a04451 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:09.749568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d52282-9033-4e6d-b45a-bb8b48857056 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:09.759475 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9456504-f171-463a-b14b-d7d945390f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:09.760254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9456504-f171-463a-b14b-d7d945390f09 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:09.760526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9456504-f171-463a-b14b-d7d945390f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:09.760792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9456504-f171-463a-b14b-d7d945390f09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:09.770178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9456504-f171-463a-b14b-d7d945390f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:09.771646 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9456504-f171-463a-b14b-d7d945390f09 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:09.781721 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219354f-495e-4a16-8b14-0a6f3ce44b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:09.782370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219354f-495e-4a16-8b14-0a6f3ce44b0b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:09.782651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219354f-495e-4a16-8b14-0a6f3ce44b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:09.782964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219354f-495e-4a16-8b14-0a6f3ce44b0b None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:09.784457 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219354f-495e-4a16-8b14-0a6f3ce44b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:09.784767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219354f-495e-4a16-8b14-0a6f3ce44b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:09.786130 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219354f-495e-4a16-8b14-0a6f3ce44b0b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-a9456504-f171-463a-b14b-d7d945390f09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:09.789488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:09.790329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:09.791406 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:09.791406 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:09.791406 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:09.791406 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:09.791406 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 266/518] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:09.791933 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9456504-f171-463a-b14b-d7d945390f09 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:09.798497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 253/519] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:09.799904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219354f-495e-4a16-8b14-0a6f3ce44b0b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:09.887970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9456504-f171-463a-b14b-d7d945390f09 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:09.893966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219354f-495e-4a16-8b14-0a6f3ce44b0b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:09.919751 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437bb63-5aad-4c2d-8350-0aebd3d98a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:09.920399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437bb63-5aad-4c2d-8350-0aebd3d98a79 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:09.920676 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437bb63-5aad-4c2d-8350-0aebd3d98a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:09.920949 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437bb63-5aad-4c2d-8350-0aebd3d98a79 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:09.921662 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437bb63-5aad-4c2d-8350-0aebd3d98a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:09.921961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437bb63-5aad-4c2d-8350-0aebd3d98a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:09.923353 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437bb63-5aad-4c2d-8350-0aebd3d98a79 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:09.926233 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03955a5d-a2ca-480e-b587-ddfe11c8c882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:09.927049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03955a5d-a2ca-480e-b587-ddfe11c8c882 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:09.927331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03955a5d-a2ca-480e-b587-ddfe11c8c882 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:09.927600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03955a5d-a2ca-480e-b587-ddfe11c8c882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:09.937523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03955a5d-a2ca-480e-b587-ddfe11c8c882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:09.943242 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 267/520] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:09.943387 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03955a5d-a2ca-480e-b587-ddfe11c8c882 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:09.943483 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437bb63-5aad-4c2d-8350-0aebd3d98a79 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-03955a5d-a2ca-480e-b587-ddfe11c8c882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:09.957940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:09.958866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:09.959741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:09.959741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:09.959741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:09.959741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:09.959741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 254/521] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:09.960011 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03955a5d-a2ca-480e-b587-ddfe11c8c882 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:10.041757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437bb63-5aad-4c2d-8350-0aebd3d98a79 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:10.055886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03955a5d-a2ca-480e-b587-ddfe11c8c882 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:10.074369 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20abf9f-5d37-4e60-b4f8-e37b30252757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:10.075181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20abf9f-5d37-4e60-b4f8-e37b30252757 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:10.075465 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20abf9f-5d37-4e60-b4f8-e37b30252757 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:10.075741 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20abf9f-5d37-4e60-b4f8-e37b30252757 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:10.082194 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20abf9f-5d37-4e60-b4f8-e37b30252757 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:10.083659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20abf9f-5d37-4e60-b4f8-e37b30252757 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:10.087630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cc93b-f560-4443-8fbb-34390fcb2fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:10.088279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cc93b-f560-4443-8fbb-34390fcb2fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:10.088556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cc93b-f560-4443-8fbb-34390fcb2fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:10.088831 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cc93b-f560-4443-8fbb-34390fcb2fc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:10.089538 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cc93b-f560-4443-8fbb-34390fcb2fc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:10.089836 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cc93b-f560-4443-8fbb-34390fcb2fc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:10.091618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cc93b-f560-4443-8fbb-34390fcb2fc8 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-b20abf9f-5d37-4e60-b4f8-e37b30252757 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:10.098122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:10.099024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:10.099874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:10.099874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:10.099874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:10.099874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:10.099874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:10.099874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:10.099874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:10.099874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:10.099874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 268/522] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:10.100358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20abf9f-5d37-4e60-b4f8-e37b30252757 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:10.114136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 255/523] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:10.114136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cc93b-f560-4443-8fbb-34390fcb2fc8 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:10.197508 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20abf9f-5d37-4e60-b4f8-e37b30252757 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:10.203717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cc93b-f560-4443-8fbb-34390fcb2fc8 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:10.228772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246dbc5-dd40-4272-9485-d8afa6d373c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:10.229551 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246dbc5-dd40-4272-9485-d8afa6d373c9 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:10.229829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246dbc5-dd40-4272-9485-d8afa6d373c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:10.230102 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246dbc5-dd40-4272-9485-d8afa6d373c9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:10.238080 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246dbc5-dd40-4272-9485-d8afa6d373c9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:10.238410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab9e91-4941-4cf3-b385-cbdb37853e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:10.239286 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9e91-4941-4cf3-b385-cbdb37853e9d None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:10.239361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9e91-4941-4cf3-b385-cbdb37853e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:10.239564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246dbc5-dd40-4272-9485-d8afa6d373c9 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:10.239660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9e91-4941-4cf3-b385-cbdb37853e9d None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:10.240322 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab9e91-4941-4cf3-b385-cbdb37853e9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:10.241742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab9e91-4941-4cf3-b385-cbdb37853e9d None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-9246dbc5-dd40-4272-9485-d8afa6d373c9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:10.254540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:10.255663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:10.256722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:10.256722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:10.256722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:10.256722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:10.256722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:10.256722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:10.256722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:10.256722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:10.256722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 17:29:10.256722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:10.260527 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 269/524] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:10.260527 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246dbc5-dd40-4272-9485-d8afa6d373c9 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:10.274700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 256/525] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:29:10 2022] POST /identity/v3/users => generated 247 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:29:10.274700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab9e91-4941-4cf3-b385-cbdb37853e9d None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:10.371439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab9e91-4941-4cf3-b385-cbdb37853e9d None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:10.372991 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246dbc5-dd40-4272-9485-d8afa6d373c9 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:10.408974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d9fb0-b2a4-4625-a227-e38ad9dae8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:10.409707 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d9fb0-b2a4-4625-a227-e38ad9dae8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:10.409989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d9fb0-b2a4-4625-a227-e38ad9dae8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:10.410279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d9fb0-b2a4-4625-a227-e38ad9dae8f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:10.411093 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d9fb0-b2a4-4625-a227-e38ad9dae8f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:10.411402 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d9fb0-b2a4-4625-a227-e38ad9dae8f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:10.412872 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d9fb0-b2a4-4625-a227-e38ad9dae8f2 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:10.413596 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cfb26-a2dd-42f4-96a0-8014664ae210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:10.414507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cfb26-a2dd-42f4-96a0-8014664ae210 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:10.415003 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cfb26-a2dd-42f4-96a0-8014664ae210 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:10.415277 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cfb26-a2dd-42f4-96a0-8014664ae210 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:10.416016 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cfb26-a2dd-42f4-96a0-8014664ae210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:10.416321 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cfb26-a2dd-42f4-96a0-8014664ae210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:10.417717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cfb26-a2dd-42f4-96a0-8014664ae210 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:10.431264 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 270/526] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:10.432131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cfb26-a2dd-42f4-96a0-8014664ae210 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:10.441462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 257/527] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:10.441462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d9fb0-b2a4-4625-a227-e38ad9dae8f2 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:10.541298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cfb26-a2dd-42f4-96a0-8014664ae210 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:10.541760 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d9fb0-b2a4-4625-a227-e38ad9dae8f2 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:10.574730 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc7b93-4dea-4440-93d0-f9ee2b540c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:10.575522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc7b93-4dea-4440-93d0-f9ee2b540c98 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:10.575805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc7b93-4dea-4440-93d0-f9ee2b540c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:10.576081 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc7b93-4dea-4440-93d0-f9ee2b540c98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:10.577856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873a726-2d90-4bc0-8264-39171947465d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:10.578707 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873a726-2d90-4bc0-8264-39171947465d None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:10.579127 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873a726-2d90-4bc0-8264-39171947465d None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:10.579542 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873a726-2d90-4bc0-8264-39171947465d None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:10.580628 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873a726-2d90-4bc0-8264-39171947465d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:10.581079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873a726-2d90-4bc0-8264-39171947465d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:10.582699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc7b93-4dea-4440-93d0-f9ee2b540c98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:10.582825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873a726-2d90-4bc0-8264-39171947465d None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:10.584134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc7b93-4dea-4440-93d0-f9ee2b540c98 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-b5bc7b93-4dea-4440-93d0-f9ee2b540c98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:10.598166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:10.599169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:10.604877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:10.604877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:10.604877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:10.604877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:10.604877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:10.604877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:10.604877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:10.604877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:10.604877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 271/528] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:10.604877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc7b93-4dea-4440-93d0-f9ee2b540c98 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:10.605424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 258/529] 10.222.0.76 () {56 vars in 1139 bytes} [Thu May 12 17:29:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:10.605424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873a726-2d90-4bc0-8264-39171947465d None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:10.700298 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873a726-2d90-4bc0-8264-39171947465d None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:10.706245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc7b93-4dea-4440-93d0-f9ee2b540c98 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:10.733331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e170ad-ef6a-4849-8cec-f30c2926226e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:10.733977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e170ad-ef6a-4849-8cec-f30c2926226e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:10.734257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e170ad-ef6a-4849-8cec-f30c2926226e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:10.734527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e170ad-ef6a-4849-8cec-f30c2926226e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:10.735389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e170ad-ef6a-4849-8cec-f30c2926226e None admin] RBAC: Adding query filter params (role.id=511b62180d4c4881999e65dfab877783, scope.project.id=745af7d676704a179668d6685724ed78, user.id=04ad234318ad47589b844351cd3bb3e3) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:10.735692 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e170ad-ef6a-4849-8cec-f30c2926226e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:10.737740 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e170ad-ef6a-4849-8cec-f30c2926226e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:10.739654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8a19d-8517-4bb9-8805-02082970ff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:10.740462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8a19d-8517-4bb9-8805-02082970ff4b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:10.740737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8a19d-8517-4bb9-8805-02082970ff4b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:10.741053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8a19d-8517-4bb9-8805-02082970ff4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:10.755088 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 259/530] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:10 2022] GET /identity/v3/role_assignments?user.id=04ad234318ad47589b844351cd3bb3e3&scope.project.id=745af7d676704a179668d6685724ed78&role.id=511b62180d4c4881999e65dfab877783 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:10.755088 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e170ad-ef6a-4849-8cec-f30c2926226e None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:10.755343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8a19d-8517-4bb9-8805-02082970ff4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:10.755343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8a19d-8517-4bb9-8805-02082970ff4b None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-62b8a19d-8517-4bb9-8805-02082970ff4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:10.771994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:10.773025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:10.773875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:10.773875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:10.773875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:10.773875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:10.773875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:10.773875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:10.773875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:10.773875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:10.778353 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 272/531] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:10.779355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8a19d-8517-4bb9-8805-02082970ff4b None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:10.865419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e170ad-ef6a-4849-8cec-f30c2926226e None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:10.888947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8a19d-8517-4bb9-8805-02082970ff4b None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:10.902468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a153fe-9fa9-4f00-82aa-42d6bd84723e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:10.903196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a153fe-9fa9-4f00-82aa-42d6bd84723e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:10.903425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a153fe-9fa9-4f00-82aa-42d6bd84723e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:10.903700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a153fe-9fa9-4f00-82aa-42d6bd84723e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:10.926970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd0f13-ff15-49a5-9ae8-7489b7958b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:10.927630 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd0f13-ff15-49a5-9ae8-7489b7958b30 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:10.927905 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd0f13-ff15-49a5-9ae8-7489b7958b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:10.928175 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd0f13-ff15-49a5-9ae8-7489b7958b30 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:10.929017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd0f13-ff15-49a5-9ae8-7489b7958b30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:10.929362 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd0f13-ff15-49a5-9ae8-7489b7958b30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:10.930830 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd0f13-ff15-49a5-9ae8-7489b7958b30 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:10.951869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 273/532] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:10.952634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd0f13-ff15-49a5-9ae8-7489b7958b30 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:10.979124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a153fe-9fa9-4f00-82aa-42d6bd84723e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:10.980625 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a153fe-9fa9-4f00-82aa-42d6bd84723e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:11.053264 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd0f13-ff15-49a5-9ae8-7489b7958b30 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:11.086624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 260/533] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:29:11.087723 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a153fe-9fa9-4f00-82aa-42d6bd84723e None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:11.090110 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc341a-eec5-4cf6-9149-b97b4ffa5fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:11.091011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc341a-eec5-4cf6-9149-b97b4ffa5fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:11.091571 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc341a-eec5-4cf6-9149-b97b4ffa5fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:11.092022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc341a-eec5-4cf6-9149-b97b4ffa5fa2 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:11.092980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc341a-eec5-4cf6-9149-b97b4ffa5fa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:11.093460 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc341a-eec5-4cf6-9149-b97b4ffa5fa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:11.095119 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc341a-eec5-4cf6-9149-b97b4ffa5fa2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:11.106941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 274/534] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:11.108273 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc341a-eec5-4cf6-9149-b97b4ffa5fa2 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:11.205872 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a153fe-9fa9-4f00-82aa-42d6bd84723e None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:11.212671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc341a-eec5-4cf6-9149-b97b4ffa5fa2 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:11.248787 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ccd92-4db9-492c-9f90-aa8e2d2f6536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:11.249437 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ccd92-4db9-492c-9f90-aa8e2d2f6536 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:11.249716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ccd92-4db9-492c-9f90-aa8e2d2f6536 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:11.249989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ccd92-4db9-492c-9f90-aa8e2d2f6536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:11.250864 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ccd92-4db9-492c-9f90-aa8e2d2f6536 None admin] RBAC: Adding query filter params (role.id=511b62180d4c4881999e65dfab877783, scope.project.id=745af7d676704a179668d6685724ed78, user.id=1a003b6145fb4c5c8919020d9208afa7) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:11.251172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ccd92-4db9-492c-9f90-aa8e2d2f6536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:11.252650 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ccd92-4db9-492c-9f90-aa8e2d2f6536 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:11.254868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43444b08-7d39-40b2-a9ed-727637a5c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:11.256485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43444b08-7d39-40b2-a9ed-727637a5c4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:11.257055 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43444b08-7d39-40b2-a9ed-727637a5c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:11.257527 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43444b08-7d39-40b2-a9ed-727637a5c4c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:11.267595 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 261/535] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:11 2022] GET /identity/v3/role_assignments?user.id=1a003b6145fb4c5c8919020d9208afa7&scope.project.id=745af7d676704a179668d6685724ed78&role.id=511b62180d4c4881999e65dfab877783 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:11.268288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ccd92-4db9-492c-9f90-aa8e2d2f6536 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:11.270285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43444b08-7d39-40b2-a9ed-727637a5c4c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:11.272256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43444b08-7d39-40b2-a9ed-727637a5c4c3 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-43444b08-7d39-40b2-a9ed-727637a5c4c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:11.292827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:11.293743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:11.294701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:11.294701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:11.294701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:11.294701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:11.297857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 275/536] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:11.304775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43444b08-7d39-40b2-a9ed-727637a5c4c3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:11.421820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43444b08-7d39-40b2-a9ed-727637a5c4c3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:11.458796 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe25a6-ed3a-4c3c-876d-1f6fba1852a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:11.459799 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe25a6-ed3a-4c3c-876d-1f6fba1852a9 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:11.460304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe25a6-ed3a-4c3c-876d-1f6fba1852a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:11.460774 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe25a6-ed3a-4c3c-876d-1f6fba1852a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:11.461726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe25a6-ed3a-4c3c-876d-1f6fba1852a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:11.462235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe25a6-ed3a-4c3c-876d-1f6fba1852a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:11.463853 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe25a6-ed3a-4c3c-876d-1f6fba1852a9 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:11.477366 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 276/537] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:11.482976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe25a6-ed3a-4c3c-876d-1f6fba1852a9 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:11.490300 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ccd92-4db9-492c-9f90-aa8e2d2f6536 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:11.577749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cae99-a718-4330-b7db-a94c4f8c630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:11.578417 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cae99-a718-4330-b7db-a94c4f8c630b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:11.578705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cae99-a718-4330-b7db-a94c4f8c630b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:11.578981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cae99-a718-4330-b7db-a94c4f8c630b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:11.579818 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cae99-a718-4330-b7db-a94c4f8c630b None admin] RBAC: Adding query filter params (role.id=511b62180d4c4881999e65dfab877783, scope.project.id=745af7d676704a179668d6685724ed78, user.id=7ffc2e3a517e48c4bf368bdc0dd18ba7) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:11.580708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cae99-a718-4330-b7db-a94c4f8c630b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:11.582372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cae99-a718-4330-b7db-a94c4f8c630b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:11.590400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe25a6-ed3a-4c3c-876d-1f6fba1852a9 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:11.593828 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 262/538] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:11 2022] GET /identity/v3/role_assignments?user.id=7ffc2e3a517e48c4bf368bdc0dd18ba7&scope.project.id=745af7d676704a179668d6685724ed78&role.id=511b62180d4c4881999e65dfab877783 => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:11.630039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a2a00-4af8-4f2e-ac50-a87942d18221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:11.631268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a2a00-4af8-4f2e-ac50-a87942d18221 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:11.631761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a2a00-4af8-4f2e-ac50-a87942d18221 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:11.632239 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a2a00-4af8-4f2e-ac50-a87942d18221 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:11.640921 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a2a00-4af8-4f2e-ac50-a87942d18221 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:11.643638 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a2a00-4af8-4f2e-ac50-a87942d18221 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-174a2a00-4af8-4f2e-ac50-a87942d18221 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:11.659932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:11.660857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:11.661698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:11.661698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:11.661698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:11.661698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:11.661698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:11.661698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:11.661698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:11.661698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:11.664461 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 277/539] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:11.670627 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cae99-a718-4330-b7db-a94c4f8c630b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:11.779453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cae99-a718-4330-b7db-a94c4f8c630b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:11.816598 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fde82-1740-4a25-aa17-de48a4824c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:11.817681 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fde82-1740-4a25-aa17-de48a4824c9d None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:11.818166 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fde82-1740-4a25-aa17-de48a4824c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:11.818641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fde82-1740-4a25-aa17-de48a4824c9d None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:11.819699 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fde82-1740-4a25-aa17-de48a4824c9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:11.820250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fde82-1740-4a25-aa17-de48a4824c9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:11.821908 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fde82-1740-4a25-aa17-de48a4824c9d None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:11.835384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 263/540] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:11.841629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a2a00-4af8-4f2e-ac50-a87942d18221 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:11.948560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a2a00-4af8-4f2e-ac50-a87942d18221 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:11.993441 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b4335-1c34-416e-b696-d096981ad3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:11.994491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b4335-1c34-416e-b696-d096981ad3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:11.994984 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b4335-1c34-416e-b696-d096981ad3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:11.995449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b4335-1c34-416e-b696-d096981ad3b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:11.996466 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b4335-1c34-416e-b696-d096981ad3b8 None admin] RBAC: Adding query filter params (role.id=511b62180d4c4881999e65dfab877783, scope.project.id=745af7d676704a179668d6685724ed78, user.id=731d9124a2294b95a7cf1127e5362b66) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:11.996996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b4335-1c34-416e-b696-d096981ad3b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:11.998631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b4335-1c34-416e-b696-d096981ad3b8 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:12.011054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 278/541] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:11 2022] GET /identity/v3/role_assignments?user.id=731d9124a2294b95a7cf1127e5362b66&scope.project.id=745af7d676704a179668d6685724ed78&role.id=511b62180d4c4881999e65dfab877783 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:12.862173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55fd77-fedf-4bab-a520-c388fc5096ee None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:12.862716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55fd77-fedf-4bab-a520-c388fc5096ee None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:12.862830 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55fd77-fedf-4bab-a520-c388fc5096ee None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:12.864431 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 264/542] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:12.869787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174fc03-d796-4b74-8541-1cc9aeda67fe None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:12.870074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174fc03-d796-4b74-8541-1cc9aeda67fe None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:12.870353 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174fc03-d796-4b74-8541-1cc9aeda67fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:12.895682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-d174fc03-d796-4b74-8541-1cc9aeda67fe None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:12.896892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d174fc03-d796-4b74-8541-1cc9aeda67fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:12.985176 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 279/543] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:13.033646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55fd77-fedf-4bab-a520-c388fc5096ee None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:13.178598 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55fd77-fedf-4bab-a520-c388fc5096ee None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:13.223907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0976dec-3569-474e-b2bf-60bb3ba3cc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:13.225096 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976dec-3569-474e-b2bf-60bb3ba3cc04 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:13.225573 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976dec-3569-474e-b2bf-60bb3ba3cc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:13.226052 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976dec-3569-474e-b2bf-60bb3ba3cc04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:13.238126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0976dec-3569-474e-b2bf-60bb3ba3cc04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-c0976dec-3569-474e-b2bf-60bb3ba3cc04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:13.246281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:13.247205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:13.248023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:13.248023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:13.248023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:13.248023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:13.248023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:13.248023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:13.248023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:13.248023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:13.248023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:13.248023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:13.248023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:13.248023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:13.248023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 265/544] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:13.254402 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174fc03-d796-4b74-8541-1cc9aeda67fe None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:13.442887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174fc03-d796-4b74-8541-1cc9aeda67fe None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:13.488819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d9f92-7d89-4acc-bfcd-108edbef0e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:13.489484 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d9f92-7d89-4acc-bfcd-108edbef0e3e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:13.489761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d9f92-7d89-4acc-bfcd-108edbef0e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:13.490027 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d9f92-7d89-4acc-bfcd-108edbef0e3e None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:13.490788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d9f92-7d89-4acc-bfcd-108edbef0e3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:13.491235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d9f92-7d89-4acc-bfcd-108edbef0e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:13.492596 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d9f92-7d89-4acc-bfcd-108edbef0e3e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:13.506148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 280/545] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:13.511761 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0976dec-3569-474e-b2bf-60bb3ba3cc04 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:13.658462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0976dec-3569-474e-b2bf-60bb3ba3cc04 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:13.698466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d5a82-9c20-465b-baf1-45399d778210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:13.699251 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d5a82-9c20-465b-baf1-45399d778210 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:13.699529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d5a82-9c20-465b-baf1-45399d778210 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:13.699847 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d5a82-9c20-465b-baf1-45399d778210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:13.716606 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d5a82-9c20-465b-baf1-45399d778210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:13.718094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d5a82-9c20-465b-baf1-45399d778210 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:13.729061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb40d82-973a-4f09-9501-d5056f70bca7 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:13.729393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb40d82-973a-4f09-9501-d5056f70bca7 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:13.729614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb40d82-973a-4f09-9501-d5056f70bca7 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:13.732202 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 281/546] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:13.738126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3f223-5d02-4336-b0e4-d689fa17eb8d None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:13.738455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3f223-5d02-4336-b0e4-d689fa17eb8d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:13.738703 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3f223-5d02-4336-b0e4-d689fa17eb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-b53d5a82-9c20-465b-baf1-45399d778210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:13.748277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:13.749256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:13.750167 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:13.750167 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:13.750167 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:13.750167 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:13.754857 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 266/547] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:13.755780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d5a82-9c20-465b-baf1-45399d778210 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:13.772869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-aae3f223-5d02-4336-b0e4-d689fa17eb8d None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:13.774071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-aae3f223-5d02-4336-b0e4-d689fa17eb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:13.879713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 282/548] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:29:13.913571 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a11127-f2d3-4798-9848-acd5ab7c468a None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:13.913899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a11127-f2d3-4798-9848-acd5ab7c468a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:13.914116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a11127-f2d3-4798-9848-acd5ab7c468a None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:13.916063 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 283/549] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:29:13.922251 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7aea7-3d6e-4c97-a7ba-eca79f48f633 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:13.922847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7aea7-3d6e-4c97-a7ba-eca79f48f633 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:13.923388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7aea7-3d6e-4c97-a7ba-eca79f48f633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:13.924107 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d5a82-9c20-465b-baf1-45399d778210 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:13.942771 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-1fa7aea7-3d6e-4c97-a7ba-eca79f48f633 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:13.944323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-1fa7aea7-3d6e-4c97-a7ba-eca79f48f633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:13.958766 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2066916-5e85-4dbb-a51d-7ed9c26b3ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:13.959365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066916-5e85-4dbb-a51d-7ed9c26b3ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:13.959734 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066916-5e85-4dbb-a51d-7ed9c26b3ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:13.960012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066916-5e85-4dbb-a51d-7ed9c26b3ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:13.960907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2066916-5e85-4dbb-a51d-7ed9c26b3ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:13.961217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2066916-5e85-4dbb-a51d-7ed9c26b3ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:13.963518 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2066916-5e85-4dbb-a51d-7ed9c26b3ac0 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:13.985910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 267/550] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:13.987041 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2066916-5e85-4dbb-a51d-7ed9c26b3ac0 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:14.019179 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 284/551] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:29:14.020671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7aea7-3d6e-4c97-a7ba-eca79f48f633 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:14.110037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2066916-5e85-4dbb-a51d-7ed9c26b3ac0 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:14.123771 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7aea7-3d6e-4c97-a7ba-eca79f48f633 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:14.161005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b430058-0280-451f-8dee-930ae936f263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:14.161817 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b430058-0280-451f-8dee-930ae936f263 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:14.162262 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b430058-0280-451f-8dee-930ae936f263 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:14.162730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b430058-0280-451f-8dee-930ae936f263 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:14.163952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69d330-2997-418d-b754-b3a30d3ec30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:14.165057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69d330-2997-418d-b754-b3a30d3ec30c None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:14.165544 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69d330-2997-418d-b754-b3a30d3ec30c None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:14.166013 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69d330-2997-418d-b754-b3a30d3ec30c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:14.173855 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69d330-2997-418d-b754-b3a30d3ec30c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:14.174853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b430058-0280-451f-8dee-930ae936f263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:14.176343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69d330-2997-418d-b754-b3a30d3ec30c None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-4b430058-0280-451f-8dee-930ae936f263 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:14.184023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:14.184930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:14.185725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:14.185725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:14.185725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:14.185725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:14.185725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:14.185725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:14.185725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:14.185725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:14.185725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:14.185725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:14.185725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:14.185725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:14.190696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 268/552] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:14.191583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b430058-0280-451f-8dee-930ae936f263 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-5f69d330-2997-418d-b754-b3a30d3ec30c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:14.195819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:14.196693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:14.197580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:14.197580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:14.197580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:14.197580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:14.197580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:14.197580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:14.197580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:14.197580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:14.197580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 17:29:14.197580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:14.200129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 285/553] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:29:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:14.201076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69d330-2997-418d-b754-b3a30d3ec30c None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:14.321041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69d330-2997-418d-b754-b3a30d3ec30c None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:14.324615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b430058-0280-451f-8dee-930ae936f263 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:14.358331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962cb3f-6a19-4223-8dcd-792e442983af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:14.359042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962cb3f-6a19-4223-8dcd-792e442983af None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:14.359328 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962cb3f-6a19-4223-8dcd-792e442983af None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:14.359605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962cb3f-6a19-4223-8dcd-792e442983af None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:14.360438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962cb3f-6a19-4223-8dcd-792e442983af None admin] RBAC: Adding query filter params (name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:14.360748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962cb3f-6a19-4223-8dcd-792e442983af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:14.362246 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962cb3f-6a19-4223-8dcd-792e442983af None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:14.362351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16ef98-fb40-4ed8-90df-9878314b00ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:14.363181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16ef98-fb40-4ed8-90df-9878314b00ed None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:14.363665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16ef98-fb40-4ed8-90df-9878314b00ed None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:14.363942 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16ef98-fb40-4ed8-90df-9878314b00ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:14.370703 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 286/554] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:14.375841 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962cb3f-6a19-4223-8dcd-792e442983af None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:14.377339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16ef98-fb40-4ed8-90df-9878314b00ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-9e16ef98-fb40-4ed8-90df-9878314b00ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:14.385898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:14.386983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:14.388119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:14.388119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:14.388119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:14.388119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:14.388119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:14.388119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:14.388119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:14.388119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:14.388119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:14.388119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:14.388119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:14.388119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:14.388119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 269/555] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:14.388937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2256224-1613-480b-b9ff-0f97d537cd43 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:14.388937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2256224-1613-480b-b9ff-0f97d537cd43 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:14.389145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2256224-1613-480b-b9ff-0f97d537cd43 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:14.390534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 270/556] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:14.391083 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2256224-1613-480b-b9ff-0f97d537cd43 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:14.483922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962cb3f-6a19-4223-8dcd-792e442983af None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:14.493562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2256224-1613-480b-b9ff-0f97d537cd43 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:14.519327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10146348-a9bc-4c8a-83db-2b3eecb3d73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:14.520365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10146348-a9bc-4c8a-83db-2b3eecb3d73d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:14.520862 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10146348-a9bc-4c8a-83db-2b3eecb3d73d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:14.521347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10146348-a9bc-4c8a-83db-2b3eecb3d73d None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:14.522400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10146348-a9bc-4c8a-83db-2b3eecb3d73d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:14.522938 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10146348-a9bc-4c8a-83db-2b3eecb3d73d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:14.524562 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10146348-a9bc-4c8a-83db-2b3eecb3d73d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:14.527090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127c2ad-cb33-4c44-aece-b3536a2151d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:14.527880 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127c2ad-cb33-4c44-aece-b3536a2151d4 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:14.528157 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127c2ad-cb33-4c44-aece-b3536a2151d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:14.528426 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127c2ad-cb33-4c44-aece-b3536a2151d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:14.538817 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127c2ad-cb33-4c44-aece-b3536a2151d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:14.540263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127c2ad-cb33-4c44-aece-b3536a2151d4 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:14.542975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 287/557] 10.222.0.76 () {56 vars in 1135 bytes} [Thu May 12 17:29:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:14.544038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10146348-a9bc-4c8a-83db-2b3eecb3d73d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-5127c2ad-cb33-4c44-aece-b3536a2151d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:14.558206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:14.559168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:14.560326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:14.560326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:14.560326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:14.560326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:14.560326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 271/558] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:14.560650 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664e23f-e2d2-45a4-8329-dda99f7a12f5 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:14.565796 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664e23f-e2d2-45a4-8329-dda99f7a12f5 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:14.565796 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664e23f-e2d2-45a4-8329-dda99f7a12f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:14.577856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-4664e23f-e2d2-45a4-8329-dda99f7a12f5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:14.579082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4664e23f-e2d2-45a4-8329-dda99f7a12f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:14.654704 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 272/559] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:14.654704 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664e23f-e2d2-45a4-8329-dda99f7a12f5 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:14.662499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10146348-a9bc-4c8a-83db-2b3eecb3d73d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:14.704136 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc2b9f-8efc-4673-9a47-9506c544086f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:14.705336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc2b9f-8efc-4673-9a47-9506c544086f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:14.705853 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc2b9f-8efc-4673-9a47-9506c544086f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:14.706205 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc2b9f-8efc-4673-9a47-9506c544086f None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:14.707016 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc2b9f-8efc-4673-9a47-9506c544086f None admin] RBAC: Adding query filter params (name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:14.707323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc2b9f-8efc-4673-9a47-9506c544086f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:14.708721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc2b9f-8efc-4673-9a47-9506c544086f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:14.718836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 288/560] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:14.720900 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc2b9f-8efc-4673-9a47-9506c544086f None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:14.750266 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664e23f-e2d2-45a4-8329-dda99f7a12f5 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:14.786153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962f5b8-2d5d-40d4-848f-0a8d017e4afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:14.786829 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962f5b8-2d5d-40d4-848f-0a8d017e4afa None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:14.787109 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962f5b8-2d5d-40d4-848f-0a8d017e4afa None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:14.787382 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962f5b8-2d5d-40d4-848f-0a8d017e4afa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:14.819529 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc2b9f-8efc-4673-9a47-9506c544086f None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:14.852120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962f5b8-2d5d-40d4-848f-0a8d017e4afa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:14.853087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b371cf-c842-4a46-a132-ec2c97a9fe6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:14.853595 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962f5b8-2d5d-40d4-848f-0a8d017e4afa None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:14.854187 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b371cf-c842-4a46-a132-ec2c97a9fe6b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:14.854653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b371cf-c842-4a46-a132-ec2c97a9fe6b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:14.855136 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b371cf-c842-4a46-a132-ec2c97a9fe6b None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:14.856064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b371cf-c842-4a46-a132-ec2c97a9fe6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:14.856371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b371cf-c842-4a46-a132-ec2c97a9fe6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:14.857791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b371cf-c842-4a46-a132-ec2c97a9fe6b None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:14.871509 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 289/561] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:14.872391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b371cf-c842-4a46-a132-ec2c97a9fe6b None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:14.949043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 273/562] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:29:14.949956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962f5b8-2d5d-40d4-848f-0a8d017e4afa None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:14.971223 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b371cf-c842-4a46-a132-ec2c97a9fe6b None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:15.003394 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadaeab-193c-47ca-8e9f-40111b9b34a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:15.004104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadaeab-193c-47ca-8e9f-40111b9b34a9 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.004384 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadaeab-193c-47ca-8e9f-40111b9b34a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.004666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadaeab-193c-47ca-8e9f-40111b9b34a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.014380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadaeab-193c-47ca-8e9f-40111b9b34a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-9aadaeab-193c-47ca-8e9f-40111b9b34a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:15.022140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:15.023521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:15.024333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:15.024333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:15.024333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:15.024333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:15.024333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:15.024333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:15.024333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:15.024333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:15.024333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:15.024333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:15.024333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:15.024333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:15.024333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 290/563] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:15.025011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b87f82-7150-4e40-a2c0-9541bfebff31 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.025588 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b87f82-7150-4e40-a2c0-9541bfebff31 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.025588 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b87f82-7150-4e40-a2c0-9541bfebff31 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.026782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 291/564] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:15.027455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b87f82-7150-4e40-a2c0-9541bfebff31 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:15.045191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962f5b8-2d5d-40d4-848f-0a8d017e4afa None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:15.077794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c582f-96be-41be-aa85-ec56b05273e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:15.078569 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c582f-96be-41be-aa85-ec56b05273e9 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.079140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c582f-96be-41be-aa85-ec56b05273e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.079140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c582f-96be-41be-aa85-ec56b05273e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.089271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c582f-96be-41be-aa85-ec56b05273e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:15.090760 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c582f-96be-41be-aa85-ec56b05273e9 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-596c582f-96be-41be-aa85-ec56b05273e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:15.108439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:15.109505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:15.111030 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:15.111030 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:15.111030 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:15.111030 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:15.111030 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 274/565] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:15.111030 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c582f-96be-41be-aa85-ec56b05273e9 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:15.125946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b87f82-7150-4e40-a2c0-9541bfebff31 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:15.158488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db50a9-2a34-4edc-8fb7-038491976b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:15.159392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db50a9-2a34-4edc-8fb7-038491976b8d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.159675 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db50a9-2a34-4edc-8fb7-038491976b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.159945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db50a9-2a34-4edc-8fb7-038491976b8d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.168140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db50a9-2a34-4edc-8fb7-038491976b8d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:15.169782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db50a9-2a34-4edc-8fb7-038491976b8d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-16db50a9-2a34-4edc-8fb7-038491976b8d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:15.184085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:15.185066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:15.186919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:15.186919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:15.186919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:15.186919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:15.186919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:15.186919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:15.186919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:15.186919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:15.186919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 17:29:15.186919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:15.186919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 292/566] 10.222.0.76 () {56 vars in 1093 bytes} [Thu May 12 17:29:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:15.186919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db50a9-2a34-4edc-8fb7-038491976b8d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:15.205063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c582f-96be-41be-aa85-ec56b05273e9 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:15.242004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c036c-8460-4fa4-9ba0-c09723b79f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:15.242831 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c036c-8460-4fa4-9ba0-c09723b79f5f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.243105 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c036c-8460-4fa4-9ba0-c09723b79f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.243371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c036c-8460-4fa4-9ba0-c09723b79f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.253627 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c036c-8460-4fa4-9ba0-c09723b79f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:15.255041 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c036c-8460-4fa4-9ba0-c09723b79f5f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-df0c036c-8460-4fa4-9ba0-c09723b79f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:15.273010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:15.274089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:15.275044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:15.275044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:15.275044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:15.275044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:15.275044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 275/567] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:15.275354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b74b-f8d6-4ba0-a78e-d44e6ff2f313 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.275630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b74b-f8d6-4ba0-a78e-d44e6ff2f313 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.275908 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b74b-f8d6-4ba0-a78e-d44e6ff2f313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.282516 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db50a9-2a34-4edc-8fb7-038491976b8d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:15.292681 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-9f60b74b-f8d6-4ba0-a78e-d44e6ff2f313 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:15.293845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9f60b74b-f8d6-4ba0-a78e-d44e6ff2f313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:15.315909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5495f10-b5c0-4364-a494-2cc726b53799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:15.316565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5495f10-b5c0-4364-a494-2cc726b53799 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.316847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5495f10-b5c0-4364-a494-2cc726b53799 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.317115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5495f10-b5c0-4364-a494-2cc726b53799 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.317849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5495f10-b5c0-4364-a494-2cc726b53799 None admin] RBAC: Adding query filter params (name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:15.318149 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5495f10-b5c0-4364-a494-2cc726b53799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:15.319541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5495f10-b5c0-4364-a494-2cc726b53799 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:15.327003 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 293/568] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:15.327776 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5495f10-b5c0-4364-a494-2cc726b53799 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:15.358650 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 276/569] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:15.359485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b74b-f8d6-4ba0-a78e-d44e6ff2f313 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:15.424901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5495f10-b5c0-4364-a494-2cc726b53799 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:15.452884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b74b-f8d6-4ba0-a78e-d44e6ff2f313 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:15.457007 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abd0dd-f5d8-4687-ba7e-1c70d8e728fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:15.457656 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd0dd-f5d8-4687-ba7e-1c70d8e728fc None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.457930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd0dd-f5d8-4687-ba7e-1c70d8e728fc None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.458197 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd0dd-f5d8-4687-ba7e-1c70d8e728fc None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.458934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abd0dd-f5d8-4687-ba7e-1c70d8e728fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:15.459234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abd0dd-f5d8-4687-ba7e-1c70d8e728fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:15.460581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abd0dd-f5d8-4687-ba7e-1c70d8e728fc None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:15.472806 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 294/570] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:15.473588 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abd0dd-f5d8-4687-ba7e-1c70d8e728fc None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:15.486479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86c09a-610c-4022-8180-d7395c951b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:15.487144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86c09a-610c-4022-8180-d7395c951b41 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.487420 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86c09a-610c-4022-8180-d7395c951b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.487688 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86c09a-610c-4022-8180-d7395c951b41 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.488521 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86c09a-610c-4022-8180-d7395c951b41 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:15.488826 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86c09a-610c-4022-8180-d7395c951b41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:15.490264 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86c09a-610c-4022-8180-d7395c951b41 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:15.507465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 277/571] 10.222.0.76 () {56 vars in 1133 bytes} [Thu May 12 17:29:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:15.508186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86c09a-610c-4022-8180-d7395c951b41 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:15.583992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abd0dd-f5d8-4687-ba7e-1c70d8e728fc None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:15.603893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86c09a-610c-4022-8180-d7395c951b41 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:15.615964 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4285-e9e6-406d-bccf-26820c6017dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:15.616617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4285-e9e6-406d-bccf-26820c6017dc None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.616898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4285-e9e6-406d-bccf-26820c6017dc None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.617198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4285-e9e6-406d-bccf-26820c6017dc None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.617918 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb4285-e9e6-406d-bccf-26820c6017dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:15.618224 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb4285-e9e6-406d-bccf-26820c6017dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:15.619615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb4285-e9e6-406d-bccf-26820c6017dc None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:15.631022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 295/572] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:15.631808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4285-e9e6-406d-bccf-26820c6017dc None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:15.637580 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f765661-a59f-4d35-b75b-a6dd81ef4b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:15.638363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f765661-a59f-4d35-b75b-a6dd81ef4b06 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.638640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f765661-a59f-4d35-b75b-a6dd81ef4b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.638938 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f765661-a59f-4d35-b75b-a6dd81ef4b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.649437 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f765661-a59f-4d35-b75b-a6dd81ef4b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:15.650941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f765661-a59f-4d35-b75b-a6dd81ef4b06 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-1f765661-a59f-4d35-b75b-a6dd81ef4b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:15.667963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:15.669412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:15.670315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:15.670315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:15.670315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:15.670315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:15.670315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 278/573] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:15.670315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f765661-a59f-4d35-b75b-a6dd81ef4b06 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:15.728045 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4285-e9e6-406d-bccf-26820c6017dc None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:15.759874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c85026-23c0-4ed5-b703-b0d484f81e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:15.760588 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85026-23c0-4ed5-b703-b0d484f81e71 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.760871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85026-23c0-4ed5-b703-b0d484f81e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.761146 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85026-23c0-4ed5-b703-b0d484f81e71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.764137 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f765661-a59f-4d35-b75b-a6dd81ef4b06 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:15.771629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c85026-23c0-4ed5-b703-b0d484f81e71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-93c85026-23c0-4ed5-b703-b0d484f81e71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:15.779177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:15.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:15.781155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:15.781155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:15.781155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:15.781155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:15.781155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:15.781155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:15.781155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:15.781155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:15.781155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:15.781155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:15.781155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:15.781155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:15.781155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 296/574] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:15.781155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c85026-23c0-4ed5-b703-b0d484f81e71 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:15.801657 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca39fc-b768-4565-8f16-568fbec697a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:15.802544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca39fc-b768-4565-8f16-568fbec697a6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.802861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca39fc-b768-4565-8f16-568fbec697a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.803135 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca39fc-b768-4565-8f16-568fbec697a6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.809997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca39fc-b768-4565-8f16-568fbec697a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:15.811468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca39fc-b768-4565-8f16-568fbec697a6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-c8ca39fc-b768-4565-8f16-568fbec697a6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:15.826038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:15.827095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:15.828211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:15.828211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:15.828211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:15.828211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:15.828211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:15.828211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:15.828211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:15.828211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:15.828211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 17:29:15.828211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:15.828211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 279/575] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:29:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:15.828211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca39fc-b768-4565-8f16-568fbec697a6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:15.887181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c85026-23c0-4ed5-b703-b0d484f81e71 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:15.919129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcbc4b-502e-4fa3-a43a-8624c5c06844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:15.919903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcbc4b-502e-4fa3-a43a-8624c5c06844 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.920183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcbc4b-502e-4fa3-a43a-8624c5c06844 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.920454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcbc4b-502e-4fa3-a43a-8624c5c06844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.925729 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca39fc-b768-4565-8f16-568fbec697a6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:15.932290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcbc4b-502e-4fa3-a43a-8624c5c06844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:15.933750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcbc4b-502e-4fa3-a43a-8624c5c06844 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-8fbcbc4b-502e-4fa3-a43a-8624c5c06844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:15.950805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:15.951717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:15.952625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:15.952625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:15.952625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:15.952625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:15.952625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 297/576] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:15.952941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcbc4b-502e-4fa3-a43a-8624c5c06844 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:15.959949 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d150d06-2690-4f5f-9e82-620d45dcb647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:15.960736 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d150d06-2690-4f5f-9e82-620d45dcb647 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:15.961009 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d150d06-2690-4f5f-9e82-620d45dcb647 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:15.961276 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d150d06-2690-4f5f-9e82-620d45dcb647 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:15.967805 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d150d06-2690-4f5f-9e82-620d45dcb647 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:15.969230 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d150d06-2690-4f5f-9e82-620d45dcb647 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-4d150d06-2690-4f5f-9e82-620d45dcb647 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:15.983722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:15.984669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:15.985552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:15.985552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:15.985552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:15.985552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:15.985552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:15.985552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:15.985552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:15.985552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:15.985552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 280/577] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:15.986555 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d150d06-2690-4f5f-9e82-620d45dcb647 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:16.056533 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcbc4b-502e-4fa3-a43a-8624c5c06844 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:16.082813 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d150d06-2690-4f5f-9e82-620d45dcb647 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:16.088769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d958d-13d6-471e-94b6-4fc9563a107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:16.089430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d958d-13d6-471e-94b6-4fc9563a107d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:16.089706 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d958d-13d6-471e-94b6-4fc9563a107d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:16.089981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d958d-13d6-471e-94b6-4fc9563a107d None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:16.090727 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d958d-13d6-471e-94b6-4fc9563a107d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:16.091035 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d958d-13d6-471e-94b6-4fc9563a107d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:16.092400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d958d-13d6-471e-94b6-4fc9563a107d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:16.103657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 298/578] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:16.104451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d958d-13d6-471e-94b6-4fc9563a107d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:16.115425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f097f-740a-4f02-bca4-2f3312da620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:16.116089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f097f-740a-4f02-bca4-2f3312da620a None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:16.116370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f097f-740a-4f02-bca4-2f3312da620a None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:16.116644 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f097f-740a-4f02-bca4-2f3312da620a None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:16.117415 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f097f-740a-4f02-bca4-2f3312da620a None admin] RBAC: Adding query filter params (name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:16.117719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f097f-740a-4f02-bca4-2f3312da620a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:16.119138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f097f-740a-4f02-bca4-2f3312da620a None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:16.131423 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 281/579] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:16.132221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f097f-740a-4f02-bca4-2f3312da620a None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:16.212758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d958d-13d6-471e-94b6-4fc9563a107d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:16.249277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f097f-740a-4f02-bca4-2f3312da620a None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:16.255458 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf37ea-7be6-4124-8def-e6adee0df5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:16.256128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf37ea-7be6-4124-8def-e6adee0df5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:16.256410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf37ea-7be6-4124-8def-e6adee0df5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:16.256682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf37ea-7be6-4124-8def-e6adee0df5d6 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:16.257519 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf37ea-7be6-4124-8def-e6adee0df5d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:16.257826 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf37ea-7be6-4124-8def-e6adee0df5d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:16.259564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf37ea-7be6-4124-8def-e6adee0df5d6 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:16.276847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 299/580] 10.222.0.76 () {56 vars in 1137 bytes} [Thu May 12 17:29:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:16.277656 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf37ea-7be6-4124-8def-e6adee0df5d6 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:16.291392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50085e-4bb2-4f48-91b8-82f646fdf2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:16.292060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50085e-4bb2-4f48-91b8-82f646fdf2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:16.292328 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50085e-4bb2-4f48-91b8-82f646fdf2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:16.292605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50085e-4bb2-4f48-91b8-82f646fdf2b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:16.293329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50085e-4bb2-4f48-91b8-82f646fdf2b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:16.293634 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50085e-4bb2-4f48-91b8-82f646fdf2b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:16.295079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50085e-4bb2-4f48-91b8-82f646fdf2b7 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:16.307670 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 282/581] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:16.308388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50085e-4bb2-4f48-91b8-82f646fdf2b7 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:16.409811 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf37ea-7be6-4124-8def-e6adee0df5d6 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:16.413436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50085e-4bb2-4f48-91b8-82f646fdf2b7 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:16.447267 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cba23-353d-4725-9e33-76bee5b2a0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:16.448059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cba23-353d-4725-9e33-76bee5b2a0be None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:16.448339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cba23-353d-4725-9e33-76bee5b2a0be None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:16.448614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cba23-353d-4725-9e33-76bee5b2a0be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:16.452985 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23aeca-7e93-4cae-8797-84d3ef1328d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:16.453639 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23aeca-7e93-4cae-8797-84d3ef1328d8 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:16.453912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23aeca-7e93-4cae-8797-84d3ef1328d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:16.454211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23aeca-7e93-4cae-8797-84d3ef1328d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:16.455845 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23aeca-7e93-4cae-8797-84d3ef1328d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:16.456155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23aeca-7e93-4cae-8797-84d3ef1328d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:16.456644 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cba23-353d-4725-9e33-76bee5b2a0be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:16.457587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23aeca-7e93-4cae-8797-84d3ef1328d8 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:16.459393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cba23-353d-4725-9e33-76bee5b2a0be None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:16.472250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 300/582] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:16.472970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23aeca-7e93-4cae-8797-84d3ef1328d8 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-d34cba23-353d-4725-9e33-76bee5b2a0be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:16.478196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:16.479601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:16.480737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:16.480737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:16.480737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:16.480737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:16.480737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:16.480737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:16.480737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:16.480737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:16.480737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 17:29:16.480737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:16.483122 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 283/583] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:29:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:16.484005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cba23-353d-4725-9e33-76bee5b2a0be None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:16.584132 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23aeca-7e93-4cae-8797-84d3ef1328d8 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:16.585744 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cba23-353d-4725-9e33-76bee5b2a0be None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:16.616266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15990d96-7b64-45fa-a323-eeef2bdd5841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:16.617053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15990d96-7b64-45fa-a323-eeef2bdd5841 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:16.617355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15990d96-7b64-45fa-a323-eeef2bdd5841 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:16.617637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15990d96-7b64-45fa-a323-eeef2bdd5841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:16.618617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3620733-37ff-4338-a69a-b2ede00bbe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:16.619424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3620733-37ff-4338-a69a-b2ede00bbe77 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:16.619695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3620733-37ff-4338-a69a-b2ede00bbe77 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:16.619958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3620733-37ff-4338-a69a-b2ede00bbe77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:16.627823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15990d96-7b64-45fa-a323-eeef2bdd5841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:16.629273 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15990d96-7b64-45fa-a323-eeef2bdd5841 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:16.629643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3620733-37ff-4338-a69a-b2ede00bbe77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:16.631086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3620733-37ff-4338-a69a-b2ede00bbe77 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-15990d96-7b64-45fa-a323-eeef2bdd5841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:16.646196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:16.647210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:16.648106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:16.648106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:16.648106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:16.648106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:16.648106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 301/584] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:16.648389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15990d96-7b64-45fa-a323-eeef2bdd5841 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-b3620733-37ff-4338-a69a-b2ede00bbe77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:16.648464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:16.649279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:16.650182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:16.650182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:16.650182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:16.650182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:16.650182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 284/585] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:16.650463 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3620733-37ff-4338-a69a-b2ede00bbe77 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:16.746037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3620733-37ff-4338-a69a-b2ede00bbe77 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:16.746275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15990d96-7b64-45fa-a323-eeef2bdd5841 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:16.778575 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1d702-81bf-4197-a8d7-8cecaf83e98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:16.779126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dc7fa-a731-4448-9def-f241b1dfa0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:16.779245 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1d702-81bf-4197-a8d7-8cecaf83e98c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:16.779505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1d702-81bf-4197-a8d7-8cecaf83e98c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:16.779772 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1d702-81bf-4197-a8d7-8cecaf83e98c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:16.779899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dc7fa-a731-4448-9def-f241b1dfa0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:16.780173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dc7fa-a731-4448-9def-f241b1dfa0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:16.780447 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dc7fa-a731-4448-9def-f241b1dfa0b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:16.780585 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1d702-81bf-4197-a8d7-8cecaf83e98c None admin] RBAC: Adding query filter params (role.id=511b62180d4c4881999e65dfab877783, scope.project.id=745af7d676704a179668d6685724ed78, user.id=0e679573cc984993b98e416fabd586d4) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:16.780887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1d702-81bf-4197-a8d7-8cecaf83e98c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:16.782298 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1d702-81bf-4197-a8d7-8cecaf83e98c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:16.787652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dc7fa-a731-4448-9def-f241b1dfa0b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:16.787789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 285/586] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:16 2022] GET /identity/v3/role_assignments?user.id=0e679573cc984993b98e416fabd586d4&scope.project.id=745af7d676704a179668d6685724ed78&role.id=511b62180d4c4881999e65dfab877783 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:16.788406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1d702-81bf-4197-a8d7-8cecaf83e98c None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:16.789076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dc7fa-a731-4448-9def-f241b1dfa0b1 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-dc4dc7fa-a731-4448-9def-f241b1dfa0b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:16.804710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:16.805747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:16.806643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:16.806643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:16.806643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:16.806643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:16.806643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:16.806643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:16.806643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:16.806643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:16.806643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 302/587] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:16.807215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dc7fa-a731-4448-9def-f241b1dfa0b1 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:16.904659 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1d702-81bf-4197-a8d7-8cecaf83e98c None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:16.914812 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dc7fa-a731-4448-9def-f241b1dfa0b1 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:16.940789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46786d5d-bb3f-45b3-bcec-01369e2dbcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:16.941460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46786d5d-bb3f-45b3-bcec-01369e2dbcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:16.941736 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46786d5d-bb3f-45b3-bcec-01369e2dbcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:16.942009 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46786d5d-bb3f-45b3-bcec-01369e2dbcc6 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:16.942887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46786d5d-bb3f-45b3-bcec-01369e2dbcc6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:16.943193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46786d5d-bb3f-45b3-bcec-01369e2dbcc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:16.944674 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46786d5d-bb3f-45b3-bcec-01369e2dbcc6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:16.951355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c54c1-db19-4e16-a6ab-a67b31a56fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:16.952034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c54c1-db19-4e16-a6ab-a67b31a56fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:16.952313 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c54c1-db19-4e16-a6ab-a67b31a56fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:16.952584 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c54c1-db19-4e16-a6ab-a67b31a56fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:16.953319 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c54c1-db19-4e16-a6ab-a67b31a56fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:16.953620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c54c1-db19-4e16-a6ab-a67b31a56fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:16.955724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c54c1-db19-4e16-a6ab-a67b31a56fe6 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:16.965598 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 286/588] 10.222.0.76 () {56 vars in 1137 bytes} [Thu May 12 17:29:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:16.967139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46786d5d-bb3f-45b3-bcec-01369e2dbcc6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:16.972474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 303/589] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:16.973376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c54c1-db19-4e16-a6ab-a67b31a56fe6 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:17.070474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46786d5d-bb3f-45b3-bcec-01369e2dbcc6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:17.072638 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c54c1-db19-4e16-a6ab-a67b31a56fe6 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:17.104829 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd9506-86da-43fe-9978-be4e5785735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:17.105497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd9506-86da-43fe-9978-be4e5785735d None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:17.105775 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd9506-86da-43fe-9978-be4e5785735d None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:17.106042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd9506-86da-43fe-9978-be4e5785735d None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:17.106712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd497ab-01f7-4d35-8ac6-db9039e20a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:17.106860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd9506-86da-43fe-9978-be4e5785735d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:17.107072 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd9506-86da-43fe-9978-be4e5785735d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:17.107793 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd497ab-01f7-4d35-8ac6-db9039e20a43 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:17.108221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd497ab-01f7-4d35-8ac6-db9039e20a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:17.108425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd9506-86da-43fe-9978-be4e5785735d None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:17.108800 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd497ab-01f7-4d35-8ac6-db9039e20a43 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:17.109774 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd497ab-01f7-4d35-8ac6-db9039e20a43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:17.110277 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd497ab-01f7-4d35-8ac6-db9039e20a43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:17.112005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd497ab-01f7-4d35-8ac6-db9039e20a43 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:17.119861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 287/590] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:17.120667 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd9506-86da-43fe-9978-be4e5785735d None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:17.124683 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 304/591] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:17.125715 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd497ab-01f7-4d35-8ac6-db9039e20a43 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:17.222995 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd9506-86da-43fe-9978-be4e5785735d None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:17.228194 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd497ab-01f7-4d35-8ac6-db9039e20a43 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:17.257742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c9353-42ad-4c1e-999d-5f18e9854e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:17.258820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9353-42ad-4c1e-999d-5f18e9854e84 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:17.259104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9353-42ad-4c1e-999d-5f18e9854e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:17.259388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9353-42ad-4c1e-999d-5f18e9854e84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:17.263200 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcdbc1-d0de-42cb-ab6b-9e0b95c08c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:17.264153 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcdbc1-d0de-42cb-ab6b-9e0b95c08c03 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:17.264580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcdbc1-d0de-42cb-ab6b-9e0b95c08c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:17.264996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcdbc1-d0de-42cb-ab6b-9e0b95c08c03 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:17.270286 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c9353-42ad-4c1e-999d-5f18e9854e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:17.271813 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c9353-42ad-4c1e-999d-5f18e9854e84 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:17.272946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fcdbc1-d0de-42cb-ab6b-9e0b95c08c03 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:17.274418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fcdbc1-d0de-42cb-ab6b-9e0b95c08c03 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-213c9353-42ad-4c1e-999d-5f18e9854e84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:17.289546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:17.291739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:17.292646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:17.292646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:17.292646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:17.292646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-a3fcdbc1-d0de-42cb-ab6b-9e0b95c08c03 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:17.292881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:17.293724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:17.294778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:17.294778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:17.294778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:17.294778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:17.294778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:17.294778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:17.294778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:17.294778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:17.294778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 17:29:17.294778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:17.296471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 288/592] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:17.296617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 305/593] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:17.296764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c9353-42ad-4c1e-999d-5f18e9854e84 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:17.296905 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcdbc1-d0de-42cb-ab6b-9e0b95c08c03 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:17.395471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c9353-42ad-4c1e-999d-5f18e9854e84 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:17.396737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcdbc1-d0de-42cb-ab6b-9e0b95c08c03 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:17.429868 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856ebf1-f5c6-46da-a184-04f2db730fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:17.430741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856ebf1-f5c6-46da-a184-04f2db730fcf None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:17.431026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856ebf1-f5c6-46da-a184-04f2db730fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:17.431296 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856ebf1-f5c6-46da-a184-04f2db730fcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:17.434721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359c12f-0b2c-49a9-9604-2db3eff2663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:17.435605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359c12f-0b2c-49a9-9604-2db3eff2663f None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:17.435883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359c12f-0b2c-49a9-9604-2db3eff2663f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:17.436156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359c12f-0b2c-49a9-9604-2db3eff2663f None admin] PATH_INFO: `/v3/projects/745af7d676704a179668d6685724ed78/users/04ad234318ad47589b844351cd3bb3e3/roles/511b62180d4c4881999e65dfab877783` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:17.437821 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856ebf1-f5c6-46da-a184-04f2db730fcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:17.439425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856ebf1-f5c6-46da-a184-04f2db730fcf None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:17.451572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359c12f-0b2c-49a9-9604-2db3eff2663f None admin] RBAC: Authorizing `identity:create_grant(project_id=745af7d676704a179668d6685724ed78, user_id=04ad234318ad47589b844351cd3bb3e3, role_id=511b62180d4c4881999e65dfab877783)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:17.453030 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359c12f-0b2c-49a9-9604-2db3eff2663f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-d856ebf1-f5c6-46da-a184-04f2db730fcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:17.453676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:17.454535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:17.455618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:17.455618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:17.455618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:17.455618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:17.455618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:17.455618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:17.455618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:17.455618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:17.455618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 289/594] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:17.456553 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856ebf1-f5c6-46da-a184-04f2db730fcf None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:17.467743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 306/595] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:29:17 2022] PUT /identity/v3/projects/745af7d676704a179668d6685724ed78/users/04ad234318ad47589b844351cd3bb3e3/roles/511b62180d4c4881999e65dfab877783 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:29:17.474786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359c12f-0b2c-49a9-9604-2db3eff2663f None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:17.587967 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359c12f-0b2c-49a9-9604-2db3eff2663f None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:17.590803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856ebf1-f5c6-46da-a184-04f2db730fcf None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:17.625836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44718094-dacf-4089-9da2-74c12395042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:17.626511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44718094-dacf-4089-9da2-74c12395042b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:17.626866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44718094-dacf-4089-9da2-74c12395042b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:17.627145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44718094-dacf-4089-9da2-74c12395042b None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:17.627695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acba973-b488-4ca5-a945-afe39b8660e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:17.627898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44718094-dacf-4089-9da2-74c12395042b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:17.628203 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44718094-dacf-4089-9da2-74c12395042b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:17.628682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acba973-b488-4ca5-a945-afe39b8660e3 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:17.629060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acba973-b488-4ca5-a945-afe39b8660e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:17.629432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acba973-b488-4ca5-a945-afe39b8660e3 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:17.629670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44718094-dacf-4089-9da2-74c12395042b None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:17.630475 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acba973-b488-4ca5-a945-afe39b8660e3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:17.631082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acba973-b488-4ca5-a945-afe39b8660e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:17.632744 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acba973-b488-4ca5-a945-afe39b8660e3 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:17.648306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 307/596] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:17.649273 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44718094-dacf-4089-9da2-74c12395042b None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:17.654066 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 290/597] 10.222.0.76 () {56 vars in 1139 bytes} [Thu May 12 17:29:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:17.655238 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acba973-b488-4ca5-a945-afe39b8660e3 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:17.759703 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44718094-dacf-4089-9da2-74c12395042b None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:17.771945 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acba973-b488-4ca5-a945-afe39b8660e3 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:17.793094 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9503f3c-4b13-4a1e-86d0-3ceed8614a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:17.793757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9503f3c-4b13-4a1e-86d0-3ceed8614a0b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:17.794038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9503f3c-4b13-4a1e-86d0-3ceed8614a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:17.794331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9503f3c-4b13-4a1e-86d0-3ceed8614a0b None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:17.795131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9503f3c-4b13-4a1e-86d0-3ceed8614a0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:17.795442 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9503f3c-4b13-4a1e-86d0-3ceed8614a0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:17.796992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9503f3c-4b13-4a1e-86d0-3ceed8614a0b None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:17.810832 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 308/598] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:17.811819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9503f3c-4b13-4a1e-86d0-3ceed8614a0b None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:17.826143 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ee411-6b6d-4703-8ab3-312b3bd7a9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:17.827605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee411-6b6d-4703-8ab3-312b3bd7a9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:17.827891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee411-6b6d-4703-8ab3-312b3bd7a9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:17.828218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee411-6b6d-4703-8ab3-312b3bd7a9a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:17.837933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ee411-6b6d-4703-8ab3-312b3bd7a9a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:17.839746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ee411-6b6d-4703-8ab3-312b3bd7a9a1 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-2f4ee411-6b6d-4703-8ab3-312b3bd7a9a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:17.857393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:17.858351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:17.859884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:17.859884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:17.859884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:17.859884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:17.859884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:17.859884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:17.859884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:17.859884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:17.859884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 291/599] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:17.859884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ee411-6b6d-4703-8ab3-312b3bd7a9a1 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:17.926646 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9503f3c-4b13-4a1e-86d0-3ceed8614a0b None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:17.962201 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f470e-0ef7-42a9-91b8-bf0d9ad96f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:17.963361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f470e-0ef7-42a9-91b8-bf0d9ad96f39 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:17.963845 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f470e-0ef7-42a9-91b8-bf0d9ad96f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:17.964340 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f470e-0ef7-42a9-91b8-bf0d9ad96f39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:17.970093 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ee411-6b6d-4703-8ab3-312b3bd7a9a1 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:17.976507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f470e-0ef7-42a9-91b8-bf0d9ad96f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:17.978245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f470e-0ef7-42a9-91b8-bf0d9ad96f39 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-409f470e-0ef7-42a9-91b8-bf0d9ad96f39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:17.997037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:17.997981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:17.998899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:17.998899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:17.998899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:17.998899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:18.001155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 309/600] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:18.002391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f470e-0ef7-42a9-91b8-bf0d9ad96f39 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:18.011973 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6798c7c-eba3-4dd4-91aa-6a37c0bc24b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:18.012782 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6798c7c-eba3-4dd4-91aa-6a37c0bc24b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:18.013061 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6798c7c-eba3-4dd4-91aa-6a37c0bc24b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:18.013322 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6798c7c-eba3-4dd4-91aa-6a37c0bc24b2 None admin] PATH_INFO: `/v3/projects/745af7d676704a179668d6685724ed78/users/1a003b6145fb4c5c8919020d9208afa7/roles/511b62180d4c4881999e65dfab877783` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:18.029361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6798c7c-eba3-4dd4-91aa-6a37c0bc24b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=745af7d676704a179668d6685724ed78, user_id=1a003b6145fb4c5c8919020d9208afa7, role_id=511b62180d4c4881999e65dfab877783)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:18.030942 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6798c7c-eba3-4dd4-91aa-6a37c0bc24b2 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:18.051505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 292/601] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:29:17 2022] PUT /identity/v3/projects/745af7d676704a179668d6685724ed78/users/1a003b6145fb4c5c8919020d9208afa7/roles/511b62180d4c4881999e65dfab877783 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:29:18.051910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6798c7c-eba3-4dd4-91aa-6a37c0bc24b2 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:18.123010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f470e-0ef7-42a9-91b8-bf0d9ad96f39 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:18.161482 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921b0ee-57cf-4639-b2f4-094432d97eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:18.162535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921b0ee-57cf-4639-b2f4-094432d97eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:18.163051 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921b0ee-57cf-4639-b2f4-094432d97eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:18.163601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921b0ee-57cf-4639-b2f4-094432d97eb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:18.164619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921b0ee-57cf-4639-b2f4-094432d97eb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:18.165196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921b0ee-57cf-4639-b2f4-094432d97eb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:18.166910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921b0ee-57cf-4639-b2f4-094432d97eb1 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:18.181177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 310/602] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:18.192524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921b0ee-57cf-4639-b2f4-094432d97eb1 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:18.270970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6798c7c-eba3-4dd4-91aa-6a37c0bc24b2 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:18.322716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e814e1-2198-4250-b894-c6dcd6a01b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:18.323398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e814e1-2198-4250-b894-c6dcd6a01b63 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:18.323950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e814e1-2198-4250-b894-c6dcd6a01b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:18.324235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e814e1-2198-4250-b894-c6dcd6a01b63 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:18.324972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e814e1-2198-4250-b894-c6dcd6a01b63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:18.325277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e814e1-2198-4250-b894-c6dcd6a01b63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:18.327291 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e814e1-2198-4250-b894-c6dcd6a01b63 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:18.345202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 293/603] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:18.350931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921b0ee-57cf-4639-b2f4-094432d97eb1 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:18.355180 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e814e1-2198-4250-b894-c6dcd6a01b63 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:18.386362 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f1762-f4de-4ed4-9aaa-fb2d35a5f22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:18.387711 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f1762-f4de-4ed4-9aaa-fb2d35a5f22f None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:18.388220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f1762-f4de-4ed4-9aaa-fb2d35a5f22f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:18.388751 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f1762-f4de-4ed4-9aaa-fb2d35a5f22f None admin] PATH_INFO: `/v3/projects/745af7d676704a179668d6685724ed78/users/7ffc2e3a517e48c4bf368bdc0dd18ba7/roles/511b62180d4c4881999e65dfab877783` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:18.404600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f1762-f4de-4ed4-9aaa-fb2d35a5f22f None admin] RBAC: Authorizing `identity:create_grant(project_id=745af7d676704a179668d6685724ed78, user_id=7ffc2e3a517e48c4bf368bdc0dd18ba7, role_id=511b62180d4c4881999e65dfab877783)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:18.406401 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f1762-f4de-4ed4-9aaa-fb2d35a5f22f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:18.423893 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 311/604] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:29:18 2022] PUT /identity/v3/projects/745af7d676704a179668d6685724ed78/users/7ffc2e3a517e48c4bf368bdc0dd18ba7/roles/511b62180d4c4881999e65dfab877783 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:29:18.531017 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e814e1-2198-4250-b894-c6dcd6a01b63 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:18.593000 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051d7e3-aadc-4027-83d7-ee034519f318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:18.593823 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051d7e3-aadc-4027-83d7-ee034519f318 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:18.594101 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051d7e3-aadc-4027-83d7-ee034519f318 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:18.594370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051d7e3-aadc-4027-83d7-ee034519f318 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:18.608601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051d7e3-aadc-4027-83d7-ee034519f318 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:18.610061 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051d7e3-aadc-4027-83d7-ee034519f318 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-c051d7e3-aadc-4027-83d7-ee034519f318 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:18.630325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:18.631329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:18.632235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:18.632235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:18.632235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:18.632235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:18.632235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:18.632235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:18.632235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:18.632235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:18.632235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 294/605] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:18.638134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f1762-f4de-4ed4-9aaa-fb2d35a5f22f None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:18.791370 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f1762-f4de-4ed4-9aaa-fb2d35a5f22f None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:18.834039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a73155-bb67-48a2-a561-6461ca93eaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:18.835078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a73155-bb67-48a2-a561-6461ca93eaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:18.835566 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a73155-bb67-48a2-a561-6461ca93eaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:18.836040 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a73155-bb67-48a2-a561-6461ca93eaa7 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:18.837084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a73155-bb67-48a2-a561-6461ca93eaa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:18.837594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a73155-bb67-48a2-a561-6461ca93eaa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:18.839272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a73155-bb67-48a2-a561-6461ca93eaa7 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:18.852666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 312/606] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:18.858181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051d7e3-aadc-4027-83d7-ee034519f318 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:19.038888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051d7e3-aadc-4027-83d7-ee034519f318 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:19.086473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee025cbe-9325-4bc0-aed0-25b4c91ee8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:19.087418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee025cbe-9325-4bc0-aed0-25b4c91ee8a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:19.087696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee025cbe-9325-4bc0-aed0-25b4c91ee8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:19.087966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee025cbe-9325-4bc0-aed0-25b4c91ee8a5 None admin] PATH_INFO: `/v3/projects/745af7d676704a179668d6685724ed78/users/731d9124a2294b95a7cf1127e5362b66/roles/511b62180d4c4881999e65dfab877783` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:19.105596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee025cbe-9325-4bc0-aed0-25b4c91ee8a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=745af7d676704a179668d6685724ed78, user_id=731d9124a2294b95a7cf1127e5362b66, role_id=511b62180d4c4881999e65dfab877783)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:19.107085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee025cbe-9325-4bc0-aed0-25b4c91ee8a5 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:19.122716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 295/607] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:29:18 2022] PUT /identity/v3/projects/745af7d676704a179668d6685724ed78/users/731d9124a2294b95a7cf1127e5362b66/roles/511b62180d4c4881999e65dfab877783 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:29:19.320550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd158-937a-4633-84a5-5aa9746ba755 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:19.320550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd158-937a-4633-84a5-5aa9746ba755 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:19.320550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd158-937a-4633-84a5-5aa9746ba755 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:19.320550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 313/608] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:19.326473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2befe-c411-4063-80d8-0741522d6063 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:19.326799 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2befe-c411-4063-80d8-0741522d6063 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:19.327079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2befe-c411-4063-80d8-0741522d6063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:19.347021 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-17b2befe-c411-4063-80d8-0741522d6063 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:19.347324 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-17b2befe-c411-4063-80d8-0741522d6063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:19.422809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 296/609] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:19.442548 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dd158-937a-4633-84a5-5aa9746ba755 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:19.559949 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dd158-937a-4633-84a5-5aa9746ba755 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:19.593758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e112a-cd7b-4ce5-a7cb-1688e3b6b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:19.594607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e112a-cd7b-4ce5-a7cb-1688e3b6b866 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:19.594911 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e112a-cd7b-4ce5-a7cb-1688e3b6b866 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:19.595181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e112a-cd7b-4ce5-a7cb-1688e3b6b866 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:19.606624 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e112a-cd7b-4ce5-a7cb-1688e3b6b866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-756e112a-cd7b-4ce5-a7cb-1688e3b6b866 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:19.615275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:19.617472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:19.619750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:19.619750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:19.619750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:19.619750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:19.619750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:19.619750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:19.619750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:19.619750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:19.619750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:19.619750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:19.619750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:19.619750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:19.619750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 314/610] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:19.626701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2befe-c411-4063-80d8-0741522d6063 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:19.727097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2befe-c411-4063-80d8-0741522d6063 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:19.761320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f4115-a61e-49f9-ba00-1dd6837736e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:19.761993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f4115-a61e-49f9-ba00-1dd6837736e6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:19.762272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f4115-a61e-49f9-ba00-1dd6837736e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:19.762539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f4115-a61e-49f9-ba00-1dd6837736e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:19.763307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f4115-a61e-49f9-ba00-1dd6837736e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:19.763608 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f4115-a61e-49f9-ba00-1dd6837736e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:19.764970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f4115-a61e-49f9-ba00-1dd6837736e6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:19.778834 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 297/611] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:19.780337 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e112a-cd7b-4ce5-a7cb-1688e3b6b866 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:19.902658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e112a-cd7b-4ce5-a7cb-1688e3b6b866 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:19.949797 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825785b-837c-44c8-a715-c5dd29ec1239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:19.950592 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825785b-837c-44c8-a715-c5dd29ec1239 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:19.950900 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825785b-837c-44c8-a715-c5dd29ec1239 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:19.951175 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825785b-837c-44c8-a715-c5dd29ec1239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:19.967803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825785b-837c-44c8-a715-c5dd29ec1239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:19.969276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825785b-837c-44c8-a715-c5dd29ec1239 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-0825785b-837c-44c8-a715-c5dd29ec1239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:19.993538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:19.995723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:19.997878 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:19.997878 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:19.997878 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:19.997878 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:19.997878 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 315/612] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:20.000475 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f4115-a61e-49f9-ba00-1dd6837736e6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:20.173954 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f4115-a61e-49f9-ba00-1dd6837736e6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:20.224817 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16542dea-d076-4a6d-bc49-58b27bebf9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:20.225487 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16542dea-d076-4a6d-bc49-58b27bebf9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:20.225765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16542dea-d076-4a6d-bc49-58b27bebf9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:20.226040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16542dea-d076-4a6d-bc49-58b27bebf9d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:20.226796 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16542dea-d076-4a6d-bc49-58b27bebf9d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:20.227102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16542dea-d076-4a6d-bc49-58b27bebf9d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:20.228487 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16542dea-d076-4a6d-bc49-58b27bebf9d6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:20.248936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 298/613] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:20.255169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825785b-837c-44c8-a715-c5dd29ec1239 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:20.395618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825785b-837c-44c8-a715-c5dd29ec1239 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:20.411804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf64032-3402-48d3-9215-a29002af0288 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:20.411804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf64032-3402-48d3-9215-a29002af0288 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:20.412142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf64032-3402-48d3-9215-a29002af0288 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:20.413617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 299/614] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:20.419299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cc0f3-d85f-4869-a68f-f212975d8ebf None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:20.419463 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cc0f3-d85f-4869-a68f-f212975d8ebf None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:20.419629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cc0f3-d85f-4869-a68f-f212975d8ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:20.442502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93ba71-aa42-438d-934a-be32cb94e276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:20.443669 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93ba71-aa42-438d-934a-be32cb94e276 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:20.444159 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93ba71-aa42-438d-934a-be32cb94e276 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:20.444633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93ba71-aa42-438d-934a-be32cb94e276 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:20.456257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93ba71-aa42-438d-934a-be32cb94e276 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:20.461023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93ba71-aa42-438d-934a-be32cb94e276 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:20.462556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c29cc0f3-d85f-4869-a68f-f212975d8ebf None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:20.464153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c29cc0f3-d85f-4869-a68f-f212975d8ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-5a93ba71-aa42-438d-934a-be32cb94e276 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:20.481347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:20.482351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:20.483350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:20.483350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:20.483350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:20.483350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:20.483350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:20.483350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:20.483350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:20.483350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:20.483350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 17:29:20.483350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:20.486022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 316/615] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:29:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:20.492681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93ba71-aa42-438d-934a-be32cb94e276 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:20.597355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 300/616] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:29:20.599489 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93ba71-aa42-438d-934a-be32cb94e276 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:20.637520 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6f207-4cab-4105-8f1c-87a55959bcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:20.638191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6f207-4cab-4105-8f1c-87a55959bcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:20.638500 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6f207-4cab-4105-8f1c-87a55959bcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:20.638816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6f207-4cab-4105-8f1c-87a55959bcf1 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:20.639668 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6f207-4cab-4105-8f1c-87a55959bcf1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:20.639976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6f207-4cab-4105-8f1c-87a55959bcf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:20.641419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6f207-4cab-4105-8f1c-87a55959bcf1 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:20.656103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cc0f3-d85f-4869-a68f-f212975d8ebf None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:20.661445 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 317/617] 10.222.0.76 () {56 vars in 1135 bytes} [Thu May 12 17:29:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:20.684187 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6f207-4cab-4105-8f1c-87a55959bcf1 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:20.802563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cc0f3-d85f-4869-a68f-f212975d8ebf None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:20.843371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc4383-e71c-4410-854c-baea2d1c1e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:20.844627 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc4383-e71c-4410-854c-baea2d1c1e35 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:20.845151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc4383-e71c-4410-854c-baea2d1c1e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:20.845669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc4383-e71c-4410-854c-baea2d1c1e35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:20.857887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc4383-e71c-4410-854c-baea2d1c1e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-67dc4383-e71c-4410-854c-baea2d1c1e35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:20.866597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:20.867623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:20.868485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:20.868485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:20.868485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:20.868485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:20.868485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:20.868485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:20.868485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:20.868485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:20.868485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:20.868485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:20.868485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:20.868485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:20.871478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 301/618] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:20.873175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ff80-ff52-4677-8e95-3bf80dbfb21c None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:20.873743 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ff80-ff52-4677-8e95-3bf80dbfb21c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:20.874218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108ff80-ff52-4677-8e95-3bf80dbfb21c None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:20.876159 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 302/619] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:20.882086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108ff80-ff52-4677-8e95-3bf80dbfb21c None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:20.892557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6f207-4cab-4105-8f1c-87a55959bcf1 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:20.931215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281d797-8054-48f5-97f1-6e79f9b036c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:20.932253 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281d797-8054-48f5-97f1-6e79f9b036c6 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:20.932368 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281d797-8054-48f5-97f1-6e79f9b036c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:20.932609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281d797-8054-48f5-97f1-6e79f9b036c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:20.944213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281d797-8054-48f5-97f1-6e79f9b036c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:20.945901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281d797-8054-48f5-97f1-6e79f9b036c6 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-4281d797-8054-48f5-97f1-6e79f9b036c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:20.964932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:20.965919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:20.972050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:20.972050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:20.972050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:20.972050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:20.972050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 318/620] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:20.972050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c550bb6-f1a2-46fd-8204-5478670ad808 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:20.972050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c550bb6-f1a2-46fd-8204-5478670ad808 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:20.972050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c550bb6-f1a2-46fd-8204-5478670ad808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:20.990804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-8c550bb6-f1a2-46fd-8204-5478670ad808 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:20.992184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8c550bb6-f1a2-46fd-8204-5478670ad808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:21.007682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108ff80-ff52-4677-8e95-3bf80dbfb21c None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:21.051397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0046-a35f-4ab2-9781-6773c2658d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:21.052373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0046-a35f-4ab2-9781-6773c2658d8c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:21.052881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0046-a35f-4ab2-9781-6773c2658d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:21.053351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0046-a35f-4ab2-9781-6773c2658d8c None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:21.054267 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d0046-a35f-4ab2-9781-6773c2658d8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:21.054757 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d0046-a35f-4ab2-9781-6773c2658d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:21.056351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d0046-a35f-4ab2-9781-6773c2658d8c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:21.066131 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 303/621] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:21.067680 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0046-a35f-4ab2-9781-6773c2658d8c None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:21.078703 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 319/622] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:21.078703 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c550bb6-f1a2-46fd-8204-5478670ad808 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:21.202287 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c550bb6-f1a2-46fd-8204-5478670ad808 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:21.218585 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0046-a35f-4ab2-9781-6773c2658d8c None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:21.245024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a619d-2576-4198-a2f1-47847f433d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:21.245872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a619d-2576-4198-a2f1-47847f433d8c None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:21.246115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a619d-2576-4198-a2f1-47847f433d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:21.246394 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a619d-2576-4198-a2f1-47847f433d8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:21.257928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a619d-2576-4198-a2f1-47847f433d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:21.259471 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a619d-2576-4198-a2f1-47847f433d8c None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:21.279963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a175d5d-ae5e-47a4-91eb-e3f3d61716bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-198a619d-2576-4198-a2f1-47847f433d8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:21.280168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:21.281052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:21.281942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:21.281942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:21.281942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:21.281942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:21.284375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a175d5d-ae5e-47a4-91eb-e3f3d61716bc None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:21.285143 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a175d5d-ae5e-47a4-91eb-e3f3d61716bc None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:21.285671 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a175d5d-ae5e-47a4-91eb-e3f3d61716bc None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:21.286748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 320/623] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:21.287306 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a175d5d-ae5e-47a4-91eb-e3f3d61716bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:21.287594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a619d-2576-4198-a2f1-47847f433d8c None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:21.288101 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a175d5d-ae5e-47a4-91eb-e3f3d61716bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:21.289707 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a175d5d-ae5e-47a4-91eb-e3f3d61716bc None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:21.305830 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 304/624] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:21.306929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a175d5d-ae5e-47a4-91eb-e3f3d61716bc None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:21.415568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a619d-2576-4198-a2f1-47847f433d8c None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:21.432574 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a175d5d-ae5e-47a4-91eb-e3f3d61716bc None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:21.458968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fb349-7b01-4993-bb1a-f8cde825ad35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:21.459814 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb349-7b01-4993-bb1a-f8cde825ad35 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:21.460288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb349-7b01-4993-bb1a-f8cde825ad35 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:21.460758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb349-7b01-4993-bb1a-f8cde825ad35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:21.474324 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e22e2-1558-4314-830e-2f092d79ad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:21.474655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fb349-7b01-4993-bb1a-f8cde825ad35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:21.475714 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e22e2-1558-4314-830e-2f092d79ad46 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:21.476342 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e22e2-1558-4314-830e-2f092d79ad46 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:21.476874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e22e2-1558-4314-830e-2f092d79ad46 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:21.477748 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e22e2-1558-4314-830e-2f092d79ad46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:21.478207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e22e2-1558-4314-830e-2f092d79ad46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:21.479758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e22e2-1558-4314-830e-2f092d79ad46 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-0d1fb349-7b01-4993-bb1a-f8cde825ad35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:21.482474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:21.483958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:21.484821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:21.484821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:21.484821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:21.484821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:21.484821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:21.484821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:21.484821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:21.484821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:21.484821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:21.484821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:21.484821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:21.484821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:21.488686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 321/625] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:21.490797 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b644c1-fc2e-46b3-a9b1-459e699fde37 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:21.491089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b644c1-fc2e-46b3-a9b1-459e699fde37 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:21.491368 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b644c1-fc2e-46b3-a9b1-459e699fde37 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:21.492853 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 322/626] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:21.498365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 305/627] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:21.498573 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b644c1-fc2e-46b3-a9b1-459e699fde37 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:21.498780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e22e2-1558-4314-830e-2f092d79ad46 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:21.607655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b644c1-fc2e-46b3-a9b1-459e699fde37 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:21.615586 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e22e2-1558-4314-830e-2f092d79ad46 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:21.643682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48401c-741c-499b-b0ff-413404a9f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:21.644474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48401c-741c-499b-b0ff-413404a9f467 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:21.644769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48401c-741c-499b-b0ff-413404a9f467 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:21.645027 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48401c-741c-499b-b0ff-413404a9f467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:21.650036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588136e8-adc5-42c9-a5e9-71f493e0a96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:21.650726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588136e8-adc5-42c9-a5e9-71f493e0a96d None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:21.651010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588136e8-adc5-42c9-a5e9-71f493e0a96d None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:21.651283 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588136e8-adc5-42c9-a5e9-71f493e0a96d None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:21.652028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588136e8-adc5-42c9-a5e9-71f493e0a96d None admin] RBAC: Adding query filter params (name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:21.652332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588136e8-adc5-42c9-a5e9-71f493e0a96d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:21.652431 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48401c-741c-499b-b0ff-413404a9f467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:21.653694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588136e8-adc5-42c9-a5e9-71f493e0a96d None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:21.653875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48401c-741c-499b-b0ff-413404a9f467 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:21.666027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 306/628] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:21.666027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00ce5-b09d-401b-9c22-999f58db0f58 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:21.666027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00ce5-b09d-401b-9c22-999f58db0f58 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:21.666027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00ce5-b09d-401b-9c22-999f58db0f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-1a48401c-741c-499b-b0ff-413404a9f467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:21.668436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:21.669753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:21.670651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:21.670651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:21.670651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:21.670651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:21.670651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:21.670651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:21.670651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:21.670651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:21.674413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 323/629] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:21.675314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48401c-741c-499b-b0ff-413404a9f467 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:21.684075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-d7f00ce5-b09d-401b-9c22-999f58db0f58 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:21.685271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d7f00ce5-b09d-401b-9c22-999f58db0f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:21.752387 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 307/630] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:21.753311 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00ce5-b09d-401b-9c22-999f58db0f58 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:21.788943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48401c-741c-499b-b0ff-413404a9f467 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:21.823254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5b0ea-6d79-4027-bb2c-283cb1815f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:21.824049 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5b0ea-6d79-4027-bb2c-283cb1815f2e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:21.824330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5b0ea-6d79-4027-bb2c-283cb1815f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:21.824605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5b0ea-6d79-4027-bb2c-283cb1815f2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:21.833297 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5b0ea-6d79-4027-bb2c-283cb1815f2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:21.834843 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5b0ea-6d79-4027-bb2c-283cb1815f2e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-91b5b0ea-6d79-4027-bb2c-283cb1815f2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:21.850462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:21.851550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:21.852674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:21.852674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:21.852674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:21.852674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:21.852674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:21.852674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:21.852674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:21.852674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:21.852674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 17:29:21.852674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:21.852674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 324/631] 10.222.0.76 () {56 vars in 1093 bytes} [Thu May 12 17:29:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:21.852674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5b0ea-6d79-4027-bb2c-283cb1815f2e None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:21.864819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00ce5-b09d-401b-9c22-999f58db0f58 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:21.903803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c058f-b42b-4b4f-a449-ee99281beb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:21.904603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c058f-b42b-4b4f-a449-ee99281beb0a None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:21.904887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c058f-b42b-4b4f-a449-ee99281beb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:21.905159 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c058f-b42b-4b4f-a449-ee99281beb0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:21.917531 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c058f-b42b-4b4f-a449-ee99281beb0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:21.919029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c058f-b42b-4b4f-a449-ee99281beb0a None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-2f4c058f-b42b-4b4f-a449-ee99281beb0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:21.937246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:21.938381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:21.940059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:21.940059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:21.940059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:21.940059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:21.942959 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 308/632] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:21.943630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c058f-b42b-4b4f-a449-ee99281beb0a None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:21.958979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5b0ea-6d79-4027-bb2c-283cb1815f2e None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:21.992278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db7513-22ec-432b-a3bc-2932a4694b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:21.992937 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db7513-22ec-432b-a3bc-2932a4694b4a None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:21.993221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db7513-22ec-432b-a3bc-2932a4694b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:21.993496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db7513-22ec-432b-a3bc-2932a4694b4a None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:21.994277 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db7513-22ec-432b-a3bc-2932a4694b4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:21.994586 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db7513-22ec-432b-a3bc-2932a4694b4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:21.996046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db7513-22ec-432b-a3bc-2932a4694b4a None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:22.012955 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 325/633] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:22.012955 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db7513-22ec-432b-a3bc-2932a4694b4a None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:22.044261 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c058f-b42b-4b4f-a449-ee99281beb0a None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:22.077792 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cd88d-0305-4447-966a-658039fe6ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:22.078579 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cd88d-0305-4447-966a-658039fe6ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:22.078895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cd88d-0305-4447-966a-658039fe6ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:22.079164 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cd88d-0305-4447-966a-658039fe6ac0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:22.090477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cd88d-0305-4447-966a-658039fe6ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-bc4cd88d-0305-4447-966a-658039fe6ac0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:22.098305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:22.099334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:22.100331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:22.100331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:22.100331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:22.100331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:22.100331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:22.100331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:22.100331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:22.100331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:22.100331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:22.100331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:22.100331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:22.100331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:22.100331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 309/634] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:22.101625 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cd88d-0305-4447-966a-658039fe6ac0 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:22.116290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db7513-22ec-432b-a3bc-2932a4694b4a None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:22.148382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d006ca-0274-4a91-a89a-95d7161c2a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:22.149043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d006ca-0274-4a91-a89a-95d7161c2a6c None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:22.149320 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d006ca-0274-4a91-a89a-95d7161c2a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:22.149592 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d006ca-0274-4a91-a89a-95d7161c2a6c None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:22.150421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d006ca-0274-4a91-a89a-95d7161c2a6c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:22.150754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d006ca-0274-4a91-a89a-95d7161c2a6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:22.152202 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d006ca-0274-4a91-a89a-95d7161c2a6c None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:22.169338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 326/635] 10.222.0.76 () {56 vars in 1133 bytes} [Thu May 12 17:29:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:22.170116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d006ca-0274-4a91-a89a-95d7161c2a6c None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:22.196748 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cd88d-0305-4447-966a-658039fe6ac0 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:22.228269 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4eafe-a7c7-44ea-81e9-c3f94c4562a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:22.228927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4eafe-a7c7-44ea-81e9-c3f94c4562a8 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:22.229198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4eafe-a7c7-44ea-81e9-c3f94c4562a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:22.229468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4eafe-a7c7-44ea-81e9-c3f94c4562a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:22.230175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4eafe-a7c7-44ea-81e9-c3f94c4562a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:22.230474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4eafe-a7c7-44ea-81e9-c3f94c4562a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:22.231874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4eafe-a7c7-44ea-81e9-c3f94c4562a8 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:22.244258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 310/636] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:22.245534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1c246-3a1c-4e4f-9de6-788351bbe616 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:22.245822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1c246-3a1c-4e4f-9de6-788351bbe616 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:22.246086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1c246-3a1c-4e4f-9de6-788351bbe616 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:22.247604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 311/637] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:22.248292 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1c246-3a1c-4e4f-9de6-788351bbe616 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:22.271981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d006ca-0274-4a91-a89a-95d7161c2a6c None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:22.304375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b149d-99bb-4517-8c9b-60d290000a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:22.305281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b149d-99bb-4517-8c9b-60d290000a27 None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:22.305556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b149d-99bb-4517-8c9b-60d290000a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:22.305824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b149d-99bb-4517-8c9b-60d290000a27 None admin] PATH_INFO: `/v3/projects/745af7d676704a179668d6685724ed78/users/0e679573cc984993b98e416fabd586d4/roles/511b62180d4c4881999e65dfab877783` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:22.320343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b149d-99bb-4517-8c9b-60d290000a27 None admin] RBAC: Authorizing `identity:create_grant(project_id=745af7d676704a179668d6685724ed78, user_id=0e679573cc984993b98e416fabd586d4, role_id=511b62180d4c4881999e65dfab877783)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:22.321842 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b149d-99bb-4517-8c9b-60d290000a27 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:22.334865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 327/638] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:29:22 2022] PUT /identity/v3/projects/745af7d676704a179668d6685724ed78/users/0e679573cc984993b98e416fabd586d4/roles/511b62180d4c4881999e65dfab877783 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:29:22.335657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b149d-99bb-4517-8c9b-60d290000a27 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:22.347761 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1c246-3a1c-4e4f-9de6-788351bbe616 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:22.386653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4bebb-88f6-473c-a5ef-4ff9cb17f30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:22.387265 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4bebb-88f6-473c-a5ef-4ff9cb17f30b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:22.387548 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4bebb-88f6-473c-a5ef-4ff9cb17f30b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:22.387819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4bebb-88f6-473c-a5ef-4ff9cb17f30b None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:22.388574 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4bebb-88f6-473c-a5ef-4ff9cb17f30b None admin] RBAC: Adding query filter params (name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:22.388877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4bebb-88f6-473c-a5ef-4ff9cb17f30b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:22.390306 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4bebb-88f6-473c-a5ef-4ff9cb17f30b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:22.404493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 312/639] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:22.404493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4bebb-88f6-473c-a5ef-4ff9cb17f30b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:22.453895 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b149d-99bb-4517-8c9b-60d290000a27 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:22.491966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffcb7f-e958-46fc-b8e0-8a14739057ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:22.492631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffcb7f-e958-46fc-b8e0-8a14739057ad None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:22.492908 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffcb7f-e958-46fc-b8e0-8a14739057ad None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:22.493186 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffcb7f-e958-46fc-b8e0-8a14739057ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:22.512150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4bebb-88f6-473c-a5ef-4ff9cb17f30b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:22.551086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5750a5-5949-4a33-b669-c5c0497aae1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:22.552039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5750a5-5949-4a33-b669-c5c0497aae1f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:22.552421 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5750a5-5949-4a33-b669-c5c0497aae1f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:22.552793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5750a5-5949-4a33-b669-c5c0497aae1f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:22.560553 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5750a5-5949-4a33-b669-c5c0497aae1f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:22.562089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5750a5-5949-4a33-b669-c5c0497aae1f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:22.563962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffcb7f-e958-46fc-b8e0-8a14739057ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:22.566022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffcb7f-e958-46fc-b8e0-8a14739057ad None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-ca5750a5-5949-4a33-b669-c5c0497aae1f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:22.577120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:22.578277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:22.579473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:22.579473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:22.579473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:22.579473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:22.579473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:22.579473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:22.579473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:22.579473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:22.579473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 17:29:22.579473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:22.580132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 313/640] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:29:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:22.581426 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46e972-7443-45ba-bc31-2a1ceaf77ff4 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:22.581715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46e972-7443-45ba-bc31-2a1ceaf77ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:22.581989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46e972-7443-45ba-bc31-2a1ceaf77ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:22.598637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-2a46e972-7443-45ba-bc31-2a1ceaf77ff4 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:22.599828 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2a46e972-7443-45ba-bc31-2a1ceaf77ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:22.671126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 314/641] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:22.671126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46e972-7443-45ba-bc31-2a1ceaf77ff4 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:22.679275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 328/642] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:29:22.680403 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffcb7f-e958-46fc-b8e0-8a14739057ad None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:22.774352 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46e972-7443-45ba-bc31-2a1ceaf77ff4 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:22.781743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffcb7f-e958-46fc-b8e0-8a14739057ad None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:22.809363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b1f87-612d-48c0-a0fa-d381372f1640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:22.810154 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b1f87-612d-48c0-a0fa-d381372f1640 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:22.810590 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b1f87-612d-48c0-a0fa-d381372f1640 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:22.810893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b1f87-612d-48c0-a0fa-d381372f1640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:22.815781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47732051-4679-4630-9ac4-6672c85492a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:22.816538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47732051-4679-4630-9ac4-6672c85492a1 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:22.816888 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47732051-4679-4630-9ac4-6672c85492a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:22.817229 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47732051-4679-4630-9ac4-6672c85492a1 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:22.818140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47732051-4679-4630-9ac4-6672c85492a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:22.818449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47732051-4679-4630-9ac4-6672c85492a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:22.819962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47732051-4679-4630-9ac4-6672c85492a1 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:22.822116 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b1f87-612d-48c0-a0fa-d381372f1640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:22.823735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b1f87-612d-48c0-a0fa-d381372f1640 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:22.842245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 329/643] 10.222.0.76 () {56 vars in 1137 bytes} [Thu May 12 17:29:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:22.842245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47732051-4679-4630-9ac4-6672c85492a1 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-db5b1f87-612d-48c0-a0fa-d381372f1640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:22.842593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:22.843806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:22.844901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:22.844901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:22.844901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:22.844901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:22.844901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 315/644] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:22.847537 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b1f87-612d-48c0-a0fa-d381372f1640 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:22.945335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47732051-4679-4630-9ac4-6672c85492a1 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:22.947896 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b1f87-612d-48c0-a0fa-d381372f1640 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:22.979076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce849e1-64d7-4271-8c83-9ce576089634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:22.979862 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce849e1-64d7-4271-8c83-9ce576089634 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:22.980140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce849e1-64d7-4271-8c83-9ce576089634 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:22.980411 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce849e1-64d7-4271-8c83-9ce576089634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:22.982077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e9edf-6d6b-4b77-8c63-86c7bc91f2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:22.982887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e9edf-6d6b-4b77-8c63-86c7bc91f2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:22.983172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e9edf-6d6b-4b77-8c63-86c7bc91f2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:22.983450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e9edf-6d6b-4b77-8c63-86c7bc91f2a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:22.990375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce849e1-64d7-4271-8c83-9ce576089634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:22.991869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce849e1-64d7-4271-8c83-9ce576089634 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:22.993414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e9edf-6d6b-4b77-8c63-86c7bc91f2a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-378e9edf-6d6b-4b77-8c63-86c7bc91f2a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:23.001069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:23.002051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:23.003460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:23.003460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:23.003460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:23.003460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:23.003460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:23.003460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:23.003460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:23.003460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:23.003460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:23.003460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:23.003460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:23.003460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:23.006985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 316/645] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:23.008049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e9edf-6d6b-4b77-8c63-86c7bc91f2a3 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-2ce849e1-64d7-4271-8c83-9ce576089634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:23.009391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:23.010420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:23.015854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:23.015854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:23.015854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:23.015854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:23.015854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 330/646] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:23.015854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce849e1-64d7-4271-8c83-9ce576089634 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:23.108847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce849e1-64d7-4271-8c83-9ce576089634 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:23.109362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e9edf-6d6b-4b77-8c63-86c7bc91f2a3 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:23.142053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a62c3-2917-46ee-b282-6f10743fbb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:23.143272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecdf98-d204-4166-9f2a-3403b3783132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:23.143453 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a62c3-2917-46ee-b282-6f10743fbb89 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:23.143778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecdf98-d204-4166-9f2a-3403b3783132 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:23.143922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a62c3-2917-46ee-b282-6f10743fbb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:23.144211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a62c3-2917-46ee-b282-6f10743fbb89 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:23.144376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecdf98-d204-4166-9f2a-3403b3783132 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:23.144741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecdf98-d204-4166-9f2a-3403b3783132 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:23.144939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a62c3-2917-46ee-b282-6f10743fbb89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:23.145245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a62c3-2917-46ee-b282-6f10743fbb89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:23.146617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a62c3-2917-46ee-b282-6f10743fbb89 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:23.162407 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 331/647] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:23.162407 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a62c3-2917-46ee-b282-6f10743fbb89 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:23.215499 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecdf98-d204-4166-9f2a-3403b3783132 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:23.217634 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecdf98-d204-4166-9f2a-3403b3783132 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:23.261149 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a62c3-2917-46ee-b282-6f10743fbb89 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:23.299333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de9e00-7b68-4308-8b26-a4fc4612fad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:23.300000 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de9e00-7b68-4308-8b26-a4fc4612fad2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:23.300278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de9e00-7b68-4308-8b26-a4fc4612fad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:23.300553 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de9e00-7b68-4308-8b26-a4fc4612fad2 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:23.301298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de9e00-7b68-4308-8b26-a4fc4612fad2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:23.301603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de9e00-7b68-4308-8b26-a4fc4612fad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:23.302996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de9e00-7b68-4308-8b26-a4fc4612fad2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:23.311073 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 332/648] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:23.311843 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de9e00-7b68-4308-8b26-a4fc4612fad2 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:23.318152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 317/649] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:29:23.319726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecdf98-d204-4166-9f2a-3403b3783132 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:23.409603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de9e00-7b68-4308-8b26-a4fc4612fad2 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:23.415414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecdf98-d204-4166-9f2a-3403b3783132 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:23.442274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dbd97-3d41-4133-a270-b039fac27b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:23.442962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dbd97-3d41-4133-a270-b039fac27b65 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:23.443244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dbd97-3d41-4133-a270-b039fac27b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:23.443520 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dbd97-3d41-4133-a270-b039fac27b65 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:23.444303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dbd97-3d41-4133-a270-b039fac27b65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:23.444609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dbd97-3d41-4133-a270-b039fac27b65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:23.446035 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dbd97-3d41-4133-a270-b039fac27b65 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:23.449494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58138988-c868-4ffc-8b30-30324caf6955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:23.450301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58138988-c868-4ffc-8b30-30324caf6955 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:23.450579 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58138988-c868-4ffc-8b30-30324caf6955 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:23.450898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58138988-c868-4ffc-8b30-30324caf6955 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:23.459036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 333/650] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:23.459036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dbd97-3d41-4133-a270-b039fac27b65 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:23.464277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58138988-c868-4ffc-8b30-30324caf6955 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:23.464277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58138988-c868-4ffc-8b30-30324caf6955 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-58138988-c868-4ffc-8b30-30324caf6955 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:23.480735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:23.481920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:23.482916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:23.482916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:23.482916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:23.482916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:23.482916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:23.482916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:23.482916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:23.482916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:23.482916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 17:29:23.482916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:23.482916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 318/651] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:29:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:23.483517 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58138988-c868-4ffc-8b30-30324caf6955 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:23.568623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dbd97-3d41-4133-a270-b039fac27b65 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:23.595320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58138988-c868-4ffc-8b30-30324caf6955 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:23.603172 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9729b57-3974-4082-90c9-0374390d405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:23.603967 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9729b57-3974-4082-90c9-0374390d405d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:23.604247 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9729b57-3974-4082-90c9-0374390d405d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:23.604520 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9729b57-3974-4082-90c9-0374390d405d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:23.614848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9729b57-3974-4082-90c9-0374390d405d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:23.616307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9729b57-3974-4082-90c9-0374390d405d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:23.630184 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0837e-37a5-4b98-83b4-64422502946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:23.630997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0837e-37a5-4b98-83b4-64422502946e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:23.631278 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0837e-37a5-4b98-83b4-64422502946e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:23.631550 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0837e-37a5-4b98-83b4-64422502946e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-d9729b57-3974-4082-90c9-0374390d405d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:23.634698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:23.635590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:23.636510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:23.636510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:23.636510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:23.636510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:23.640438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 334/652] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:23.641036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9729b57-3974-4082-90c9-0374390d405d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:23.642001 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0837e-37a5-4b98-83b4-64422502946e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:23.644119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0837e-37a5-4b98-83b4-64422502946e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-46b0837e-37a5-4b98-83b4-64422502946e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:23.661934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:23.662874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:23.663771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:23.663771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:23.663771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:23.663771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:23.663771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 319/653] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:23.664064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0837e-37a5-4b98-83b4-64422502946e None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:23.745368 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9729b57-3974-4082-90c9-0374390d405d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:23.760801 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0837e-37a5-4b98-83b4-64422502946e None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:23.779320 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf7ca1-eea9-47a4-bdd6-964219db31e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:23.780216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf7ca1-eea9-47a4-bdd6-964219db31e8 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:23.780566 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf7ca1-eea9-47a4-bdd6-964219db31e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:23.780937 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf7ca1-eea9-47a4-bdd6-964219db31e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:23.788842 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf7ca1-eea9-47a4-bdd6-964219db31e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:23.790877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf7ca1-eea9-47a4-bdd6-964219db31e8 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:23.795228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba5f77-5283-4576-882e-2bd17ac2b944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:23.795985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba5f77-5283-4576-882e-2bd17ac2b944 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:23.796340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba5f77-5283-4576-882e-2bd17ac2b944 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:23.796682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba5f77-5283-4576-882e-2bd17ac2b944 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:23.797583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba5f77-5283-4576-882e-2bd17ac2b944 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:23.797959 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba5f77-5283-4576-882e-2bd17ac2b944 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:23.799494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba5f77-5283-4576-882e-2bd17ac2b944 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-94cf7ca1-eea9-47a4-bdd6-964219db31e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:23.806953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:23.807966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:23.808947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:23.808947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:23.808947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:23.808947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:23.808947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:23.808947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:23.808947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:23.808947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:23.808947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 335/654] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:23.809513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf7ca1-eea9-47a4-bdd6-964219db31e8 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:23.821092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 320/655] 10.222.0.76 () {56 vars in 1137 bytes} [Thu May 12 17:29:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:23.822108 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba5f77-5283-4576-882e-2bd17ac2b944 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:23.914854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf7ca1-eea9-47a4-bdd6-964219db31e8 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:23.920766 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba5f77-5283-4576-882e-2bd17ac2b944 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:23.953941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1994e-387d-4db7-88b8-1177c7614100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:23.954142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d6ba5-8852-4fa1-aff5-10793c03df4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:23.954616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1994e-387d-4db7-88b8-1177c7614100 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:23.955578 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d6ba5-8852-4fa1-aff5-10793c03df4f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:23.955960 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d6ba5-8852-4fa1-aff5-10793c03df4f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:23.956066 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1994e-387d-4db7-88b8-1177c7614100 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:23.956232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1994e-387d-4db7-88b8-1177c7614100 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:23.956517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d6ba5-8852-4fa1-aff5-10793c03df4f None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:23.956954 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1994e-387d-4db7-88b8-1177c7614100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:23.957254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1994e-387d-4db7-88b8-1177c7614100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:23.957544 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d6ba5-8852-4fa1-aff5-10793c03df4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:23.957954 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d6ba5-8852-4fa1-aff5-10793c03df4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:23.958623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1994e-387d-4db7-88b8-1177c7614100 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:23.959493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d6ba5-8852-4fa1-aff5-10793c03df4f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:23.974381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 321/656] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:23.974381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1994e-387d-4db7-88b8-1177c7614100 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:23.978295 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 336/657] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:23.982560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d6ba5-8852-4fa1-aff5-10793c03df4f None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:24.069668 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1994e-387d-4db7-88b8-1177c7614100 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:24.089617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d6ba5-8852-4fa1-aff5-10793c03df4f None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:24.103294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b31a6-eb4a-4757-b710-bf6ff2b6de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:24.104112 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b31a6-eb4a-4757-b710-bf6ff2b6de76 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:24.104484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b31a6-eb4a-4757-b710-bf6ff2b6de76 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:24.104856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b31a6-eb4a-4757-b710-bf6ff2b6de76 None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:24.105637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b31a6-eb4a-4757-b710-bf6ff2b6de76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:24.105938 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b31a6-eb4a-4757-b710-bf6ff2b6de76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:24.107407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b31a6-eb4a-4757-b710-bf6ff2b6de76 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:24.120535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 322/658] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:24.121334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b31a6-eb4a-4757-b710-bf6ff2b6de76 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:24.130434 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0768ca9-be9c-4925-ab57-d6d5f63dc1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:24.131314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0768ca9-be9c-4925-ab57-d6d5f63dc1ab None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:24.131768 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0768ca9-be9c-4925-ab57-d6d5f63dc1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:24.132216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0768ca9-be9c-4925-ab57-d6d5f63dc1ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:24.199165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0768ca9-be9c-4925-ab57-d6d5f63dc1ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:24.200768 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0768ca9-be9c-4925-ab57-d6d5f63dc1ab None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:24.224871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b31a6-eb4a-4757-b710-bf6ff2b6de76 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:24.262436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d307d-457f-4607-af61-91bcaf502338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:24.263257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d307d-457f-4607-af61-91bcaf502338 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:24.263538 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d307d-457f-4607-af61-91bcaf502338 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:24.263815 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d307d-457f-4607-af61-91bcaf502338 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:24.271175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d307d-457f-4607-af61-91bcaf502338 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:24.272671 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d307d-457f-4607-af61-91bcaf502338 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-991d307d-457f-4607-af61-91bcaf502338 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:24.286460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:24.287424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:24.291560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:24.291560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:24.291560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:24.291560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:24.291560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:24.291560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:24.291560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:24.291560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:24.291560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 323/659] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:24.291560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d307d-457f-4607-af61-91bcaf502338 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:24.308785 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 337/660] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:29:24.309549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0768ca9-be9c-4925-ab57-d6d5f63dc1ab None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:24.389861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d307d-457f-4607-af61-91bcaf502338 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:24.408945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0768ca9-be9c-4925-ab57-d6d5f63dc1ab None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:24.436219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313a4a6-23ac-4034-b4e7-95d84e3c828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:24.437217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313a4a6-23ac-4034-b4e7-95d84e3c828e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:24.437601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313a4a6-23ac-4034-b4e7-95d84e3c828e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:24.437971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313a4a6-23ac-4034-b4e7-95d84e3c828e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:24.446402 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b0702-d53d-45dc-b5f5-00502d8af75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:24.447221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b0702-d53d-45dc-b5f5-00502d8af75f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:24.447355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313a4a6-23ac-4034-b4e7-95d84e3c828e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:24.447679 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b0702-d53d-45dc-b5f5-00502d8af75f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:24.448065 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b0702-d53d-45dc-b5f5-00502d8af75f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:24.448796 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313a4a6-23ac-4034-b4e7-95d84e3c828e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:24.449078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b0702-d53d-45dc-b5f5-00502d8af75f None admin] RBAC: Adding query filter params (role.id=511b62180d4c4881999e65dfab877783, scope.project.id=745af7d676704a179668d6685724ed78, user.id=04ad234318ad47589b844351cd3bb3e3) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:24.449488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b0702-d53d-45dc-b5f5-00502d8af75f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:24.451010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b0702-d53d-45dc-b5f5-00502d8af75f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:24.465893 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 338/661] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:24 2022] GET /identity/v3/role_assignments?user.id=04ad234318ad47589b844351cd3bb3e3&scope.project.id=745af7d676704a179668d6685724ed78&role.id=511b62180d4c4881999e65dfab877783 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:24.465893 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b0702-d53d-45dc-b5f5-00502d8af75f None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-f313a4a6-23ac-4034-b4e7-95d84e3c828e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:24.466602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:24.467843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:24.469406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:24.469406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:24.469406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:24.469406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:24.469406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:24.469406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:24.469406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:24.469406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:24.469406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 17:29:24.469406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:24.469406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 324/662] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:24.469406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313a4a6-23ac-4034-b4e7-95d84e3c828e None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:24.589636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b0702-d53d-45dc-b5f5-00502d8af75f None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:24.602244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313a4a6-23ac-4034-b4e7-95d84e3c828e None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:24.629794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980c564-1a9f-4afb-8264-d5f571121b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:24.630471 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980c564-1a9f-4afb-8264-d5f571121b99 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:24.630781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980c564-1a9f-4afb-8264-d5f571121b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:24.631059 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980c564-1a9f-4afb-8264-d5f571121b99 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:24.631862 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980c564-1a9f-4afb-8264-d5f571121b99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:24.632173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980c564-1a9f-4afb-8264-d5f571121b99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:24.633914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980c564-1a9f-4afb-8264-d5f571121b99 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:24.638511 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d149d-fafd-4f97-8861-785b7ead2fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:24.639347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d149d-fafd-4f97-8861-785b7ead2fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:24.639628 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d149d-fafd-4f97-8861-785b7ead2fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:24.639951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d149d-fafd-4f97-8861-785b7ead2fb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:24.646284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 339/663] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:24.648110 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980c564-1a9f-4afb-8264-d5f571121b99 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:24.651415 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d149d-fafd-4f97-8861-785b7ead2fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:24.652880 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d149d-fafd-4f97-8861-785b7ead2fb3 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-0f3d149d-fafd-4f97-8861-785b7ead2fb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:24.671070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:24.672023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:24.673133 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:24.673133 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:24.673133 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:24.673133 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:24.673133 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 325/664] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:24.674071 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cffce-ef59-436c-8a81-cb1cebba469e None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:24.674359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cffce-ef59-436c-8a81-cb1cebba469e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:24.674632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cffce-ef59-436c-8a81-cb1cebba469e None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:24.676849 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 326/665] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:24.681595 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cffce-ef59-436c-8a81-cb1cebba469e None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:24.767884 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980c564-1a9f-4afb-8264-d5f571121b99 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:24.790715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cffce-ef59-436c-8a81-cb1cebba469e None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:24.809032 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a277dd-137c-4fb8-95f2-c5299a12a765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:24.809705 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a277dd-137c-4fb8-95f2-c5299a12a765 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:24.810394 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a277dd-137c-4fb8-95f2-c5299a12a765 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:24.810701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a277dd-137c-4fb8-95f2-c5299a12a765 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:24.811827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a277dd-137c-4fb8-95f2-c5299a12a765 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:24.812137 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a277dd-137c-4fb8-95f2-c5299a12a765 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:24.814239 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a277dd-137c-4fb8-95f2-c5299a12a765 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:24.823568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7dc64-1cc4-4793-8b5e-72e0f14f3f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:24.824221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7dc64-1cc4-4793-8b5e-72e0f14f3f3e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:24.824505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7dc64-1cc4-4793-8b5e-72e0f14f3f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:24.824777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7dc64-1cc4-4793-8b5e-72e0f14f3f3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:24.825603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7dc64-1cc4-4793-8b5e-72e0f14f3f3e None admin] RBAC: Adding query filter params (role.id=511b62180d4c4881999e65dfab877783, scope.project.id=745af7d676704a179668d6685724ed78, user.id=1a003b6145fb4c5c8919020d9208afa7) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:24.825907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7dc64-1cc4-4793-8b5e-72e0f14f3f3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:24.827363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7dc64-1cc4-4793-8b5e-72e0f14f3f3e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:24.833262 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 327/666] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:24 2022] GET /identity/v3/role_assignments?user.id=1a003b6145fb4c5c8919020d9208afa7&scope.project.id=745af7d676704a179668d6685724ed78&role.id=511b62180d4c4881999e65dfab877783 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:24.834044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7dc64-1cc4-4793-8b5e-72e0f14f3f3e None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:24.851110 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 340/667] 10.222.0.76 () {56 vars in 1139 bytes} [Thu May 12 17:29:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:24.852658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb5cfb-fb10-44e1-80fd-193dcc32b1cc None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:24.852944 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb5cfb-fb10-44e1-80fd-193dcc32b1cc None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:24.853285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb5cfb-fb10-44e1-80fd-193dcc32b1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:24.874251 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-69fb5cfb-fb10-44e1-80fd-193dcc32b1cc None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:24.875771 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-69fb5cfb-fb10-44e1-80fd-193dcc32b1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:24.947116 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7dc64-1cc4-4793-8b5e-72e0f14f3f3e None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:24.965886 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 341/668] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:24.966773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb5cfb-fb10-44e1-80fd-193dcc32b1cc None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:24.990246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bde9aa-298e-4b97-8e55-81ce8e02ecda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:24.991544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde9aa-298e-4b97-8e55-81ce8e02ecda None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:24.992009 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde9aa-298e-4b97-8e55-81ce8e02ecda None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:24.992432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde9aa-298e-4b97-8e55-81ce8e02ecda None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:24.993477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bde9aa-298e-4b97-8e55-81ce8e02ecda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:24.994076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bde9aa-298e-4b97-8e55-81ce8e02ecda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:24.995867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bde9aa-298e-4b97-8e55-81ce8e02ecda None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:25.010948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 328/669] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:25.012085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bde9aa-298e-4b97-8e55-81ce8e02ecda None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:25.104349 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb5cfb-fb10-44e1-80fd-193dcc32b1cc None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:25.127343 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bde9aa-298e-4b97-8e55-81ce8e02ecda None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:25.147439 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d2e4c-0cda-4d2e-b1d6-38bcdaa98133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:25.148089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d2e4c-0cda-4d2e-b1d6-38bcdaa98133 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:25.148362 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d2e4c-0cda-4d2e-b1d6-38bcdaa98133 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:25.148629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d2e4c-0cda-4d2e-b1d6-38bcdaa98133 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:25.164346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a9179-4611-480d-852c-46ec89aecbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:25.165478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a9179-4611-480d-852c-46ec89aecbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:25.165904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a9179-4611-480d-852c-46ec89aecbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:25.166323 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a9179-4611-480d-852c-46ec89aecbd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:25.177270 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a9179-4611-480d-852c-46ec89aecbd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-778a9179-4611-480d-852c-46ec89aecbd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:25.185070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:25.186219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:25.187280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:25.187280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:25.187280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:25.187280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:25.187280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:25.187280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:25.187280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:25.187280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:25.187280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:25.187280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:25.187280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:25.187280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:25.187280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 329/670] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:25.188008 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a9179-4611-480d-852c-46ec89aecbd6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:25.223827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d2e4c-0cda-4d2e-b1d6-38bcdaa98133 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:25.225497 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d2e4c-0cda-4d2e-b1d6-38bcdaa98133 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:25.292082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a9179-4611-480d-852c-46ec89aecbd6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:25.326484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc29426-a2ae-494e-9e73-deffe3075d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:25.327550 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc29426-a2ae-494e-9e73-deffe3075d4c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:25.327673 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc29426-a2ae-494e-9e73-deffe3075d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:25.327859 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc29426-a2ae-494e-9e73-deffe3075d4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:25.335065 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 342/671] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:29:25.335807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc29426-a2ae-494e-9e73-deffe3075d4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:25.336250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d2e4c-0cda-4d2e-b1d6-38bcdaa98133 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:25.337311 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc29426-a2ae-494e-9e73-deffe3075d4c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-fdc29426-a2ae-494e-9e73-deffe3075d4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:25.353048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:25.354224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:25.355329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:25.355329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:25.355329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:25.355329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:25.355329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:25.355329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:25.355329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:25.355329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:25.358780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 330/672] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:25.359597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc29426-a2ae-494e-9e73-deffe3075d4c None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:25.439870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d2e4c-0cda-4d2e-b1d6-38bcdaa98133 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:25.463380 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc29426-a2ae-494e-9e73-deffe3075d4c None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:25.475150 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4197a-2e0f-4912-b869-e2f82a60b74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:25.476331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4197a-2e0f-4912-b869-e2f82a60b74c None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:25.476779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4197a-2e0f-4912-b869-e2f82a60b74c None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:25.477201 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4197a-2e0f-4912-b869-e2f82a60b74c None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:25.478091 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4197a-2e0f-4912-b869-e2f82a60b74c None admin] RBAC: Adding query filter params (name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:25.478553 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4197a-2e0f-4912-b869-e2f82a60b74c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:25.480085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4197a-2e0f-4912-b869-e2f82a60b74c None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:25.488783 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 343/673] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:25.489907 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4197a-2e0f-4912-b869-e2f82a60b74c None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:25.499391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2efc2b-9bab-4747-bc97-3f29b5a4a3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:25.500934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2efc2b-9bab-4747-bc97-3f29b5a4a3eb None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:25.501258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2efc2b-9bab-4747-bc97-3f29b5a4a3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:25.502065 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2efc2b-9bab-4747-bc97-3f29b5a4a3eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:25.513359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2efc2b-9bab-4747-bc97-3f29b5a4a3eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:25.514839 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2efc2b-9bab-4747-bc97-3f29b5a4a3eb None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-8c2efc2b-9bab-4747-bc97-3f29b5a4a3eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:25.533969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:25.535089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:25.536200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:25.536200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:25.536200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:25.536200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:25.536200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 331/674] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:25.536510 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2efc2b-9bab-4747-bc97-3f29b5a4a3eb None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:25.594884 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4197a-2e0f-4912-b869-e2f82a60b74c None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:25.628816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6958069-785b-4cb7-82c6-2f53127cead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:25.629729 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958069-785b-4cb7-82c6-2f53127cead7 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:25.630158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958069-785b-4cb7-82c6-2f53127cead7 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:25.630591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958069-785b-4cb7-82c6-2f53127cead7 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:25.631550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6958069-785b-4cb7-82c6-2f53127cead7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:25.632003 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6958069-785b-4cb7-82c6-2f53127cead7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:25.633852 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6958069-785b-4cb7-82c6-2f53127cead7 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:25.638051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2efc2b-9bab-4747-bc97-3f29b5a4a3eb None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:25.647178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 344/675] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:25.648202 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6958069-785b-4cb7-82c6-2f53127cead7 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:25.679618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03732e-04eb-404b-9430-09b076ded2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:25.680402 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03732e-04eb-404b-9430-09b076ded2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:25.680901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03732e-04eb-404b-9430-09b076ded2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:25.681022 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03732e-04eb-404b-9430-09b076ded2f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:25.692705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03732e-04eb-404b-9430-09b076ded2f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:25.694215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03732e-04eb-404b-9430-09b076ded2f6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-2f03732e-04eb-404b-9430-09b076ded2f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:25.714596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:25.715773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:25.716884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:25.716884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:25.716884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:25.716884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:25.716884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 332/676] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:25.717209 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03732e-04eb-404b-9430-09b076ded2f6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:25.762098 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6958069-785b-4cb7-82c6-2f53127cead7 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:25.797572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f8b06-decd-4fe1-ad7e-1ca2d34f6be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:25.799057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f8b06-decd-4fe1-ad7e-1ca2d34f6be2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:25.799485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f8b06-decd-4fe1-ad7e-1ca2d34f6be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:25.799927 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f8b06-decd-4fe1-ad7e-1ca2d34f6be2 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:25.800795 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f8b06-decd-4fe1-ad7e-1ca2d34f6be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:25.801253 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f8b06-decd-4fe1-ad7e-1ca2d34f6be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:25.802796 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f8b06-decd-4fe1-ad7e-1ca2d34f6be2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:25.815677 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 345/677] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:25.816785 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f8b06-decd-4fe1-ad7e-1ca2d34f6be2 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:25.822701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03732e-04eb-404b-9430-09b076ded2f6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:25.858032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc6540-b610-4016-b2f1-cb4c50907d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:25.858807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6540-b610-4016-b2f1-cb4c50907d98 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:25.859031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6540-b610-4016-b2f1-cb4c50907d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:25.859299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6540-b610-4016-b2f1-cb4c50907d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:25.860124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc6540-b610-4016-b2f1-cb4c50907d98 None admin] RBAC: Adding query filter params (role.id=511b62180d4c4881999e65dfab877783, scope.project.id=745af7d676704a179668d6685724ed78, user.id=7ffc2e3a517e48c4bf368bdc0dd18ba7) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:25.860426 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc6540-b610-4016-b2f1-cb4c50907d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:25.863125 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc6540-b610-4016-b2f1-cb4c50907d98 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:25.874985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 333/678] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:25 2022] GET /identity/v3/role_assignments?user.id=7ffc2e3a517e48c4bf368bdc0dd18ba7&scope.project.id=745af7d676704a179668d6685724ed78&role.id=511b62180d4c4881999e65dfab877783 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:25.875948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc6540-b610-4016-b2f1-cb4c50907d98 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:25.921865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f8b06-decd-4fe1-ad7e-1ca2d34f6be2 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:25.957620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f924a-73c9-42e4-b4ec-a05b8f9186de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:25.958531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f924a-73c9-42e4-b4ec-a05b8f9186de None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:25.959184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f924a-73c9-42e4-b4ec-a05b8f9186de None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:25.959719 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f924a-73c9-42e4-b4ec-a05b8f9186de None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:25.960589 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f924a-73c9-42e4-b4ec-a05b8f9186de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:25.961038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f924a-73c9-42e4-b4ec-a05b8f9186de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:25.962556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f924a-73c9-42e4-b4ec-a05b8f9186de None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:25.977439 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 346/679] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:25.987997 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f924a-73c9-42e4-b4ec-a05b8f9186de None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:26.024134 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc6540-b610-4016-b2f1-cb4c50907d98 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:26.089235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a97f97-8bfc-48c6-9029-2417bfe99166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:26.090042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a97f97-8bfc-48c6-9029-2417bfe99166 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:26.090317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a97f97-8bfc-48c6-9029-2417bfe99166 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:26.091386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a97f97-8bfc-48c6-9029-2417bfe99166 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:26.106712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a97f97-8bfc-48c6-9029-2417bfe99166 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:26.108266 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a97f97-8bfc-48c6-9029-2417bfe99166 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-a8a97f97-8bfc-48c6-9029-2417bfe99166 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:26.124235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:26.125360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:26.126554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:26.126554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:26.126554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:26.126554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:26.126554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:26.126554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:26.126554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:26.126554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:26.126554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 334/680] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:26.135741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a97f97-8bfc-48c6-9029-2417bfe99166 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:26.162494 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f924a-73c9-42e4-b4ec-a05b8f9186de None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:26.225150 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060c8de-0811-48d6-a5c4-70d63406108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:26.226054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c8de-0811-48d6-a5c4-70d63406108a None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:26.226344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c8de-0811-48d6-a5c4-70d63406108a None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:26.226622 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c8de-0811-48d6-a5c4-70d63406108a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:26.238517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060c8de-0811-48d6-a5c4-70d63406108a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:26.242778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060c8de-0811-48d6-a5c4-70d63406108a None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:26.261534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a97f97-8bfc-48c6-9029-2417bfe99166 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-b060c8de-0811-48d6-a5c4-70d63406108a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:26.262240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:26.263219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:26.264161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:26.264161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:26.264161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:26.264161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:26.264161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:26.264161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:26.264161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:26.264161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:26.264161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 17:29:26.264161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:26.264161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 347/681] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:29:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:26.269581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060c8de-0811-48d6-a5c4-70d63406108a None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:26.302475 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b502b-eec3-4a33-9cd7-0ca5902b36b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:26.303103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b502b-eec3-4a33-9cd7-0ca5902b36b6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:26.303427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b502b-eec3-4a33-9cd7-0ca5902b36b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:26.303699 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b502b-eec3-4a33-9cd7-0ca5902b36b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:26.304479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b502b-eec3-4a33-9cd7-0ca5902b36b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:26.304832 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b502b-eec3-4a33-9cd7-0ca5902b36b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:26.306267 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b502b-eec3-4a33-9cd7-0ca5902b36b6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:26.320678 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 335/682] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:26.326183 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b502b-eec3-4a33-9cd7-0ca5902b36b6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:26.393446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060c8de-0811-48d6-a5c4-70d63406108a None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:26.437250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd73a2c-d98b-437b-98ea-bbe8e1c5d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:26.437930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd73a2c-d98b-437b-98ea-bbe8e1c5d8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:26.438211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd73a2c-d98b-437b-98ea-bbe8e1c5d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:26.438483 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd73a2c-d98b-437b-98ea-bbe8e1c5d8c8 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:26.439564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd73a2c-d98b-437b-98ea-bbe8e1c5d8c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:26.439872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd73a2c-d98b-437b-98ea-bbe8e1c5d8c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:26.441631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd73a2c-d98b-437b-98ea-bbe8e1c5d8c8 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:26.472487 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b502b-eec3-4a33-9cd7-0ca5902b36b6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:26.474927 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 348/683] 10.222.0.76 () {56 vars in 1135 bytes} [Thu May 12 17:29:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:26.482717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd73a2c-d98b-437b-98ea-bbe8e1c5d8c8 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:26.551379 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e354a4e-a52d-4934-bbb0-b2ecefda8038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:26.552039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e354a4e-a52d-4934-bbb0-b2ecefda8038 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:26.552320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e354a4e-a52d-4934-bbb0-b2ecefda8038 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:26.552644 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e354a4e-a52d-4934-bbb0-b2ecefda8038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:26.553431 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e354a4e-a52d-4934-bbb0-b2ecefda8038 None admin] RBAC: Adding query filter params (role.id=511b62180d4c4881999e65dfab877783, scope.project.id=745af7d676704a179668d6685724ed78, user.id=731d9124a2294b95a7cf1127e5362b66) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:26.553737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e354a4e-a52d-4934-bbb0-b2ecefda8038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:26.555211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e354a4e-a52d-4934-bbb0-b2ecefda8038 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:26.568943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 336/684] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:26 2022] GET /identity/v3/role_assignments?user.id=731d9124a2294b95a7cf1127e5362b66&scope.project.id=745af7d676704a179668d6685724ed78&role.id=511b62180d4c4881999e65dfab877783 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:26.638386 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd73a2c-d98b-437b-98ea-bbe8e1c5d8c8 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:26.674839 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7803c52-56b6-493f-88e1-1361d50e4bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:26.675496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7803c52-56b6-493f-88e1-1361d50e4bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:26.675776 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7803c52-56b6-493f-88e1-1361d50e4bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:26.676049 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7803c52-56b6-493f-88e1-1361d50e4bb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:26.754099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7803c52-56b6-493f-88e1-1361d50e4bb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:26.755602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7803c52-56b6-493f-88e1-1361d50e4bb6 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:26.859854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 349/685] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:29:26.865960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e354a4e-a52d-4934-bbb0-b2ecefda8038 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:26.938342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469db8e0-716b-4721-b824-70792d28ce1a None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:26.938713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469db8e0-716b-4721-b824-70792d28ce1a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:26.938951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469db8e0-716b-4721-b824-70792d28ce1a None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:26.940799 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 350/686] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:26.946580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94410995-7f08-4ba6-ab0f-4822cd7e4b36 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:26.946892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94410995-7f08-4ba6-ab0f-4822cd7e4b36 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:26.947169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94410995-7f08-4ba6-ab0f-4822cd7e4b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:26.969667 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-94410995-7f08-4ba6-ab0f-4822cd7e4b36 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:26.971620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-94410995-7f08-4ba6-ab0f-4822cd7e4b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:27.016258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e354a4e-a52d-4934-bbb0-b2ecefda8038 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:27.046696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 351/687] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 17:29:27.055761 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642d738-8c70-452e-aa18-9e72d85409ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:27.056563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642d738-8c70-452e-aa18-9e72d85409ac None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:27.056841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642d738-8c70-452e-aa18-9e72d85409ac None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:27.057115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642d738-8c70-452e-aa18-9e72d85409ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:27.069304 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642d738-8c70-452e-aa18-9e72d85409ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:27.070814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642d738-8c70-452e-aa18-9e72d85409ac None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:27.073365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94410995-7f08-4ba6-ab0f-4822cd7e4b36 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-6642d738-8c70-452e-aa18-9e72d85409ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:27.100814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:27.101764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:27.102691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:27.102691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:27.102691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:27.102691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:27.104155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 337/688] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:27.109427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642d738-8c70-452e-aa18-9e72d85409ac None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:27.209666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94410995-7f08-4ba6-ab0f-4822cd7e4b36 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:27.226215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642d738-8c70-452e-aa18-9e72d85409ac None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:27.247255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea2d9f-f45e-48af-95ea-f9814d888a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:27.248060 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea2d9f-f45e-48af-95ea-f9814d888a8f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:27.248343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea2d9f-f45e-48af-95ea-f9814d888a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:27.248619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea2d9f-f45e-48af-95ea-f9814d888a8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:27.259824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea2d9f-f45e-48af-95ea-f9814d888a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:27.262546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803cc75-2a21-4b9f-85ed-64bbd7922b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:27.263250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803cc75-2a21-4b9f-85ed-64bbd7922b7e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:27.263527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803cc75-2a21-4b9f-85ed-64bbd7922b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:27.263801 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803cc75-2a21-4b9f-85ed-64bbd7922b7e None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:27.264530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803cc75-2a21-4b9f-85ed-64bbd7922b7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:27.264832 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803cc75-2a21-4b9f-85ed-64bbd7922b7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:27.266214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803cc75-2a21-4b9f-85ed-64bbd7922b7e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-33ea2d9f-f45e-48af-95ea-f9814d888a8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:27.268759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:27.269692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:27.270541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:27.270541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:27.270541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:27.270541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:27.270541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:27.270541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:27.270541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:27.270541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:27.270541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:27.270541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:27.270541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:29:27.270541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:27.270541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 352/689] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:29:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:27.279647 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea2d9f-f45e-48af-95ea-f9814d888a8f None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:27.280269 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 338/690] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:27.288113 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803cc75-2a21-4b9f-85ed-64bbd7922b7e None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:27.413304 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803cc75-2a21-4b9f-85ed-64bbd7922b7e None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:27.452319 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6be063-8e3f-4b3d-9696-1c43df286b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:27.453116 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6be063-8e3f-4b3d-9696-1c43df286b8e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:27.453390 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6be063-8e3f-4b3d-9696-1c43df286b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:27.453657 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6be063-8e3f-4b3d-9696-1c43df286b8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:27.463783 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6be063-8e3f-4b3d-9696-1c43df286b8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:27.466455 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6be063-8e3f-4b3d-9696-1c43df286b8e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:27.485750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea2d9f-f45e-48af-95ea-f9814d888a8f None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-fb6be063-8e3f-4b3d-9696-1c43df286b8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:27.490058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:27.491246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:27.492142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:27.492142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:27.492142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:27.492142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:27.492142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:27.492142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:27.492142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:27.492142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:27.492142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 339/691] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:27.494760 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85195dc4-3313-46e5-af2e-cb419563f991 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:27.495056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85195dc4-3313-46e5-af2e-cb419563f991 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:27.495335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85195dc4-3313-46e5-af2e-cb419563f991 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:27.496978 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 340/692] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:27.500165 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85195dc4-3313-46e5-af2e-cb419563f991 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:27.528063 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef3f45-1786-450e-9b7a-adea5e44ccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:27.528776 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef3f45-1786-450e-9b7a-adea5e44ccc0 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:27.529002 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef3f45-1786-450e-9b7a-adea5e44ccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:27.529271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef3f45-1786-450e-9b7a-adea5e44ccc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:27.530007 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef3f45-1786-450e-9b7a-adea5e44ccc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:27.530307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef3f45-1786-450e-9b7a-adea5e44ccc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:27.531714 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef3f45-1786-450e-9b7a-adea5e44ccc0 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:27.546080 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 353/693] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:29:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:27.547432 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915dc5a-e704-40b2-b085-e6546c8d4cf1 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:27.547715 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915dc5a-e704-40b2-b085-e6546c8d4cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:27.547990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915dc5a-e704-40b2-b085-e6546c8d4cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:27.565502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-b915dc5a-e704-40b2-b085-e6546c8d4cf1 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:27.566691 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b915dc5a-e704-40b2-b085-e6546c8d4cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:27.606926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85195dc4-3313-46e5-af2e-cb419563f991 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:27.644360 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 354/694] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:27.645676 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915dc5a-e704-40b2-b085-e6546c8d4cf1 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:27.659427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc52573-c4fa-4ff9-9fb5-2e814c7ed51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:27.660101 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc52573-c4fa-4ff9-9fb5-2e814c7ed51f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:27.660380 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc52573-c4fa-4ff9-9fb5-2e814c7ed51f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:27.660654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc52573-c4fa-4ff9-9fb5-2e814c7ed51f None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:27.661446 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc52573-c4fa-4ff9-9fb5-2e814c7ed51f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:27.661751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc52573-c4fa-4ff9-9fb5-2e814c7ed51f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:27.663218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc52573-c4fa-4ff9-9fb5-2e814c7ed51f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:27.682216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 341/695] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:27.683168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc52573-c4fa-4ff9-9fb5-2e814c7ed51f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:27.749934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915dc5a-e704-40b2-b085-e6546c8d4cf1 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:27.784236 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc52573-c4fa-4ff9-9fb5-2e814c7ed51f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:27.786068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2feda5-5d37-47df-8a60-d586f934748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:27.786898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2feda5-5d37-47df-8a60-d586f934748b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:27.787177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2feda5-5d37-47df-8a60-d586f934748b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:27.787449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2feda5-5d37-47df-8a60-d586f934748b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:27.797707 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2feda5-5d37-47df-8a60-d586f934748b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:27.799949 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2feda5-5d37-47df-8a60-d586f934748b None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-7e2feda5-5d37-47df-8a60-d586f934748b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:27.819387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:27.821502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:27.823651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:27.823651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:27.823651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:27.823651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:27.824150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c42346-1494-49c6-b9d1-155cb120efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:27.824150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c42346-1494-49c6-b9d1-155cb120efdc None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:27.824150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c42346-1494-49c6-b9d1-155cb120efdc None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:27.824150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c42346-1494-49c6-b9d1-155cb120efdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:27.824693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 355/696] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:27.824693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2feda5-5d37-47df-8a60-d586f934748b None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:27.838638 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c42346-1494-49c6-b9d1-155cb120efdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:27.840758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c42346-1494-49c6-b9d1-155cb120efdc None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-78c42346-1494-49c6-b9d1-155cb120efdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:27.864924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:27.867069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:27.869224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:27.869224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:27.869224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:27.869224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:27.869224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 342/697] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:27.869224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c42346-1494-49c6-b9d1-155cb120efdc None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:27.952504 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2feda5-5d37-47df-8a60-d586f934748b None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:27.977036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c42346-1494-49c6-b9d1-155cb120efdc None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:27.994107 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8191e6-f8fb-4760-be21-57c891cfd9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:27.994788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8191e6-f8fb-4760-be21-57c891cfd9cd None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:27.995065 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8191e6-f8fb-4760-be21-57c891cfd9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:27.995381 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8191e6-f8fb-4760-be21-57c891cfd9cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:27.996212 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8191e6-f8fb-4760-be21-57c891cfd9cd None admin] RBAC: Adding query filter params (role.id=511b62180d4c4881999e65dfab877783, scope.project.id=745af7d676704a179668d6685724ed78, user.id=0e679573cc984993b98e416fabd586d4) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:27.996617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8191e6-f8fb-4760-be21-57c891cfd9cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:27.998052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8191e6-f8fb-4760-be21-57c891cfd9cd None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:28.005163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 356/698] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:27 2022] GET /identity/v3/role_assignments?user.id=0e679573cc984993b98e416fabd586d4&scope.project.id=745af7d676704a179668d6685724ed78&role.id=511b62180d4c4881999e65dfab877783 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:28.005957 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8191e6-f8fb-4760-be21-57c891cfd9cd None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:28.016395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2826a3b-47fb-4653-a020-7409e6a1fe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:28.017114 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2826a3b-47fb-4653-a020-7409e6a1fe05 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:28.018921 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2826a3b-47fb-4653-a020-7409e6a1fe05 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:28.019198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2826a3b-47fb-4653-a020-7409e6a1fe05 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:28.020248 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2826a3b-47fb-4653-a020-7409e6a1fe05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:28.020554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2826a3b-47fb-4653-a020-7409e6a1fe05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:28.022250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2826a3b-47fb-4653-a020-7409e6a1fe05 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:28.044948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 343/699] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:28.046171 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2826a3b-47fb-4653-a020-7409e6a1fe05 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:28.130075 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8191e6-f8fb-4760-be21-57c891cfd9cd None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:28.166248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8cf9b-0c84-4a9c-a0c2-be11b02490cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:28.166798 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2826a3b-47fb-4653-a020-7409e6a1fe05 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:28.166997 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8cf9b-0c84-4a9c-a0c2-be11b02490cf None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:28.167193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8cf9b-0c84-4a9c-a0c2-be11b02490cf None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:28.167478 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8cf9b-0c84-4a9c-a0c2-be11b02490cf None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:28.168206 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8cf9b-0c84-4a9c-a0c2-be11b02490cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:28.168511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8cf9b-0c84-4a9c-a0c2-be11b02490cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:28.170278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8cf9b-0c84-4a9c-a0c2-be11b02490cf None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:28.190346 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 357/700] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:28.191611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8cf9b-0c84-4a9c-a0c2-be11b02490cf None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:28.213370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d91d58-00c0-4047-b61d-29c74e36ce73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:28.214169 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d91d58-00c0-4047-b61d-29c74e36ce73 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:28.214453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d91d58-00c0-4047-b61d-29c74e36ce73 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:28.214784 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d91d58-00c0-4047-b61d-29c74e36ce73 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:28.224065 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d91d58-00c0-4047-b61d-29c74e36ce73 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:28.225597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d91d58-00c0-4047-b61d-29c74e36ce73 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-c4d91d58-00c0-4047-b61d-29c74e36ce73 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:28.241254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:28.242195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:28.243181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:28.243181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:28.243181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:28.243181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:28.243181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:28.243181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:28.243181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:28.243181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:28.243181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 17:29:28.243181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:28.246826 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 344/701] 10.222.0.76 () {56 vars in 1093 bytes} [Thu May 12 17:29:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:28.249177 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d91d58-00c0-4047-b61d-29c74e36ce73 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:28.323377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8cf9b-0c84-4a9c-a0c2-be11b02490cf None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:28.365017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755e2b8-f266-4364-a115-38306149e29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:28.366151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755e2b8-f266-4364-a115-38306149e29d None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:28.366582 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755e2b8-f266-4364-a115-38306149e29d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:28.367351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755e2b8-f266-4364-a115-38306149e29d None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:28.368503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755e2b8-f266-4364-a115-38306149e29d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:28.370376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755e2b8-f266-4364-a115-38306149e29d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:28.403871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 358/702] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:29:28 2022] POST /identity/v3/users => generated 254 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:29:28.428883 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d91d58-00c0-4047-b61d-29c74e36ce73 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:28.477018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508e6f7-8bb6-4df1-b06c-8efa4f6df86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:28.477967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508e6f7-8bb6-4df1-b06c-8efa4f6df86c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:28.478395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508e6f7-8bb6-4df1-b06c-8efa4f6df86c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:28.478882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508e6f7-8bb6-4df1-b06c-8efa4f6df86c None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:28.479893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508e6f7-8bb6-4df1-b06c-8efa4f6df86c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:28.480355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508e6f7-8bb6-4df1-b06c-8efa4f6df86c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:28.482014 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508e6f7-8bb6-4df1-b06c-8efa4f6df86c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:28.514662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 345/703] 10.222.0.76 () {56 vars in 1133 bytes} [Thu May 12 17:29:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:28.520994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755e2b8-f266-4364-a115-38306149e29d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:28.647219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755e2b8-f266-4364-a115-38306149e29d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:28.682344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408a9b2-cb47-4275-9111-c6c24f15ab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:28.683026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408a9b2-cb47-4275-9111-c6c24f15ab66 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:28.683306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408a9b2-cb47-4275-9111-c6c24f15ab66 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:28.683580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408a9b2-cb47-4275-9111-c6c24f15ab66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:28.753254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408a9b2-cb47-4275-9111-c6c24f15ab66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:28.754699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408a9b2-cb47-4275-9111-c6c24f15ab66 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:28.837094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e9fa5-3f2a-47b7-9767-98aa99be3259 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:28.837371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e9fa5-3f2a-47b7-9767-98aa99be3259 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:28.837650 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e9fa5-3f2a-47b7-9767-98aa99be3259 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:28.839317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 346/704] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:29:28.844173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a71f6-cc1a-4014-a719-f92d1a89b585 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:28.844591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a71f6-cc1a-4014-a719-f92d1a89b585 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:28.844965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a71f6-cc1a-4014-a719-f92d1a89b585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:28.867449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 359/705] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:29:28.870501 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-de6a71f6-cc1a-4014-a719-f92d1a89b585 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:28.871892 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-de6a71f6-cc1a-4014-a719-f92d1a89b585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:28.872657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408a9b2-cb47-4275-9111-c6c24f15ab66 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:28.952581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 347/706] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:28.975288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a71f6-cc1a-4014-a719-f92d1a89b585 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:28.985009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408a9b2-cb47-4275-9111-c6c24f15ab66 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:29.021130 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc9d0c-3580-4e41-ba7e-1417fa6727ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:29.021888 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9d0c-3580-4e41-ba7e-1417fa6727ef None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:29.022169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9d0c-3580-4e41-ba7e-1417fa6727ef None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:29.022443 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9d0c-3580-4e41-ba7e-1417fa6727ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:29.032919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc9d0c-3580-4e41-ba7e-1417fa6727ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:29.034378 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc9d0c-3580-4e41-ba7e-1417fa6727ef None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-a8dc9d0c-3580-4e41-ba7e-1417fa6727ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:29.053271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:29.054244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:29.055557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:29.055557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:29.055557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:29.055557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:29.058992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 360/707] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:29.060197 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc9d0c-3580-4e41-ba7e-1417fa6727ef None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:29.083198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a71f6-cc1a-4014-a719-f92d1a89b585 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:29.118986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47e36c-a8de-4a29-ada5-574b6e33c926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:29.120221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47e36c-a8de-4a29-ada5-574b6e33c926 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:29.120769 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47e36c-a8de-4a29-ada5-574b6e33c926 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:29.121240 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47e36c-a8de-4a29-ada5-574b6e33c926 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:29.122095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47e36c-a8de-4a29-ada5-574b6e33c926 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:29.123685 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47e36c-a8de-4a29-ada5-574b6e33c926 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-fb47e36c-a8de-4a29-ada5-574b6e33c926 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:29.139336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:29.140372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 17:29:29.141219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:29.144323 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 348/708] 10.222.0.76 () {56 vars in 1129 bytes} [Thu May 12 17:29:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:29.150338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47e36c-a8de-4a29-ada5-574b6e33c926 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:29.166525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc9d0c-3580-4e41-ba7e-1417fa6727ef None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:29.201357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82bcb5-a91c-4138-8525-b3ea6b89b896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:29.202021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82bcb5-a91c-4138-8525-b3ea6b89b896 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:29.202302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82bcb5-a91c-4138-8525-b3ea6b89b896 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:29.202636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82bcb5-a91c-4138-8525-b3ea6b89b896 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:29.203332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82bcb5-a91c-4138-8525-b3ea6b89b896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:29.203654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82bcb5-a91c-4138-8525-b3ea6b89b896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:29.205262 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82bcb5-a91c-4138-8525-b3ea6b89b896 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:29.221556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 361/709] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:29.223061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82bcb5-a91c-4138-8525-b3ea6b89b896 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:29.263353 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47e36c-a8de-4a29-ada5-574b6e33c926 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:29.304949 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e109d-789f-4502-ba4c-ccd914cd9344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:29.305915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e109d-789f-4502-ba4c-ccd914cd9344 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:29.306420 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e109d-789f-4502-ba4c-ccd914cd9344 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:29.306921 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e109d-789f-4502-ba4c-ccd914cd9344 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:29.307959 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e109d-789f-4502-ba4c-ccd914cd9344 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:29.308475 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e109d-789f-4502-ba4c-ccd914cd9344 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:29.310055 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e109d-789f-4502-ba4c-ccd914cd9344 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:29.315361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 349/710] 10.222.0.76 () {56 vars in 1124 bytes} [Thu May 12 17:29:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:29.320960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e109d-789f-4502-ba4c-ccd914cd9344 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:29.325356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82bcb5-a91c-4138-8525-b3ea6b89b896 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:29.359019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a4041-2714-4985-a5c3-6f4ea26cdf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:29.359821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a4041-2714-4985-a5c3-6f4ea26cdf91 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:29.360090 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a4041-2714-4985-a5c3-6f4ea26cdf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:29.360364 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a4041-2714-4985-a5c3-6f4ea26cdf91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:29.367918 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a4041-2714-4985-a5c3-6f4ea26cdf91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:29.369362 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a4041-2714-4985-a5c3-6f4ea26cdf91 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-3c5a4041-2714-4985-a5c3-6f4ea26cdf91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:29.384180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:29.385140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:29.386039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:29.386039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:29.386039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:29.386039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:29.386039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:29.386039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:29.386039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:29.386039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:29.389983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 362/711] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:29.391026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a4041-2714-4985-a5c3-6f4ea26cdf91 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:29.444638 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e109d-789f-4502-ba4c-ccd914cd9344 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:29.492185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a4041-2714-4985-a5c3-6f4ea26cdf91 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:29.503585 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67a133-c9ec-4530-82c0-ce88a51245c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:29.504566 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67a133-c9ec-4530-82c0-ce88a51245c2 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:29.505051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67a133-c9ec-4530-82c0-ce88a51245c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:29.505529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67a133-c9ec-4530-82c0-ce88a51245c2 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:29.506507 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67a133-c9ec-4530-82c0-ce88a51245c2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:29.507029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67a133-c9ec-4530-82c0-ce88a51245c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:29.508852 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67a133-c9ec-4530-82c0-ce88a51245c2 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:29.523807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 350/712] 10.222.0.76 () {56 vars in 1124 bytes} [Thu May 12 17:29:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:29.527924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5805ab3-f463-404a-b76a-5d235dac5fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:29.528600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5805ab3-f463-404a-b76a-5d235dac5fff None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:29.528881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5805ab3-f463-404a-b76a-5d235dac5fff None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:29.529155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5805ab3-f463-404a-b76a-5d235dac5fff None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:29.529952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5805ab3-f463-404a-b76a-5d235dac5fff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:29.530261 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5805ab3-f463-404a-b76a-5d235dac5fff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:29.531754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5805ab3-f463-404a-b76a-5d235dac5fff None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:29.552543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 363/713] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:29.558597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67a133-c9ec-4530-82c0-ce88a51245c2 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:29.727083 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67a133-c9ec-4530-82c0-ce88a51245c2 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:29.774576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3b7a2-2b8b-4814-a07e-43719dbbd46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:29.775182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3b7a2-2b8b-4814-a07e-43719dbbd46f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:29.775462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3b7a2-2b8b-4814-a07e-43719dbbd46f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:29.775732 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3b7a2-2b8b-4814-a07e-43719dbbd46f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:29.776567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3b7a2-2b8b-4814-a07e-43719dbbd46f None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=745af7d676704a179668d6685724ed78, user.id=04ad234318ad47589b844351cd3bb3e3) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:29.776870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3b7a2-2b8b-4814-a07e-43719dbbd46f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:29.778302 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3b7a2-2b8b-4814-a07e-43719dbbd46f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:29.788537 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 351/714] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:29 2022] GET /identity/v3/role_assignments?user.id=04ad234318ad47589b844351cd3bb3e3&scope.project.id=745af7d676704a179668d6685724ed78&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:29.933223 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb75e1-9972-4d5b-afae-c2110bef8e9d None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:29.933774 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb75e1-9972-4d5b-afae-c2110bef8e9d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:29.934215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb75e1-9972-4d5b-afae-c2110bef8e9d None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:29.935845 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 364/715] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:29.942462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3562-0051-40dd-b8ab-412bd300f001 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:29.943126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3562-0051-40dd-b8ab-412bd300f001 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:29.943611 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a3562-0051-40dd-b8ab-412bd300f001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:29.967882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-679a3562-0051-40dd-b8ab-412bd300f001 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:29.969508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-679a3562-0051-40dd-b8ab-412bd300f001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:30.055506 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 352/716] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:30.089981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb75e1-9972-4d5b-afae-c2110bef8e9d None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:30.216469 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb75e1-9972-4d5b-afae-c2110bef8e9d None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:30.264306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91113350-5f5e-4c51-bf5e-ad7b2e40da46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:30.265160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91113350-5f5e-4c51-bf5e-ad7b2e40da46 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:30.265445 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91113350-5f5e-4c51-bf5e-ad7b2e40da46 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:30.265719 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91113350-5f5e-4c51-bf5e-ad7b2e40da46 None admin] PATH_INFO: `/v3/services/network` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:30.266372 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91113350-5f5e-4c51-bf5e-ad7b2e40da46 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:30.268503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91113350-5f5e-4c51-bf5e-ad7b2e40da46 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-91113350-5f5e-4c51-bf5e-ad7b2e40da46 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:30.284363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:30.285400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:30.286260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 365/717] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:30 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:30.298145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a3562-0051-40dd-b8ab-412bd300f001 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:30.442931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a3562-0051-40dd-b8ab-412bd300f001 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:30.488281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b36db-8f14-4da5-9904-874d8d9c1ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:30.489349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b36db-8f14-4da5-9904-874d8d9c1ece None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:30.489833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b36db-8f14-4da5-9904-874d8d9c1ece None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:30.490323 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b36db-8f14-4da5-9904-874d8d9c1ece None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:30.491272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b36db-8f14-4da5-9904-874d8d9c1ece None admin] RBAC: Adding query filter params (name=network) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:30.491778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b36db-8f14-4da5-9904-874d8d9c1ece None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:30.493368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b36db-8f14-4da5-9904-874d8d9c1ece None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:30.500195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 353/718] 10.222.0.76 () {56 vars in 1112 bytes} [Thu May 12 17:29:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:30.508060 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91113350-5f5e-4c51-bf5e-ad7b2e40da46 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:30.621854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91113350-5f5e-4c51-bf5e-ad7b2e40da46 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:30.662164 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a6863-9e86-4e90-a872-9a07173cf750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:30.662858 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6863-9e86-4e90-a872-9a07173cf750 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:30.663142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6863-9e86-4e90-a872-9a07173cf750 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:30.663416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6863-9e86-4e90-a872-9a07173cf750 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:30.664128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a6863-9e86-4e90-a872-9a07173cf750 None admin] RBAC: Adding query filter params (type=network) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:30.664436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a6863-9e86-4e90-a872-9a07173cf750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:30.665824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a6863-9e86-4e90-a872-9a07173cf750 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:30.672622 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 366/719] 10.222.0.76 () {56 vars in 1112 bytes} [Thu May 12 17:29:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:31.270725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228997fa-a56a-4d8d-aba3-1ad68fe05e1d None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:31.270725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228997fa-a56a-4d8d-aba3-1ad68fe05e1d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:31.270725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228997fa-a56a-4d8d-aba3-1ad68fe05e1d None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:31.271821 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 354/720] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:31.278248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e858f-9054-41f0-be89-768464c673c9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:31.278536 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e858f-9054-41f0-be89-768464c673c9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:31.278852 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e858f-9054-41f0-be89-768464c673c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:31.308199 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-696e858f-9054-41f0-be89-768464c673c9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:31.309407 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-696e858f-9054-41f0-be89-768464c673c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:31.464360 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 367/721] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:31.495879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228997fa-a56a-4d8d-aba3-1ad68fe05e1d None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:31.664127 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b758b-0d69-4428-a6d5-003a4d6cbce3 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:31.664646 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b758b-0d69-4428-a6d5-003a4d6cbce3 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:31.664754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b758b-0d69-4428-a6d5-003a4d6cbce3 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:31.666042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 368/722] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:31.671124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228997fa-a56a-4d8d-aba3-1ad68fe05e1d None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:31.700179 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464dd3-a61f-4d9f-9b17-2b7a06254b19 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:31.700507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464dd3-a61f-4d9f-9b17-2b7a06254b19 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:31.700804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d464dd3-a61f-4d9f-9b17-2b7a06254b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:31.718252 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dd9cc-05e5-4312-b4bd-e216234743dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:31.719076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd9cc-05e5-4312-b4bd-e216234743dc None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:31.719359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd9cc-05e5-4312-b4bd-e216234743dc None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:31.719633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd9cc-05e5-4312-b4bd-e216234743dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:31.742253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dd9cc-05e5-4312-b4bd-e216234743dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-b32dd9cc-05e5-4312-b4bd-e216234743dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:31.750075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:31.751147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:31.752294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:31.752294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:31.752294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:31.752294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:31.752294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:31.752294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:31.752294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:31.752294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:31.752294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:31.752294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:31.752294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:29:31.752294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:31.767733 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 355/723] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:29:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:31.768755 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dd9cc-05e5-4312-b4bd-e216234743dc None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:31.905562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dd9cc-05e5-4312-b4bd-e216234743dc None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:31.950554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-1d464dd3-a61f-4d9f-9b17-2b7a06254b19 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:31.953120 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-1d464dd3-a61f-4d9f-9b17-2b7a06254b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:31.956237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7d98c-b1df-490c-a285-ea415b5db9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:31.956913 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d98c-b1df-490c-a285-ea415b5db9af None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:31.957191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d98c-b1df-490c-a285-ea415b5db9af None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:31.957461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d98c-b1df-490c-a285-ea415b5db9af None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:31.958215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7d98c-b1df-490c-a285-ea415b5db9af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:31.958517 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7d98c-b1df-490c-a285-ea415b5db9af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:31.959997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7d98c-b1df-490c-a285-ea415b5db9af None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:31.978847 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 356/724] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:29:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:31.987740 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7d98c-b1df-490c-a285-ea415b5db9af None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:32.042930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 369/725] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:32.082401 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d464dd3-a61f-4d9f-9b17-2b7a06254b19 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:32.131745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7d98c-b1df-490c-a285-ea415b5db9af None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:32.166663 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2c69c-75c4-4bd8-aa62-94921154b90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:32.167555 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2c69c-75c4-4bd8-aa62-94921154b90f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:32.167798 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2c69c-75c4-4bd8-aa62-94921154b90f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:32.168071 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2c69c-75c4-4bd8-aa62-94921154b90f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:32.181124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2c69c-75c4-4bd8-aa62-94921154b90f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:32.182705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2c69c-75c4-4bd8-aa62-94921154b90f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-ade2c69c-75c4-4bd8-aa62-94921154b90f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:32.201984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:32.203028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:32.203941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:32.203941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:32.203941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:32.203941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:32.203941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 357/726] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:32.209624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2c69c-75c4-4bd8-aa62-94921154b90f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:32.311301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2c69c-75c4-4bd8-aa62-94921154b90f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:32.322318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d464dd3-a61f-4d9f-9b17-2b7a06254b19 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:32.346648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070dea7-3cb7-43a5-98a4-f524a49c8bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:32.347346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070dea7-3cb7-43a5-98a4-f524a49c8bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:32.347675 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070dea7-3cb7-43a5-98a4-f524a49c8bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:32.347954 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070dea7-3cb7-43a5-98a4-f524a49c8bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:32.348672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070dea7-3cb7-43a5-98a4-f524a49c8bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:32.348976 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070dea7-3cb7-43a5-98a4-f524a49c8bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:32.350337 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070dea7-3cb7-43a5-98a4-f524a49c8bf8 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:32.357882 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f9b80-30d9-47c6-afc1-735f676b3e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:32.358972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f9b80-30d9-47c6-afc1-735f676b3e92 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:32.359455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f9b80-30d9-47c6-afc1-735f676b3e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:32.359935 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f9b80-30d9-47c6-afc1-735f676b3e92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:32.369159 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 358/727] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:32.369159 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070dea7-3cb7-43a5-98a4-f524a49c8bf8 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:32.391637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f9b80-30d9-47c6-afc1-735f676b3e92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-172f9b80-30d9-47c6-afc1-735f676b3e92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:32.406694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:32.407836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:32.408831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:32.408831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:32.408831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:32.408831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:32.408831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:32.408831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:32.408831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:32.408831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:32.408831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:32.408831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:32.408831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:32.408831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:32.411310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 370/728] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:32.416799 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f9b80-30d9-47c6-afc1-735f676b3e92 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:32.478029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070dea7-3cb7-43a5-98a4-f524a49c8bf8 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:32.512691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc468f-3bdd-483e-b02b-ad7095794fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:32.513491 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc468f-3bdd-483e-b02b-ad7095794fac None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:32.513772 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc468f-3bdd-483e-b02b-ad7095794fac None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:32.514043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc468f-3bdd-483e-b02b-ad7095794fac None admin] PATH_INFO: `/v3/users/swift` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:32.522330 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc468f-3bdd-483e-b02b-ad7095794fac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:32.523894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc468f-3bdd-483e-b02b-ad7095794fac None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:32.538131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f9b80-30d9-47c6-afc1-735f676b3e92 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-29dc468f-3bdd-483e-b02b-ad7095794fac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:32.540049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:32.540962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:32.541930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:32.541930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:32.541930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:32.541930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:32.541930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:32.541930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:32.541930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:32.541930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:32.541930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 17:29:32.541930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:32.541930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 359/729] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:29:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:32.547155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93bfd8-d464-4e75-b201-c4da01220517 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:32.547471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93bfd8-d464-4e75-b201-c4da01220517 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:32.547737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93bfd8-d464-4e75-b201-c4da01220517 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:32.550124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 360/730] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:32.551808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93bfd8-d464-4e75-b201-c4da01220517 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:32.585564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746c822-9f48-49fd-96a9-572b7c712176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:32.586764 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c822-9f48-49fd-96a9-572b7c712176 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:32.587377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c822-9f48-49fd-96a9-572b7c712176 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:32.588109 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c822-9f48-49fd-96a9-572b7c712176 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:32.589282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746c822-9f48-49fd-96a9-572b7c712176 None admin] RBAC: Adding query filter params (name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:32.589829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746c822-9f48-49fd-96a9-572b7c712176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:32.591550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746c822-9f48-49fd-96a9-572b7c712176 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:32.602415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 371/731] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:32.603909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0c55-39db-4684-ab92-1218a69d96e4 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:32.604344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0c55-39db-4684-ab92-1218a69d96e4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:32.604765 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0c55-39db-4684-ab92-1218a69d96e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:32.625703 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-596d0c55-39db-4684-ab92-1218a69d96e4 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:32.628149 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-596d0c55-39db-4684-ab92-1218a69d96e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:32.680278 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93bfd8-d464-4e75-b201-c4da01220517 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:32.707029 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 372/732] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:32.708451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d0c55-39db-4684-ab92-1218a69d96e4 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:32.731408 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490a8be-b09e-484e-a4c1-14a5a474982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:32.732246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a8be-b09e-484e-a4c1-14a5a474982c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:32.734720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a8be-b09e-484e-a4c1-14a5a474982c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:32.734720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a8be-b09e-484e-a4c1-14a5a474982c None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:32.734720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490a8be-b09e-484e-a4c1-14a5a474982c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:32.734720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490a8be-b09e-484e-a4c1-14a5a474982c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:32.736837 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490a8be-b09e-484e-a4c1-14a5a474982c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:32.755340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 361/733] 10.222.0.76 () {56 vars in 1135 bytes} [Thu May 12 17:29:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:32.757091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd04dad-e572-4a40-96fe-3fa0333ed678 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:32.757459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd04dad-e572-4a40-96fe-3fa0333ed678 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:32.757796 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd04dad-e572-4a40-96fe-3fa0333ed678 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:32.759652 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 362/734] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:32.760760 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd04dad-e572-4a40-96fe-3fa0333ed678 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:32.827346 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d0c55-39db-4684-ab92-1218a69d96e4 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:32.860639 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd04dad-e572-4a40-96fe-3fa0333ed678 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:32.864694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de926ecb-2e0e-48fd-8bb8-e172cff81ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:32.865476 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de926ecb-2e0e-48fd-8bb8-e172cff81ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:32.865786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de926ecb-2e0e-48fd-8bb8-e172cff81ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:32.866021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de926ecb-2e0e-48fd-8bb8-e172cff81ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:32.876095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de926ecb-2e0e-48fd-8bb8-e172cff81ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:32.878428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de926ecb-2e0e-48fd-8bb8-e172cff81ad0 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:32.894986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca4df5-985b-48e2-844a-05fe1b7a9c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:32.895643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca4df5-985b-48e2-844a-05fe1b7a9c8b None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:32.895923 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca4df5-985b-48e2-844a-05fe1b7a9c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:32.896196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca4df5-985b-48e2-844a-05fe1b7a9c8b None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-de926ecb-2e0e-48fd-8bb8-e172cff81ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:32.896294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:32.897158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:32.898104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:32.898104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:32.898104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:32.898104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:32.898348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca4df5-985b-48e2-844a-05fe1b7a9c8b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:32.898348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca4df5-985b-48e2-844a-05fe1b7a9c8b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:32.902143 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 373/735] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:32.903154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de926ecb-2e0e-48fd-8bb8-e172cff81ad0 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:32.918706 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 363/736] 10.222.0.76 () {60 vars in 1141 bytes} [Thu May 12 17:29:32 2022] POST /identity/v3/services => generated 251 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:29:32.918706 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e2a7-23a6-42e5-b8b9-28f49e93a52c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:32.918706 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e2a7-23a6-42e5-b8b9-28f49e93a52c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:32.918706 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e2a7-23a6-42e5-b8b9-28f49e93a52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:32.947458 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-afb3e2a7-23a6-42e5-b8b9-28f49e93a52c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:32.948719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-afb3e2a7-23a6-42e5-b8b9-28f49e93a52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:33.039818 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de926ecb-2e0e-48fd-8bb8-e172cff81ad0 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:33.050197 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 364/737] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:33.051234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3e2a7-23a6-42e5-b8b9-28f49e93a52c None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:33.079435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e05d38-020c-4c82-a936-770c083ce291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:33.080539 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e05d38-020c-4c82-a936-770c083ce291 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:33.081045 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e05d38-020c-4c82-a936-770c083ce291 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:33.081624 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e05d38-020c-4c82-a936-770c083ce291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:33.161833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e05d38-020c-4c82-a936-770c083ce291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:33.163652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e05d38-020c-4c82-a936-770c083ce291 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:33.201689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3e2a7-23a6-42e5-b8b9-28f49e93a52c None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:33.242812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c675f-83cc-4bb7-a864-910ef47f4922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:33.244845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c675f-83cc-4bb7-a864-910ef47f4922 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:33.245120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c675f-83cc-4bb7-a864-910ef47f4922 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:33.245390 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c675f-83cc-4bb7-a864-910ef47f4922 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:33.246117 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c675f-83cc-4bb7-a864-910ef47f4922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:33.246419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c675f-83cc-4bb7-a864-910ef47f4922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:33.247835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c675f-83cc-4bb7-a864-910ef47f4922 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:33.261073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 365/738] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:33.265537 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c675f-83cc-4bb7-a864-910ef47f4922 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:33.281217 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 374/739] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:32 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:29:33.282373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e05d38-020c-4c82-a936-770c083ce291 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:33.388661 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e05d38-020c-4c82-a936-770c083ce291 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:33.395440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c675f-83cc-4bb7-a864-910ef47f4922 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:33.426276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6b3ec-77b4-4421-bbf6-04f4cbc97864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:33.427442 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6b3ec-77b4-4421-bbf6-04f4cbc97864 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:33.427913 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6b3ec-77b4-4421-bbf6-04f4cbc97864 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:33.428397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6b3ec-77b4-4421-bbf6-04f4cbc97864 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:33.435814 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6b3ec-77b4-4421-bbf6-04f4cbc97864 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:33.436296 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d84e8-9519-4dd1-8fad-4eb19bf83174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:33.437085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d84e8-9519-4dd1-8fad-4eb19bf83174 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:33.437362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d84e8-9519-4dd1-8fad-4eb19bf83174 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:33.437630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d84e8-9519-4dd1-8fad-4eb19bf83174 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:33.438459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6b3ec-77b4-4421-bbf6-04f4cbc97864 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:33.449283 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d84e8-9519-4dd1-8fad-4eb19bf83174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-eda6b3ec-77b4-4421-bbf6-04f4cbc97864 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:33.455046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:33.455983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:33.456920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:33.456920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:33.456920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:33.456920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:33.456920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:33.456920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:33.456920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:33.456920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:33.456920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 17:29:33.456920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-c67d84e8-9519-4dd1-8fad-4eb19bf83174 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:33.457915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:33.459050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:33.459931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:33.459931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:33.459931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:33.459931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:33.459931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:33.459931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:33.459931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:33.459931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:33.459931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:33.459931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:33.459931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:29:33.459931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:33.459931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 366/740] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:29:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:33.460630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d84e8-9519-4dd1-8fad-4eb19bf83174 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:33.466825 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 375/741] 10.222.0.76 () {56 vars in 1117 bytes} [Thu May 12 17:29:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:33.467976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6b3ec-77b4-4421-bbf6-04f4cbc97864 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:33.575830 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6b3ec-77b4-4421-bbf6-04f4cbc97864 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:33.579073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d84e8-9519-4dd1-8fad-4eb19bf83174 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:33.609599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb71d57-2882-478e-86e0-bca1dd6a1e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:33.610266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb71d57-2882-478e-86e0-bca1dd6a1e90 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:33.610548 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb71d57-2882-478e-86e0-bca1dd6a1e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:33.610922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb71d57-2882-478e-86e0-bca1dd6a1e90 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:33.611717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb71d57-2882-478e-86e0-bca1dd6a1e90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:33.612022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb71d57-2882-478e-86e0-bca1dd6a1e90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:33.612599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9d578-2e76-44d4-a2f5-431a5c274098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:33.613386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9d578-2e76-44d4-a2f5-431a5c274098 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:33.613498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb71d57-2882-478e-86e0-bca1dd6a1e90 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:33.613663 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9d578-2e76-44d4-a2f5-431a5c274098 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:33.613934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9d578-2e76-44d4-a2f5-431a5c274098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:33.621631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 376/742] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:29:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:33.627545 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb71d57-2882-478e-86e0-bca1dd6a1e90 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:33.731823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb71d57-2882-478e-86e0-bca1dd6a1e90 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:33.745293 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9d578-2e76-44d4-a2f5-431a5c274098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:33.746790 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9d578-2e76-44d4-a2f5-431a5c274098 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-f4e9d578-2e76-44d4-a2f5-431a5c274098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:33.764587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:33.765549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:33.766508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:33.766508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:33.766508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:33.766508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:33.766508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 367/743] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:33.768207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4066e4-0a6f-4402-86cb-bb06ec6be6f6 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:33.768207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4066e4-0a6f-4402-86cb-bb06ec6be6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:33.768207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4066e4-0a6f-4402-86cb-bb06ec6be6f6 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:33.769549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 368/744] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:33.770053 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4066e4-0a6f-4402-86cb-bb06ec6be6f6 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:33.771594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca724e-0b5a-47a8-bba2-d1f17fc58866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:33.772273 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca724e-0b5a-47a8-bba2-d1f17fc58866 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:33.772554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca724e-0b5a-47a8-bba2-d1f17fc58866 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:33.772827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca724e-0b5a-47a8-bba2-d1f17fc58866 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:33.773668 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca724e-0b5a-47a8-bba2-d1f17fc58866 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:33.773976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca724e-0b5a-47a8-bba2-d1f17fc58866 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:33.775492 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca724e-0b5a-47a8-bba2-d1f17fc58866 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:33.798982 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 377/745] 10.222.0.76 () {56 vars in 1149 bytes} [Thu May 12 17:29:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:33.798982 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca724e-0b5a-47a8-bba2-d1f17fc58866 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:33.884889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4066e4-0a6f-4402-86cb-bb06ec6be6f6 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:33.895109 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca724e-0b5a-47a8-bba2-d1f17fc58866 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:33.918023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b553e-5674-47ed-b2b3-27230310e4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:33.918825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b553e-5674-47ed-b2b3-27230310e4db None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:33.919130 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b553e-5674-47ed-b2b3-27230310e4db None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:33.919369 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b553e-5674-47ed-b2b3-27230310e4db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:33.927075 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5800fbf-8eae-43ae-8f2d-a490785c590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:33.927727 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5800fbf-8eae-43ae-8f2d-a490785c590a None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:33.928005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5800fbf-8eae-43ae-8f2d-a490785c590a None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:33.928276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5800fbf-8eae-43ae-8f2d-a490785c590a None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:33.928988 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5800fbf-8eae-43ae-8f2d-a490785c590a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:33.929290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5800fbf-8eae-43ae-8f2d-a490785c590a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:33.929387 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b553e-5674-47ed-b2b3-27230310e4db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:33.930655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5800fbf-8eae-43ae-8f2d-a490785c590a None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:33.930881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b553e-5674-47ed-b2b3-27230310e4db None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:33.946281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 378/746] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:33.946281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62600-b007-4292-88c3-cc9f7044b285 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:33.946281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62600-b007-4292-88c3-cc9f7044b285 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:33.946281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62600-b007-4292-88c3-cc9f7044b285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-e84b553e-5674-47ed-b2b3-27230310e4db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:33.948150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:33.949034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:33.949937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:33.949937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:33.949937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:33.949937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:33.949937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 369/747] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:33.950744 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b553e-5674-47ed-b2b3-27230310e4db None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:33.967884 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-fff62600-b007-4292-88c3-cc9f7044b285 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:33.969185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-fff62600-b007-4292-88c3-cc9f7044b285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:34.037818 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 379/748] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 17:29:34.039316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff62600-b007-4292-88c3-cc9f7044b285 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:34.050610 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b553e-5674-47ed-b2b3-27230310e4db None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:34.085005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c61a-dc79-45a0-85ee-41fbd965ae73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:34.085648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c61a-dc79-45a0-85ee-41fbd965ae73 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:34.085926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c61a-dc79-45a0-85ee-41fbd965ae73 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:34.086206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c61a-dc79-45a0-85ee-41fbd965ae73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:34.148390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff62600-b007-4292-88c3-cc9f7044b285 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:34.164651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33c61a-dc79-45a0-85ee-41fbd965ae73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:34.166548 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33c61a-dc79-45a0-85ee-41fbd965ae73 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:34.182491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d546c8-cece-448a-ac49-f45858df8753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:34.183312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d546c8-cece-448a-ac49-f45858df8753 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:34.183594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d546c8-cece-448a-ac49-f45858df8753 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:34.183870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d546c8-cece-448a-ac49-f45858df8753 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:34.190573 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d546c8-cece-448a-ac49-f45858df8753 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:34.192043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d546c8-cece-448a-ac49-f45858df8753 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-b0d546c8-cece-448a-ac49-f45858df8753 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:34.206004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:34.206996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:34.207892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:34.207892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:34.207892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:34.207892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:34.207892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:34.207892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:34.207892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:34.207892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:34.210821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 380/749] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:34.211913 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d546c8-cece-448a-ac49-f45858df8753 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:34.276097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 370/750] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:33 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 17:29:34.277040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c61a-dc79-45a0-85ee-41fbd965ae73 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:34.320456 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d546c8-cece-448a-ac49-f45858df8753 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:34.353800 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e0c78-42da-4740-a7d5-0ebc8888b4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:34.354459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e0c78-42da-4740-a7d5-0ebc8888b4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:34.354761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e0c78-42da-4740-a7d5-0ebc8888b4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:34.355036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e0c78-42da-4740-a7d5-0ebc8888b4d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:34.355753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e0c78-42da-4740-a7d5-0ebc8888b4d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:34.356051 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e0c78-42da-4740-a7d5-0ebc8888b4d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:34.357404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e0c78-42da-4740-a7d5-0ebc8888b4d1 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:34.373795 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 381/751] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:34.373795 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e0c78-42da-4740-a7d5-0ebc8888b4d1 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:34.375233 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c61a-dc79-45a0-85ee-41fbd965ae73 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:34.411624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fc9cf-92c6-434d-987d-ee52ec7ce97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:34.412273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fc9cf-92c6-434d-987d-ee52ec7ce97f None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:34.412556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fc9cf-92c6-434d-987d-ee52ec7ce97f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:34.412833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fc9cf-92c6-434d-987d-ee52ec7ce97f None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:34.413552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fc9cf-92c6-434d-987d-ee52ec7ce97f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:34.414953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fc9cf-92c6-434d-987d-ee52ec7ce97f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:34.429637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 371/752] 10.222.0.76 () {60 vars in 1141 bytes} [Thu May 12 17:29:34 2022] POST /identity/v3/services => generated 240 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:29:34.431045 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fc9cf-92c6-434d-987d-ee52ec7ce97f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:34.477539 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e0c78-42da-4740-a7d5-0ebc8888b4d1 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:34.523016 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a377a2-2b94-465e-b83c-4858ee8b37ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:34.523684 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a377a2-2b94-465e-b83c-4858ee8b37ca None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:34.524017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a377a2-2b94-465e-b83c-4858ee8b37ca None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:34.524298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a377a2-2b94-465e-b83c-4858ee8b37ca None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:34.525250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a377a2-2b94-465e-b83c-4858ee8b37ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:34.525463 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a377a2-2b94-465e-b83c-4858ee8b37ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:34.527061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a377a2-2b94-465e-b83c-4858ee8b37ca None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:34.547113 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 382/753] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:34.548107 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a377a2-2b94-465e-b83c-4858ee8b37ca None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:34.567108 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fc9cf-92c6-434d-987d-ee52ec7ce97f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:34.606405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1995fc9-3bc8-4c9b-b3ab-8f8019fe9ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:34.606801 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1995fc9-3bc8-4c9b-b3ab-8f8019fe9ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:34.607085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1995fc9-3bc8-4c9b-b3ab-8f8019fe9ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:34.607357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1995fc9-3bc8-4c9b-b3ab-8f8019fe9ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:34.620010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1995fc9-3bc8-4c9b-b3ab-8f8019fe9ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:34.622029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1995fc9-3bc8-4c9b-b3ab-8f8019fe9ed7 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-b1995fc9-3bc8-4c9b-b3ab-8f8019fe9ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:34.643436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:34.644383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:34.645285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:34.645285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:34.645285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:34.645285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:34.645285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 372/754] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:34.645570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1995fc9-3bc8-4c9b-b3ab-8f8019fe9ed7 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:34.693972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a377a2-2b94-465e-b83c-4858ee8b37ca None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:34.730687 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6afdb-fb4c-43f6-bc90-83c079291392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:34.731486 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6afdb-fb4c-43f6-bc90-83c079291392 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:34.731764 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6afdb-fb4c-43f6-bc90-83c079291392 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:34.732032 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6afdb-fb4c-43f6-bc90-83c079291392 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:34.740920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6afdb-fb4c-43f6-bc90-83c079291392 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:34.742468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6afdb-fb4c-43f6-bc90-83c079291392 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-fdc6afdb-fb4c-43f6-bc90-83c079291392 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:34.757409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:34.758415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:34.759666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:34.759666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:34.759666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:34.759666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:34.759666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:34.759666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:34.759666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:34.759666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:34.759666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 17:29:34.759666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:34.763606 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 383/755] 10.222.0.76 () {56 vars in 1093 bytes} [Thu May 12 17:29:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:34.764635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6afdb-fb4c-43f6-bc90-83c079291392 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:34.772079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1995fc9-3bc8-4c9b-b3ab-8f8019fe9ed7 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:34.815665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db9912-8342-4333-927a-49ab4c687c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:34.816738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db9912-8342-4333-927a-49ab4c687c53 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:34.817332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db9912-8342-4333-927a-49ab4c687c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:34.817786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db9912-8342-4333-927a-49ab4c687c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:34.819111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db9912-8342-4333-927a-49ab4c687c53 None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=745af7d676704a179668d6685724ed78, user.id=0e679573cc984993b98e416fabd586d4) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:34.819606 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db9912-8342-4333-927a-49ab4c687c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:34.821726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db9912-8342-4333-927a-49ab4c687c53 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:34.829750 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 373/756] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:34 2022] GET /identity/v3/role_assignments?user.id=0e679573cc984993b98e416fabd586d4&scope.project.id=745af7d676704a179668d6685724ed78&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:34.830879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db9912-8342-4333-927a-49ab4c687c53 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:34.915878 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6afdb-fb4c-43f6-bc90-83c079291392 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:34.950637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db9912-8342-4333-927a-49ab4c687c53 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:34.990412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94de0e4-a217-4a5b-8f2d-3462e31d207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:34.991450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94de0e4-a217-4a5b-8f2d-3462e31d207b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:34.992373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94de0e4-a217-4a5b-8f2d-3462e31d207b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:34.992980 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94de0e4-a217-4a5b-8f2d-3462e31d207b None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:34.994155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94de0e4-a217-4a5b-8f2d-3462e31d207b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:34.994826 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94de0e4-a217-4a5b-8f2d-3462e31d207b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:34.996787 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94de0e4-a217-4a5b-8f2d-3462e31d207b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:35.012236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4713fb-bc83-4a17-83f6-30f0f6ea61df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:35.012917 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4713fb-bc83-4a17-83f6-30f0f6ea61df None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:35.013191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4713fb-bc83-4a17-83f6-30f0f6ea61df None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:35.013457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4713fb-bc83-4a17-83f6-30f0f6ea61df None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:35.014193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4713fb-bc83-4a17-83f6-30f0f6ea61df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:35.014493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4713fb-bc83-4a17-83f6-30f0f6ea61df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:35.016276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4713fb-bc83-4a17-83f6-30f0f6ea61df None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:35.020180 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 374/757] 10.222.0.76 () {56 vars in 1133 bytes} [Thu May 12 17:29:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:35.030140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94de0e4-a217-4a5b-8f2d-3462e31d207b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:35.045244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 384/758] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:35.052218 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4713fb-bc83-4a17-83f6-30f0f6ea61df None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:35.185696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94de0e4-a217-4a5b-8f2d-3462e31d207b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:35.206851 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4713fb-bc83-4a17-83f6-30f0f6ea61df None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:35.245691 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62a8ca-f0a1-410f-b979-9f013eb374e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:35.246493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62a8ca-f0a1-410f-b979-9f013eb374e5 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:35.246809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62a8ca-f0a1-410f-b979-9f013eb374e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:35.247085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62a8ca-f0a1-410f-b979-9f013eb374e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:35.254550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62a8ca-f0a1-410f-b979-9f013eb374e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:35.256399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62a8ca-f0a1-410f-b979-9f013eb374e5 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:35.264394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a9432-ad0e-4f08-bdf8-5e099c310d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:35.265241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a9432-ad0e-4f08-bdf8-5e099c310d99 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:35.265528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a9432-ad0e-4f08-bdf8-5e099c310d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:35.265803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a9432-ad0e-4f08-bdf8-5e099c310d99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-af62a8ca-f0a1-410f-b979-9f013eb374e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:35.270910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:35.271816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:35.272718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:35.272718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:35.272718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:35.272718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:35.272718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:35.272718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:35.272718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:35.272718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:35.272718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 385/759] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:35.277992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62a8ca-f0a1-410f-b979-9f013eb374e5 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:35.293230 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a9432-ad0e-4f08-bdf8-5e099c310d99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:35.294699 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a9432-ad0e-4f08-bdf8-5e099c310d99 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-540a9432-ad0e-4f08-bdf8-5e099c310d99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:35.327899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:35.330355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:35.332605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:35.332605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:35.332605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:35.332605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:35.332605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 375/760] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:35.332605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14526e-7846-4914-a627-2307de77d13d None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:35.332605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14526e-7846-4914-a627-2307de77d13d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:35.332605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14526e-7846-4914-a627-2307de77d13d None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:35.338062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 376/761] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:35.339046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14526e-7846-4914-a627-2307de77d13d None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:35.411830 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62a8ca-f0a1-410f-b979-9f013eb374e5 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:35.442552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14526e-7846-4914-a627-2307de77d13d None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:35.446070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fcec0-091a-4adb-becb-4d5b1733fd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:35.446467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fcec0-091a-4adb-becb-4d5b1733fd37 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:35.446776 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fcec0-091a-4adb-becb-4d5b1733fd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:35.447054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fcec0-091a-4adb-becb-4d5b1733fd37 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:35.447896 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fcec0-091a-4adb-becb-4d5b1733fd37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:35.448205 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fcec0-091a-4adb-becb-4d5b1733fd37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:35.449633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fcec0-091a-4adb-becb-4d5b1733fd37 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:35.466806 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 386/762] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:35.468148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6e28c-5c1f-444c-8f12-c6ab47f4ae0f None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:35.468452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6e28c-5c1f-444c-8f12-c6ab47f4ae0f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:35.468887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6e28c-5c1f-444c-8f12-c6ab47f4ae0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:35.481333 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023503c-7660-4638-b5ab-447ee5c3f034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:35.482206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023503c-7660-4638-b5ab-447ee5c3f034 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:35.482632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023503c-7660-4638-b5ab-447ee5c3f034 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:35.483065 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023503c-7660-4638-b5ab-447ee5c3f034 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:35.483931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023503c-7660-4638-b5ab-447ee5c3f034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:35.484403 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023503c-7660-4638-b5ab-447ee5c3f034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:35.486490 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023503c-7660-4638-b5ab-447ee5c3f034 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:35.487815 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-aef6e28c-5c1f-444c-8f12-c6ab47f4ae0f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:35.489072 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-aef6e28c-5c1f-444c-8f12-c6ab47f4ae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:35.503127 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 377/763] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:35.504241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023503c-7660-4638-b5ab-447ee5c3f034 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:35.566695 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 387/764] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:35.566695 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6e28c-5c1f-444c-8f12-c6ab47f4ae0f None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:35.627318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023503c-7660-4638-b5ab-447ee5c3f034 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:35.661970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fdbb1-d68a-49c0-8193-e581080f537c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:35.662935 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fdbb1-d68a-49c0-8193-e581080f537c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:35.663365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fdbb1-d68a-49c0-8193-e581080f537c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:35.663481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6e28c-5c1f-444c-8f12-c6ab47f4ae0f None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:35.663884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fdbb1-d68a-49c0-8193-e581080f537c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:35.664868 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fdbb1-d68a-49c0-8193-e581080f537c None admin] RBAC: Adding query filter params (role.id=511b62180d4c4881999e65dfab877783, scope.project.id=745af7d676704a179668d6685724ed78, user.id=a74c44dd215a4f318baf6768c2b3d932) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:35.665339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fdbb1-d68a-49c0-8193-e581080f537c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:35.666951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fdbb1-d68a-49c0-8193-e581080f537c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:35.673301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 378/765] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:35 2022] GET /identity/v3/role_assignments?user.id=a74c44dd215a4f318baf6768c2b3d932&scope.project.id=745af7d676704a179668d6685724ed78&role.id=511b62180d4c4881999e65dfab877783 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:35.674311 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fdbb1-d68a-49c0-8193-e581080f537c None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:35.738518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa474a2-73fe-4851-8506-e5b61ec878a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:35.740576 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa474a2-73fe-4851-8506-e5b61ec878a9 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:35.740866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa474a2-73fe-4851-8506-e5b61ec878a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:35.741140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa474a2-73fe-4851-8506-e5b61ec878a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:35.754014 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa474a2-73fe-4851-8506-e5b61ec878a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:35.755534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa474a2-73fe-4851-8506-e5b61ec878a9 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-bfa474a2-73fe-4851-8506-e5b61ec878a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:35.775682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:35.776663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:35.777590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:35.777590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:35.777590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:35.777590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:35.777590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:35.777590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:35.777590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:35.777590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:35.777590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 388/766] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:35.791747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa474a2-73fe-4851-8506-e5b61ec878a9 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:35.843138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fdbb1-d68a-49c0-8193-e581080f537c None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:35.889081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20585cf1-e068-4b86-a773-ba214fb2ed35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:35.890293 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20585cf1-e068-4b86-a773-ba214fb2ed35 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:35.890829 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20585cf1-e068-4b86-a773-ba214fb2ed35 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:35.891301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20585cf1-e068-4b86-a773-ba214fb2ed35 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:35.892728 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20585cf1-e068-4b86-a773-ba214fb2ed35 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:35.894318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20585cf1-e068-4b86-a773-ba214fb2ed35 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-20585cf1-e068-4b86-a773-ba214fb2ed35 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:35.911397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:35.912424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:35.913268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 379/767] 10.222.0.76 () {56 vars in 1129 bytes} [Thu May 12 17:29:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:35.920540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20585cf1-e068-4b86-a773-ba214fb2ed35 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:35.951007 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa474a2-73fe-4851-8506-e5b61ec878a9 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:36.004570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50512aa6-43cb-43e0-8d59-2d69580abc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:36.005567 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50512aa6-43cb-43e0-8d59-2d69580abc0f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:36.006051 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50512aa6-43cb-43e0-8d59-2d69580abc0f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:36.006534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50512aa6-43cb-43e0-8d59-2d69580abc0f None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:36.007573 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50512aa6-43cb-43e0-8d59-2d69580abc0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:36.008099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50512aa6-43cb-43e0-8d59-2d69580abc0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:36.010003 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50512aa6-43cb-43e0-8d59-2d69580abc0f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:36.024714 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 389/768] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:36.030805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50512aa6-43cb-43e0-8d59-2d69580abc0f None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:36.110769 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20585cf1-e068-4b86-a773-ba214fb2ed35 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:36.163903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50512aa6-43cb-43e0-8d59-2d69580abc0f None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:36.184842 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8e27f-ee00-45de-b1f0-3fa7b0c71afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:36.185527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8e27f-ee00-45de-b1f0-3fa7b0c71afd None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:36.185805 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8e27f-ee00-45de-b1f0-3fa7b0c71afd None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:36.186079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8e27f-ee00-45de-b1f0-3fa7b0c71afd None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:36.186841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8e27f-ee00-45de-b1f0-3fa7b0c71afd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:36.187145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8e27f-ee00-45de-b1f0-3fa7b0c71afd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:36.188564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8e27f-ee00-45de-b1f0-3fa7b0c71afd None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:36.205943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 380/769] 10.222.0.76 () {56 vars in 1124 bytes} [Thu May 12 17:29:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:36.207087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06de19-fb48-4369-a629-fa766a9e2d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:36.208624 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06de19-fb48-4369-a629-fa766a9e2d12 None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:36.209130 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06de19-fb48-4369-a629-fa766a9e2d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:36.211151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8e27f-ee00-45de-b1f0-3fa7b0c71afd None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:36.211534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06de19-fb48-4369-a629-fa766a9e2d12 None admin] PATH_INFO: `/v3/projects/745af7d676704a179668d6685724ed78/users/04ad234318ad47589b844351cd3bb3e3/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:36.222480 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06de19-fb48-4369-a629-fa766a9e2d12 None admin] RBAC: Authorizing `identity:create_grant(project_id=745af7d676704a179668d6685724ed78, user_id=04ad234318ad47589b844351cd3bb3e3, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:36.224019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06de19-fb48-4369-a629-fa766a9e2d12 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:36.250621 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 390/770] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:29:36 2022] PUT /identity/v3/projects/745af7d676704a179668d6685724ed78/users/04ad234318ad47589b844351cd3bb3e3/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:29:36.344539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8e27f-ee00-45de-b1f0-3fa7b0c71afd None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:36.382820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05455cd-7ca9-4d29-807d-39cc52e68e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:36.383496 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05455cd-7ca9-4d29-807d-39cc52e68e26 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:36.384036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05455cd-7ca9-4d29-807d-39cc52e68e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:36.384308 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05455cd-7ca9-4d29-807d-39cc52e68e26 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:36.385115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05455cd-7ca9-4d29-807d-39cc52e68e26 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:36.385315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05455cd-7ca9-4d29-807d-39cc52e68e26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:36.386730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05455cd-7ca9-4d29-807d-39cc52e68e26 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:36.393730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 381/771] 10.222.0.76 () {56 vars in 1124 bytes} [Thu May 12 17:29:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:36.404365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06de19-fb48-4369-a629-fa766a9e2d12 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:36.544857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06de19-fb48-4369-a629-fa766a9e2d12 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:36.586986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d248d-9528-4762-947d-1805387ab502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:36.587658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d248d-9528-4762-947d-1805387ab502 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:36.587937 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d248d-9528-4762-947d-1805387ab502 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:36.588212 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d248d-9528-4762-947d-1805387ab502 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:36.588999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d248d-9528-4762-947d-1805387ab502 None admin] RBAC: Adding query filter params (interface=public, service_id=48240464605b41c1b286ce219e2e938b, region_id=RegionOne) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:36.589309 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d248d-9528-4762-947d-1805387ab502 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:36.590701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d248d-9528-4762-947d-1805387ab502 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:36.601302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 391/772] 10.222.0.76 () {56 vars in 1251 bytes} [Thu May 12 17:29:36 2022] GET /identity/v3/endpoints?service_id=48240464605b41c1b286ce219e2e938b&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:36.606609 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05455cd-7ca9-4d29-807d-39cc52e68e26 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:36.736454 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05455cd-7ca9-4d29-807d-39cc52e68e26 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:36.780288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44ee78-5c93-4e80-9a83-1bf153d42728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:36.781328 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44ee78-5c93-4e80-9a83-1bf153d42728 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:36.781817 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44ee78-5c93-4e80-9a83-1bf153d42728 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:36.782312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44ee78-5c93-4e80-9a83-1bf153d42728 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:36.783767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44ee78-5c93-4e80-9a83-1bf153d42728 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:36.785366 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44ee78-5c93-4e80-9a83-1bf153d42728 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:36.794129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 382/773] 10.222.0.76 () {56 vars in 1087 bytes} [Thu May 12 17:29:36 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:37.252336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e342d-7e83-483f-b232-87c18085c23e None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:37.252844 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e342d-7e83-483f-b232-87c18085c23e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:37.252948 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e342d-7e83-483f-b232-87c18085c23e None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:37.254493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 392/774] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:37.260321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b4e11-d79e-41a2-ae3c-da94bbecaa3c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:37.260613 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b4e11-d79e-41a2-ae3c-da94bbecaa3c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:37.260895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b4e11-d79e-41a2-ae3c-da94bbecaa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:37.281076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-3d8b4e11-d79e-41a2-ae3c-da94bbecaa3c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:37.282287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3d8b4e11-d79e-41a2-ae3c-da94bbecaa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:37.371477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f07607-d5ef-429f-976c-266cb64c64a7 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:37.371758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f07607-d5ef-429f-976c-266cb64c64a7 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:37.372036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f07607-d5ef-429f-976c-266cb64c64a7 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:37.374422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 393/775] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:37.382033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7925d-28ea-4935-9534-5a8497e8fae5 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:37.382318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7925d-28ea-4935-9534-5a8497e8fae5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:37.382599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7925d-28ea-4935-9534-5a8497e8fae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:37.384182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 383/776] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:37.407918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b4e11-d79e-41a2-ae3c-da94bbecaa3c None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:37.411712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-13a7925d-28ea-4935-9534-5a8497e8fae5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:37.412977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-13a7925d-28ea-4935-9534-5a8497e8fae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:37.512779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 394/777] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:29:37.529371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b4e11-d79e-41a2-ae3c-da94bbecaa3c None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:37.567559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7925d-28ea-4935-9534-5a8497e8fae5 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:37.576057 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602dcf3-2a4e-43a3-a8bd-c76c3549d320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:37.578783 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602dcf3-2a4e-43a3-a8bd-c76c3549d320 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:37.581215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602dcf3-2a4e-43a3-a8bd-c76c3549d320 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:37.581682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602dcf3-2a4e-43a3-a8bd-c76c3549d320 None admin] PATH_INFO: `/v3/services/network` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:37.583301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602dcf3-2a4e-43a3-a8bd-c76c3549d320 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:37.585044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602dcf3-2a4e-43a3-a8bd-c76c3549d320 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-7602dcf3-2a4e-43a3-a8bd-c76c3549d320 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:37.605500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:37.606551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:37.607972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:37.607972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:37.607972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:37.607972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:37.607972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:37.607972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:37.607972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:37.607972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:37.607972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:37.607972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:37.607972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:37.607972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:37.607972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 17:29:37.607972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:37.612720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 384/778] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:37 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:37.619532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602dcf3-2a4e-43a3-a8bd-c76c3549d320 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:37.741563 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7925d-28ea-4935-9534-5a8497e8fae5 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:37.801029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602dcf3-2a4e-43a3-a8bd-c76c3549d320 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:37.807429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a7f67-3bb4-4a6a-9bed-4316459a6ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:37.808236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a7f67-3bb4-4a6a-9bed-4316459a6ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:37.808513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a7f67-3bb4-4a6a-9bed-4316459a6ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:37.808784 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a7f67-3bb4-4a6a-9bed-4316459a6ec7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:37.831246 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a7f67-3bb4-4a6a-9bed-4316459a6ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-647a7f67-3bb4-4a6a-9bed-4316459a6ec7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:37.842252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:37.843266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:37.844145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:37.844145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:37.844145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:37.844145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:37.844145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:37.844145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:37.844145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:37.844145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:37.844145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:37.844145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:37.844145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:29:37.844145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:37.844793 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 395/779] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:29:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:37.851684 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a7f67-3bb4-4a6a-9bed-4316459a6ec7 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:37.860359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb01e6-21b4-40f5-81c6-bdd77949085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:37.861898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb01e6-21b4-40f5-81c6-bdd77949085b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:37.862419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb01e6-21b4-40f5-81c6-bdd77949085b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:37.862930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb01e6-21b4-40f5-81c6-bdd77949085b None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:37.863848 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb01e6-21b4-40f5-81c6-bdd77949085b None admin] RBAC: Adding query filter params (name=network) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:37.868377 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb01e6-21b4-40f5-81c6-bdd77949085b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:37.870120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb01e6-21b4-40f5-81c6-bdd77949085b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:37.879294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 385/780] 10.222.0.76 () {56 vars in 1112 bytes} [Thu May 12 17:29:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:37.884998 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb01e6-21b4-40f5-81c6-bdd77949085b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:38.023837 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a7f67-3bb4-4a6a-9bed-4316459a6ec7 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:38.064224 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7efaa-0d76-40d3-a7a0-acf4105265af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:38.065950 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7efaa-0d76-40d3-a7a0-acf4105265af None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:38.067299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7efaa-0d76-40d3-a7a0-acf4105265af None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:38.068816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7efaa-0d76-40d3-a7a0-acf4105265af None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:38.070450 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7efaa-0d76-40d3-a7a0-acf4105265af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:38.072718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb01e6-21b4-40f5-81c6-bdd77949085b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:38.073267 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7efaa-0d76-40d3-a7a0-acf4105265af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:38.074885 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7efaa-0d76-40d3-a7a0-acf4105265af None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:38.092114 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 396/781] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:29:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:38.105401 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7efaa-0d76-40d3-a7a0-acf4105265af None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:38.147364 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa028059-614f-4be4-b698-2a37b25b72f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:38.148038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa028059-614f-4be4-b698-2a37b25b72f9 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:38.148325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa028059-614f-4be4-b698-2a37b25b72f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:38.148600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa028059-614f-4be4-b698-2a37b25b72f9 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:38.149309 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa028059-614f-4be4-b698-2a37b25b72f9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:38.149612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa028059-614f-4be4-b698-2a37b25b72f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:38.151126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa028059-614f-4be4-b698-2a37b25b72f9 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:38.165924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 386/782] 10.222.0.76 () {56 vars in 1112 bytes} [Thu May 12 17:29:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:38.170602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa028059-614f-4be4-b698-2a37b25b72f9 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:38.221546 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7efaa-0d76-40d3-a7a0-acf4105265af None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:38.263069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9acf24-63c9-47f4-b87e-1ee5bf2e1880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:38.264710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9acf24-63c9-47f4-b87e-1ee5bf2e1880 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:38.269024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9acf24-63c9-47f4-b87e-1ee5bf2e1880 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:38.269552 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9acf24-63c9-47f4-b87e-1ee5bf2e1880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:38.289799 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9acf24-63c9-47f4-b87e-1ee5bf2e1880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:38.293658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9acf24-63c9-47f4-b87e-1ee5bf2e1880 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-fd9acf24-63c9-47f4-b87e-1ee5bf2e1880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:38.334648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:38.335632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:38.336532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:38.336532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:38.336532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:38.336532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:38.342858 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 397/783] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:38.347601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9acf24-63c9-47f4-b87e-1ee5bf2e1880 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:38.411610 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa028059-614f-4be4-b698-2a37b25b72f9 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:38.445951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf395778-61e8-4b3a-8d23-fb343245788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:38.446622 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf395778-61e8-4b3a-8d23-fb343245788c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:38.446932 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf395778-61e8-4b3a-8d23-fb343245788c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:38.447208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf395778-61e8-4b3a-8d23-fb343245788c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:38.448003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf395778-61e8-4b3a-8d23-fb343245788c None admin] RBAC: Adding query filter params (interface=public, service_id=1ed8929fcdb84663993207f678742517, region_id=RegionOne) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:38.448316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf395778-61e8-4b3a-8d23-fb343245788c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:38.449697 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf395778-61e8-4b3a-8d23-fb343245788c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:38.457842 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 387/784] 10.222.0.76 () {56 vars in 1251 bytes} [Thu May 12 17:29:38 2022] GET /identity/v3/endpoints?service_id=1ed8929fcdb84663993207f678742517&interface=public®ion_id=RegionOne => generated 194 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:38.459460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40f1fc-a3c2-44f4-98bd-8e1610e3a151 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:38.459595 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40f1fc-a3c2-44f4-98bd-8e1610e3a151 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:38.459837 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40f1fc-a3c2-44f4-98bd-8e1610e3a151 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:38.465163 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 388/785] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:38.465853 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9acf24-63c9-47f4-b87e-1ee5bf2e1880 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:38.465969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40f1fc-a3c2-44f4-98bd-8e1610e3a151 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:38.503678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818abc45-e738-492a-a95f-92670dd4fd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:38.504714 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818abc45-e738-492a-a95f-92670dd4fd96 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:38.505203 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818abc45-e738-492a-a95f-92670dd4fd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:38.505694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818abc45-e738-492a-a95f-92670dd4fd96 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:38.506653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818abc45-e738-492a-a95f-92670dd4fd96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:38.507212 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818abc45-e738-492a-a95f-92670dd4fd96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:38.509526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818abc45-e738-492a-a95f-92670dd4fd96 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:38.528424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 398/786] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:38.530607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78174d9c-a2bb-4591-b91a-578efd62738e None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:38.531314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78174d9c-a2bb-4591-b91a-578efd62738e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:38.532134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78174d9c-a2bb-4591-b91a-578efd62738e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:38.553141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-78174d9c-a2bb-4591-b91a-578efd62738e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:38.555092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-78174d9c-a2bb-4591-b91a-578efd62738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:38.571981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40f1fc-a3c2-44f4-98bd-8e1610e3a151 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:38.607344 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9dcc8-a0e5-4ce5-83ca-daae71e35238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:38.607977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9dcc8-a0e5-4ce5-83ca-daae71e35238 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:38.608373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9dcc8-a0e5-4ce5-83ca-daae71e35238 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:38.608779 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9dcc8-a0e5-4ce5-83ca-daae71e35238 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:38.609534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9dcc8-a0e5-4ce5-83ca-daae71e35238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:38.611888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9dcc8-a0e5-4ce5-83ca-daae71e35238 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:38.617984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 389/787] 10.222.0.76 () {56 vars in 1087 bytes} [Thu May 12 17:29:38 2022] GET /identity/v3/services => generated 772 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:38.618944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9dcc8-a0e5-4ce5-83ca-daae71e35238 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:38.626807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 399/788] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:38.656069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78174d9c-a2bb-4591-b91a-578efd62738e None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:38.758567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9dcc8-a0e5-4ce5-83ca-daae71e35238 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:38.760258 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78174d9c-a2bb-4591-b91a-578efd62738e None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:38.796831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d60bc4-f248-4806-a783-f4ddc863f488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:38.797652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d60bc4-f248-4806-a783-f4ddc863f488 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:38.797982 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d60bc4-f248-4806-a783-f4ddc863f488 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:38.798323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d60bc4-f248-4806-a783-f4ddc863f488 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:38.814276 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c671d8-94e1-4299-8049-d4467ff6c4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:38.815129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c671d8-94e1-4299-8049-d4467ff6c4ca None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:38.815410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c671d8-94e1-4299-8049-d4467ff6c4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:38.815685 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c671d8-94e1-4299-8049-d4467ff6c4ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:38.829947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d60bc4-f248-4806-a783-f4ddc863f488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-96d60bc4-f248-4806-a783-f4ddc863f488 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:38.838636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:38.839909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:38.840881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:38.840881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:38.840881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:38.840881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:38.840881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:38.840881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:38.840881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:38.840881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:38.840881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:38.840881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:38.840881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:38.840881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:38.840881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 400/789] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:38.841598 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c671d8-94e1-4299-8049-d4467ff6c4ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:38.844878 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c671d8-94e1-4299-8049-d4467ff6c4ca None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:38.851808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d60bc4-f248-4806-a783-f4ddc863f488 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-b7c671d8-94e1-4299-8049-d4467ff6c4ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:38.863288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:38.864287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:38.865263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:38.865263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:38.865263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:38.865263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:38.865263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:38.865263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:38.865263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:38.865263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:38.865263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 17:29:38.865263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:38.868707 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 390/790] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:29:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:38.874091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c671d8-94e1-4299-8049-d4467ff6c4ca None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:38.988590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d60bc4-f248-4806-a783-f4ddc863f488 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:39.009190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c671d8-94e1-4299-8049-d4467ff6c4ca None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:39.028469 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b66f69-593a-496f-85f8-867f9d90cbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:39.029230 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b66f69-593a-496f-85f8-867f9d90cbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.029572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b66f69-593a-496f-85f8-867f9d90cbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.029915 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b66f69-593a-496f-85f8-867f9d90cbd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.030830 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b66f69-593a-496f-85f8-867f9d90cbd1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:39.031198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b66f69-593a-496f-85f8-867f9d90cbd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:39.032799 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b66f69-593a-496f-85f8-867f9d90cbd1 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:39.043993 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 401/791] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:39.045460 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bebc5e-94d2-4613-acf6-428e0686efe8 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.045746 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bebc5e-94d2-4613-acf6-428e0686efe8 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.046019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bebc5e-94d2-4613-acf6-428e0686efe8 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.048327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 402/792] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:39.051722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9099c-b1d0-47ff-8bcd-6830a98e6a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:39.052664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9099c-b1d0-47ff-8bcd-6830a98e6a18 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.053148 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9099c-b1d0-47ff-8bcd-6830a98e6a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.053629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9099c-b1d0-47ff-8bcd-6830a98e6a18 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.054441 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785aa3-2f9d-4cc1-b572-04fffd479b13 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.054561 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9099c-b1d0-47ff-8bcd-6830a98e6a18 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:39.054826 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785aa3-2f9d-4cc1-b572-04fffd479b13 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.054930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9099c-b1d0-47ff-8bcd-6830a98e6a18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:39.055019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785aa3-2f9d-4cc1-b572-04fffd479b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.056347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9099c-b1d0-47ff-8bcd-6830a98e6a18 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:39.075772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-a2785aa3-2f9d-4cc1-b572-04fffd479b13 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:39.076268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 391/793] 10.222.0.76 () {56 vars in 1135 bytes} [Thu May 12 17:29:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:39.076963 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a2785aa3-2f9d-4cc1-b572-04fffd479b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:39.077146 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9099c-b1d0-47ff-8bcd-6830a98e6a18 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:39.169364 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 403/794] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:39.170211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2785aa3-2f9d-4cc1-b572-04fffd479b13 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:39.199283 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9099c-b1d0-47ff-8bcd-6830a98e6a18 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:39.234119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cc6c3-4658-40d4-82df-3507aadd03b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:39.234945 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cc6c3-4658-40d4-82df-3507aadd03b6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.235226 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cc6c3-4658-40d4-82df-3507aadd03b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.235907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cc6c3-4658-40d4-82df-3507aadd03b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.246196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8cc6c3-4658-40d4-82df-3507aadd03b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:39.247753 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8cc6c3-4658-40d4-82df-3507aadd03b6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-7c8cc6c3-4658-40d4-82df-3507aadd03b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:39.266635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:39.268351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:39.269689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:39.269689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:39.269689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:39.269689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:39.269689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 392/795] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:39.274367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cc6c3-4658-40d4-82df-3507aadd03b6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:39.288764 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2785aa3-2f9d-4cc1-b572-04fffd479b13 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:39.324188 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dac53a-5607-4180-bc12-631d0efd628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:39.325344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dac53a-5607-4180-bc12-631d0efd628e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.325860 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dac53a-5607-4180-bc12-631d0efd628e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.326334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dac53a-5607-4180-bc12-631d0efd628e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.336765 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dac53a-5607-4180-bc12-631d0efd628e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:39.338523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dac53a-5607-4180-bc12-631d0efd628e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-80dac53a-5607-4180-bc12-631d0efd628e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:39.356610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:39.357560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:39.358468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:39.358468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:39.358468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:39.358468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:39.365611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 404/796] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:39.366778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dac53a-5607-4180-bc12-631d0efd628e None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:39.381144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cc6c3-4658-40d4-82df-3507aadd03b6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:39.419203 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f9520-056b-4684-9a82-5f1920755afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:39.420099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f9520-056b-4684-9a82-5f1920755afb None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.420326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f9520-056b-4684-9a82-5f1920755afb None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.420600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f9520-056b-4684-9a82-5f1920755afb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.431613 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f9520-056b-4684-9a82-5f1920755afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-f90f9520-056b-4684-9a82-5f1920755afb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:39.440698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:39.441708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:39.442576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:39.442576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:39.442576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:39.442576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:39.442576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:39.442576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:39.442576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:39.442576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:39.442576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:39.442576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:39.442576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:29:39.442576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:39.442576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 393/797] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:29:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:39.442576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f9520-056b-4684-9a82-5f1920755afb None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:39.477498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dac53a-5607-4180-bc12-631d0efd628e None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:39.513738 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741042f-feff-4cc4-837e-2783264f7d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:39.514774 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741042f-feff-4cc4-837e-2783264f7d43 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.515260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741042f-feff-4cc4-837e-2783264f7d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.515835 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741042f-feff-4cc4-837e-2783264f7d43 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.516774 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741042f-feff-4cc4-837e-2783264f7d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:39.517560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741042f-feff-4cc4-837e-2783264f7d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:39.519239 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741042f-feff-4cc4-837e-2783264f7d43 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:39.531214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 405/798] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:39.532307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741042f-feff-4cc4-837e-2783264f7d43 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:39.560818 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f9520-056b-4684-9a82-5f1920755afb None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:39.596841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7605da2-4c9e-464d-90ec-c23b26e4d23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:39.597511 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7605da2-4c9e-464d-90ec-c23b26e4d23b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.597793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7605da2-4c9e-464d-90ec-c23b26e4d23b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.598073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7605da2-4c9e-464d-90ec-c23b26e4d23b None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.598844 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7605da2-4c9e-464d-90ec-c23b26e4d23b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:39.599153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7605da2-4c9e-464d-90ec-c23b26e4d23b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:39.600539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7605da2-4c9e-464d-90ec-c23b26e4d23b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:39.616491 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 394/799] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:39.621297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7605da2-4c9e-464d-90ec-c23b26e4d23b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:39.638951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741042f-feff-4cc4-837e-2783264f7d43 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:39.675545 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95659a1-c42d-470c-a24a-f275009c2e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:39.676452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95659a1-c42d-470c-a24a-f275009c2e0b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.676733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95659a1-c42d-470c-a24a-f275009c2e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.677004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95659a1-c42d-470c-a24a-f275009c2e0b None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.677750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95659a1-c42d-470c-a24a-f275009c2e0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:39.678053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95659a1-c42d-470c-a24a-f275009c2e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:39.679445 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95659a1-c42d-470c-a24a-f275009c2e0b None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:39.691999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 406/800] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:29:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:39.692917 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95659a1-c42d-470c-a24a-f275009c2e0b None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:39.727459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7605da2-4c9e-464d-90ec-c23b26e4d23b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:39.763273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8324f5-8adf-462e-972f-5226eb3540a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:39.764092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8324f5-8adf-462e-972f-5226eb3540a3 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.764470 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8324f5-8adf-462e-972f-5226eb3540a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.764751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8324f5-8adf-462e-972f-5226eb3540a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.772011 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8324f5-8adf-462e-972f-5226eb3540a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:39.773449 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8324f5-8adf-462e-972f-5226eb3540a3 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-6b8324f5-8adf-462e-972f-5226eb3540a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:39.788614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:39.789558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:39.790530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:39.790530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:39.790530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:39.790530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:39.790530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:39.790530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:39.790530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:39.790530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:39.790530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 17:29:39.790530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:39.790530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 395/801] 10.222.0.76 () {56 vars in 1117 bytes} [Thu May 12 17:29:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:39.791169 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118e84f-9a2d-4225-bfe0-a64f56b39bd2 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.791742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118e84f-9a2d-4225-bfe0-a64f56b39bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.791742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118e84f-9a2d-4225-bfe0-a64f56b39bd2 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.794728 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 396/802] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:39.794728 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118e84f-9a2d-4225-bfe0-a64f56b39bd2 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:39.802131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95659a1-c42d-470c-a24a-f275009c2e0b None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:39.837909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b613ae-db42-454b-8b76-69d52bc715b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:39.839009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b613ae-db42-454b-8b76-69d52bc715b2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.839505 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b613ae-db42-454b-8b76-69d52bc715b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.839781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b613ae-db42-454b-8b76-69d52bc715b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.847004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b613ae-db42-454b-8b76-69d52bc715b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:39.848452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b613ae-db42-454b-8b76-69d52bc715b2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-28b613ae-db42-454b-8b76-69d52bc715b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:39.863089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:39.864062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:39.865612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:39.865612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:39.865612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:39.865612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:39.865612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:39.865612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:39.865612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:39.865612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:39.865612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 407/803] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:39.865612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b613ae-db42-454b-8b76-69d52bc715b2 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:39.903857 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118e84f-9a2d-4225-bfe0-a64f56b39bd2 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:39.945283 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1cc81-2a31-424f-a317-f8ae7a425384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:39.945989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1cc81-2a31-424f-a317-f8ae7a425384 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.946273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1cc81-2a31-424f-a317-f8ae7a425384 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.946550 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1cc81-2a31-424f-a317-f8ae7a425384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.956840 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1cc81-2a31-424f-a317-f8ae7a425384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:39.958276 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1cc81-2a31-424f-a317-f8ae7a425384 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:39.965897 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b613ae-db42-454b-8b76-69d52bc715b2 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-67b1cc81-2a31-424f-a317-f8ae7a425384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:39.976051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:39.976964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:39.977875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:39.977875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:39.977875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:39.977875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:39.977875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 397/804] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:39.978589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe839f-934d-4af7-9ac3-c730a9da3b3c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:39.978710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe839f-934d-4af7-9ac3-c730a9da3b3c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:39.978987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe839f-934d-4af7-9ac3-c730a9da3b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:39.995632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-adbe839f-934d-4af7-9ac3-c730a9da3b3c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:39.996804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-adbe839f-934d-4af7-9ac3-c730a9da3b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:40.005120 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c97e51-ad00-4c75-8c62-e297cb917048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:40.005785 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c97e51-ad00-4c75-8c62-e297cb917048 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:40.006068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c97e51-ad00-4c75-8c62-e297cb917048 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:40.006344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c97e51-ad00-4c75-8c62-e297cb917048 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:40.007218 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c97e51-ad00-4c75-8c62-e297cb917048 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:40.007525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c97e51-ad00-4c75-8c62-e297cb917048 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:40.009212 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c97e51-ad00-4c75-8c62-e297cb917048 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:40.031180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 408/805] 10.222.0.76 () {56 vars in 1149 bytes} [Thu May 12 17:29:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:40.031180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c97e51-ad00-4c75-8c62-e297cb917048 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:40.070415 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 398/806] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:40.071328 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe839f-934d-4af7-9ac3-c730a9da3b3c None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:40.146379 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c97e51-ad00-4c75-8c62-e297cb917048 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:40.174085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe839f-934d-4af7-9ac3-c730a9da3b3c None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:40.179283 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d44bc3-54d0-4e9d-b694-49857c805167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:40.179947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d44bc3-54d0-4e9d-b694-49857c805167 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:40.180230 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d44bc3-54d0-4e9d-b694-49857c805167 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:40.180503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d44bc3-54d0-4e9d-b694-49857c805167 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:40.181290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d44bc3-54d0-4e9d-b694-49857c805167 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:40.181603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d44bc3-54d0-4e9d-b694-49857c805167 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:40.183087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d44bc3-54d0-4e9d-b694-49857c805167 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:40.199301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 409/807] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:40.199301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d44bc3-54d0-4e9d-b694-49857c805167 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:40.213672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca681d7f-d0bc-4bc6-accc-447992fd9921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:40.214339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca681d7f-d0bc-4bc6-accc-447992fd9921 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:40.214620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca681d7f-d0bc-4bc6-accc-447992fd9921 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:40.214928 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca681d7f-d0bc-4bc6-accc-447992fd9921 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:40.215651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca681d7f-d0bc-4bc6-accc-447992fd9921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:40.215958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca681d7f-d0bc-4bc6-accc-447992fd9921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:40.217332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca681d7f-d0bc-4bc6-accc-447992fd9921 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:40.233557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 399/808] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:40.233557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca681d7f-d0bc-4bc6-accc-447992fd9921 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:40.304802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d44bc3-54d0-4e9d-b694-49857c805167 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:40.341366 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be55bf5-e5b2-4f07-90da-c48665a3430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:40.342663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be55bf5-e5b2-4f07-90da-c48665a3430d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:40.343165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be55bf5-e5b2-4f07-90da-c48665a3430d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:40.343648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be55bf5-e5b2-4f07-90da-c48665a3430d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:40.347147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca681d7f-d0bc-4bc6-accc-447992fd9921 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:40.356743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be55bf5-e5b2-4f07-90da-c48665a3430d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:40.358189 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be55bf5-e5b2-4f07-90da-c48665a3430d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-3be55bf5-e5b2-4f07-90da-c48665a3430d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:40.376089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:40.377602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:40.378503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:40.378503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:40.378503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:40.378503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:40.378503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 410/809] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:40.379415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be55bf5-e5b2-4f07-90da-c48665a3430d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:40.387487 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d63db-1a8a-46d9-a69b-6e542b4d736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:40.388295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d63db-1a8a-46d9-a69b-6e542b4d736a None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:40.388582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d63db-1a8a-46d9-a69b-6e542b4d736a None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:40.388857 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d63db-1a8a-46d9-a69b-6e542b4d736a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:40.389503 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d63db-1a8a-46d9-a69b-6e542b4d736a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:40.390898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d63db-1a8a-46d9-a69b-6e542b4d736a None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-499d63db-1a8a-46d9-a69b-6e542b4d736a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:40.403091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:40.404034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:40.405466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 400/810] 10.222.0.76 () {56 vars in 1129 bytes} [Thu May 12 17:29:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:40.406313 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d63db-1a8a-46d9-a69b-6e542b4d736a None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:40.481741 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be55bf5-e5b2-4f07-90da-c48665a3430d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:40.505452 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d63db-1a8a-46d9-a69b-6e542b4d736a None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:40.515352 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b3a55-3713-4489-9ced-90713ba8a6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:40.516241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b3a55-3713-4489-9ced-90713ba8a6fb None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:40.516530 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b3a55-3713-4489-9ced-90713ba8a6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:40.516808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b3a55-3713-4489-9ced-90713ba8a6fb None admin] PATH_INFO: `/v3/projects/745af7d676704a179668d6685724ed78/users/0e679573cc984993b98e416fabd586d4/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:40.518833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b3a55-3713-4489-9ced-90713ba8a6fb None admin] RBAC: Authorizing `identity:create_grant(project_id=745af7d676704a179668d6685724ed78, user_id=0e679573cc984993b98e416fabd586d4, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:40.520324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b3a55-3713-4489-9ced-90713ba8a6fb None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:40.536439 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 411/811] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:29:40 2022] PUT /identity/v3/projects/745af7d676704a179668d6685724ed78/users/0e679573cc984993b98e416fabd586d4/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:29:40.537017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b3a55-3713-4489-9ced-90713ba8a6fb None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:40.550091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f3d3d-6fc6-48dd-a636-d1019217cf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:40.551475 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f3d3d-6fc6-48dd-a636-d1019217cf88 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:40.552074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f3d3d-6fc6-48dd-a636-d1019217cf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:40.552559 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f3d3d-6fc6-48dd-a636-d1019217cf88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:40.562067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f3d3d-6fc6-48dd-a636-d1019217cf88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:40.564206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f3d3d-6fc6-48dd-a636-d1019217cf88 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-fa4f3d3d-6fc6-48dd-a636-d1019217cf88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:40.581562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:40.582583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:40.583582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:40.583582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:40.583582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:40.583582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:40.583582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:40.583582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:40.583582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:40.583582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:40.583582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 17:29:40.583582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:40.586456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 401/812] 10.222.0.76 () {56 vars in 1093 bytes} [Thu May 12 17:29:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:40.587673 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f3d3d-6fc6-48dd-a636-d1019217cf88 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:40.673939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b3a55-3713-4489-9ced-90713ba8a6fb None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:40.713606 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f3d3d-6fc6-48dd-a636-d1019217cf88 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:40.716236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a700d-22eb-43e9-91cf-4fd3e9cc8e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:40.717230 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a700d-22eb-43e9-91cf-4fd3e9cc8e7b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:40.717769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a700d-22eb-43e9-91cf-4fd3e9cc8e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:40.718272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a700d-22eb-43e9-91cf-4fd3e9cc8e7b None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:40.719873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a700d-22eb-43e9-91cf-4fd3e9cc8e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:40.720943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a700d-22eb-43e9-91cf-4fd3e9cc8e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:40.722553 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a700d-22eb-43e9-91cf-4fd3e9cc8e7b None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:40.735594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 412/813] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:40.737350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a700d-22eb-43e9-91cf-4fd3e9cc8e7b None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:40.758184 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8a458-83fc-4dd6-8813-66e45c4f26a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:40.759141 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8a458-83fc-4dd6-8813-66e45c4f26a3 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:40.759419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8a458-83fc-4dd6-8813-66e45c4f26a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:40.759694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8a458-83fc-4dd6-8813-66e45c4f26a3 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:40.760400 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8a458-83fc-4dd6-8813-66e45c4f26a3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:40.760701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8a458-83fc-4dd6-8813-66e45c4f26a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:40.762069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8a458-83fc-4dd6-8813-66e45c4f26a3 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:40.767777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 402/814] 10.222.0.76 () {56 vars in 1124 bytes} [Thu May 12 17:29:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:40.768861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8a458-83fc-4dd6-8813-66e45c4f26a3 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:40.858050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a700d-22eb-43e9-91cf-4fd3e9cc8e7b None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:40.888917 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8a458-83fc-4dd6-8813-66e45c4f26a3 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:40.892912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a398580-c7b4-4b9f-a5b2-6876bd8f799d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:40.893055 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a398580-c7b4-4b9f-a5b2-6876bd8f799d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:40.893367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a398580-c7b4-4b9f-a5b2-6876bd8f799d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:40.893641 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a398580-c7b4-4b9f-a5b2-6876bd8f799d None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:40.894478 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a398580-c7b4-4b9f-a5b2-6876bd8f799d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:40.894811 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a398580-c7b4-4b9f-a5b2-6876bd8f799d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:40.896379 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a398580-c7b4-4b9f-a5b2-6876bd8f799d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:40.915887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 413/815] 10.222.0.76 () {56 vars in 1133 bytes} [Thu May 12 17:29:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:40.917018 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a398580-c7b4-4b9f-a5b2-6876bd8f799d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:40.933429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b458e37-3319-4b02-9a73-5fbf1c115063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:40.934762 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458e37-3319-4b02-9a73-5fbf1c115063 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:40.935521 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458e37-3319-4b02-9a73-5fbf1c115063 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:40.936003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458e37-3319-4b02-9a73-5fbf1c115063 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:40.945432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b458e37-3319-4b02-9a73-5fbf1c115063 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:40.947915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b458e37-3319-4b02-9a73-5fbf1c115063 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-2b458e37-3319-4b02-9a73-5fbf1c115063 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:40.969698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:40.971651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:40.973307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:40.973307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:40.973307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:40.973307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:40.973307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:40.973307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:40.973307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:40.973307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:40.973307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 403/816] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:40.973307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b458e37-3319-4b02-9a73-5fbf1c115063 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:41.021815 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a398580-c7b4-4b9f-a5b2-6876bd8f799d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:41.058494 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46abfce-9d68-4f45-a590-cb09400e4fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:41.059193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46abfce-9d68-4f45-a590-cb09400e4fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:41.059474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46abfce-9d68-4f45-a590-cb09400e4fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:41.059749 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46abfce-9d68-4f45-a590-cb09400e4fd8 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:41.060456 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46abfce-9d68-4f45-a590-cb09400e4fd8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:41.060758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46abfce-9d68-4f45-a590-cb09400e4fd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:41.062129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46abfce-9d68-4f45-a590-cb09400e4fd8 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:41.072109 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 414/817] 10.222.0.76 () {56 vars in 1124 bytes} [Thu May 12 17:29:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:41.073056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46abfce-9d68-4f45-a590-cb09400e4fd8 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:41.085931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b458e37-3319-4b02-9a73-5fbf1c115063 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:41.121569 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98837120-0102-4ad4-be9a-d339c8e0eae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:41.122585 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98837120-0102-4ad4-be9a-d339c8e0eae4 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:41.123158 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98837120-0102-4ad4-be9a-d339c8e0eae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:41.123649 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98837120-0102-4ad4-be9a-d339c8e0eae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:41.173936 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46abfce-9d68-4f45-a590-cb09400e4fd8 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:41.195410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98837120-0102-4ad4-be9a-d339c8e0eae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:41.197222 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98837120-0102-4ad4-be9a-d339c8e0eae4 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:41.208790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f2a2d-9e7a-44ea-be10-7c62cfc09fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:41.209455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f2a2d-9e7a-44ea-be10-7c62cfc09fde None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:41.209972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f2a2d-9e7a-44ea-be10-7c62cfc09fde None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:41.209972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f2a2d-9e7a-44ea-be10-7c62cfc09fde None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:41.211111 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f2a2d-9e7a-44ea-be10-7c62cfc09fde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:41.211418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f2a2d-9e7a-44ea-be10-7c62cfc09fde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:41.212842 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f2a2d-9e7a-44ea-be10-7c62cfc09fde None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:41.225224 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 415/818] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:41.226085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f2a2d-9e7a-44ea-be10-7c62cfc09fde None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:41.308575 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 404/819] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:29:41.309834 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7a047-d6c4-4ea6-b450-7e5995ce8f1a None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:41.310119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7a047-d6c4-4ea6-b450-7e5995ce8f1a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:41.310393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7a047-d6c4-4ea6-b450-7e5995ce8f1a None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:41.311898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 405/820] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:41.312363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7a047-d6c4-4ea6-b450-7e5995ce8f1a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:41.333346 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f2a2d-9e7a-44ea-be10-7c62cfc09fde None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:41.365076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e7280-5014-47dd-8e5b-718c39c59590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:41.365762 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e7280-5014-47dd-8e5b-718c39c59590 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:41.366039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e7280-5014-47dd-8e5b-718c39c59590 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:41.366315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e7280-5014-47dd-8e5b-718c39c59590 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:41.367078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e7280-5014-47dd-8e5b-718c39c59590 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:41.368443 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e7280-5014-47dd-8e5b-718c39c59590 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:41.391463 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 416/821] 10.222.0.76 () {60 vars in 1144 bytes} [Thu May 12 17:29:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:29:41.393241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e7280-5014-47dd-8e5b-718c39c59590 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:41.442980 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7a047-d6c4-4ea6-b450-7e5995ce8f1a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:41.481767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47477c4-222c-490c-8171-501fdb698af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:41.482825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47477c4-222c-490c-8171-501fdb698af8 None admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:41.483215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47477c4-222c-490c-8171-501fdb698af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:41.483558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47477c4-222c-490c-8171-501fdb698af8 None admin] PATH_INFO: `/v3/projects/745af7d676704a179668d6685724ed78/users/a74c44dd215a4f318baf6768c2b3d932/roles/511b62180d4c4881999e65dfab877783` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:41.500468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47477c4-222c-490c-8171-501fdb698af8 None admin] RBAC: Authorizing `identity:create_grant(project_id=745af7d676704a179668d6685724ed78, user_id=a74c44dd215a4f318baf6768c2b3d932, role_id=511b62180d4c4881999e65dfab877783)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:41.503509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47477c4-222c-490c-8171-501fdb698af8 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:41.505564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e7280-5014-47dd-8e5b-718c39c59590 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:41.520480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 406/822] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:29:41 2022] PUT /identity/v3/projects/745af7d676704a179668d6685724ed78/users/a74c44dd215a4f318baf6768c2b3d932/roles/511b62180d4c4881999e65dfab877783 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:29:41.522039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5d928-fd8b-410b-bfcd-b5316128fa90 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:41.522431 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5d928-fd8b-410b-bfcd-b5316128fa90 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:41.523250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5d928-fd8b-410b-bfcd-b5316128fa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:41.546537 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64edb02-1a39-4a35-9913-3503d4575157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:41.547776 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64edb02-1a39-4a35-9913-3503d4575157 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:41.548862 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64edb02-1a39-4a35-9913-3503d4575157 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:41.549348 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64edb02-1a39-4a35-9913-3503d4575157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:41.552122 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-5de5d928-fd8b-410b-bfcd-b5316128fa90 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:41.553349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-5de5d928-fd8b-410b-bfcd-b5316128fa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:41.563008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64edb02-1a39-4a35-9913-3503d4575157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:41.565521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64edb02-1a39-4a35-9913-3503d4575157 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-d64edb02-1a39-4a35-9913-3503d4575157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:41.584998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:41.585959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:41.586888 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:41.586888 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:41.586888 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:41.586888 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:41.589272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 417/823] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:41.594450 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64edb02-1a39-4a35-9913-3503d4575157 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:41.657901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 407/824] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:41.685077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5d928-fd8b-410b-bfcd-b5316128fa90 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:41.707086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64edb02-1a39-4a35-9913-3503d4575157 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:41.745435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e2bd2-127e-4fd6-af0e-0fa552d0aaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:41.746501 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e2bd2-127e-4fd6-af0e-0fa552d0aaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:41.747025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e2bd2-127e-4fd6-af0e-0fa552d0aaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:41.747507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e2bd2-127e-4fd6-af0e-0fa552d0aaa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:41.748480 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e2bd2-127e-4fd6-af0e-0fa552d0aaa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:41.749017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e2bd2-127e-4fd6-af0e-0fa552d0aaa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:41.750629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e2bd2-127e-4fd6-af0e-0fa552d0aaa1 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:41.765299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 418/825] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:41.770355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e2bd2-127e-4fd6-af0e-0fa552d0aaa1 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:41.800789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5d928-fd8b-410b-bfcd-b5316128fa90 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:41.838751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6ccab-e2a8-4923-ace6-89436d346bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:41.839545 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6ccab-e2a8-4923-ace6-89436d346bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:41.839819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6ccab-e2a8-4923-ace6-89436d346bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:41.840084 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6ccab-e2a8-4923-ace6-89436d346bd4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:41.840866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6ccab-e2a8-4923-ace6-89436d346bd4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:41.842138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6ccab-e2a8-4923-ace6-89436d346bd4 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-4ea6ccab-e2a8-4923-ace6-89436d346bd4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:41.855095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:41.856150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:41.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 408/826] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:41 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:41.863865 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6ccab-e2a8-4923-ace6-89436d346bd4 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:41.884693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e2bd2-127e-4fd6-af0e-0fa552d0aaa1 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:41.920446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e4e12-0c78-4bec-9215-374dc71a306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:41.921617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e4e12-0c78-4bec-9215-374dc71a306d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:41.922122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e4e12-0c78-4bec-9215-374dc71a306d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:41.922599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e4e12-0c78-4bec-9215-374dc71a306d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:41.931924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e4e12-0c78-4bec-9215-374dc71a306d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:41.933680 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e4e12-0c78-4bec-9215-374dc71a306d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-857e4e12-0c78-4bec-9215-374dc71a306d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:41.947890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:41.948820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:41.949723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:41.949723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:41.949723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:41.949723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:41.949723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:41.949723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:41.949723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:41.949723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:41.952278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 419/827] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:41.957507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e4e12-0c78-4bec-9215-374dc71a306d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:41.981409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6ccab-e2a8-4923-ace6-89436d346bd4 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:42.016725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba1ca0-61d4-43f0-a171-e826308ff7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:42.018023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba1ca0-61d4-43f0-a171-e826308ff7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:42.018479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba1ca0-61d4-43f0-a171-e826308ff7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:42.018780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba1ca0-61d4-43f0-a171-e826308ff7a0 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:42.019528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba1ca0-61d4-43f0-a171-e826308ff7a0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:42.019837 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba1ca0-61d4-43f0-a171-e826308ff7a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:42.021258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba1ca0-61d4-43f0-a171-e826308ff7a0 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:42.026073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 409/828] 10.222.0.76 () {56 vars in 1112 bytes} [Thu May 12 17:29:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:42.031434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba1ca0-61d4-43f0-a171-e826308ff7a0 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:42.083951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e4e12-0c78-4bec-9215-374dc71a306d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:42.126275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47309efa-f724-4cbe-b533-0fe12c070c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:42.127397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47309efa-f724-4cbe-b533-0fe12c070c26 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:42.127906 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47309efa-f724-4cbe-b533-0fe12c070c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:42.128803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47309efa-f724-4cbe-b533-0fe12c070c26 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:42.130097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47309efa-f724-4cbe-b533-0fe12c070c26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:42.130615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47309efa-f724-4cbe-b533-0fe12c070c26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:42.133015 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47309efa-f724-4cbe-b533-0fe12c070c26 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:42.151110 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba1ca0-61d4-43f0-a171-e826308ff7a0 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:42.166704 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 420/829] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:42.171985 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47309efa-f724-4cbe-b533-0fe12c070c26 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:42.218303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8824d-4822-4080-9ea9-35011f244f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:42.221223 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8824d-4822-4080-9ea9-35011f244f6f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:42.221694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8824d-4822-4080-9ea9-35011f244f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:42.222872 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8824d-4822-4080-9ea9-35011f244f6f None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:42.223779 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8824d-4822-4080-9ea9-35011f244f6f None admin] RBAC: Adding query filter params (type=network) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:42.224896 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8824d-4822-4080-9ea9-35011f244f6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:42.226638 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8824d-4822-4080-9ea9-35011f244f6f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:42.240820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 410/830] 10.222.0.76 () {56 vars in 1112 bytes} [Thu May 12 17:29:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:42.246582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8824d-4822-4080-9ea9-35011f244f6f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:42.367594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47309efa-f724-4cbe-b533-0fe12c070c26 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:42.421409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328eaf29-bcbd-471f-b694-388df99a9802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:42.424753 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8824d-4822-4080-9ea9-35011f244f6f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:42.426281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eaf29-bcbd-471f-b694-388df99a9802 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:42.426533 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eaf29-bcbd-471f-b694-388df99a9802 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:42.426840 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328eaf29-bcbd-471f-b694-388df99a9802 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:42.427688 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328eaf29-bcbd-471f-b694-388df99a9802 None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=745af7d676704a179668d6685724ed78, user.id=04ad234318ad47589b844351cd3bb3e3) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:42.428001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328eaf29-bcbd-471f-b694-388df99a9802 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:42.429448 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328eaf29-bcbd-471f-b694-388df99a9802 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:42.443518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 421/831] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:42 2022] GET /identity/v3/role_assignments?user.id=04ad234318ad47589b844351cd3bb3e3&scope.project.id=745af7d676704a179668d6685724ed78&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:42.481696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6959e60-4002-412b-a9c1-87d629dee719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:42.482380 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6959e60-4002-412b-a9c1-87d629dee719 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:42.482658 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6959e60-4002-412b-a9c1-87d629dee719 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:42.482989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6959e60-4002-412b-a9c1-87d629dee719 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:42.483770 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6959e60-4002-412b-a9c1-87d629dee719 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:42.485258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6959e60-4002-412b-a9c1-87d629dee719 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:42.524050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 411/832] 10.222.0.76 () {60 vars in 1144 bytes} [Thu May 12 17:29:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:29:43.011780 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286f60b-fc02-47b1-ab7b-6f5300b6b981 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:43.012175 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286f60b-fc02-47b1-ab7b-6f5300b6b981 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:43.012352 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286f60b-fc02-47b1-ab7b-6f5300b6b981 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:43.013976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 422/833] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:43.019918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0335bd-5a02-4a88-acfb-5bd1b874abda None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:43.020366 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0335bd-5a02-4a88-acfb-5bd1b874abda None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:43.020535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0335bd-5a02-4a88-acfb-5bd1b874abda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:43.037890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-9f0335bd-5a02-4a88-acfb-5bd1b874abda None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:43.039389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9f0335bd-5a02-4a88-acfb-5bd1b874abda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:43.115803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 412/834] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:43.139648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286f60b-fc02-47b1-ab7b-6f5300b6b981 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:43.244286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286f60b-fc02-47b1-ab7b-6f5300b6b981 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:43.279222 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6bd24-1d54-4e87-b09b-4d91a5927ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:43.279982 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6bd24-1d54-4e87-b09b-4d91a5927ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:43.280288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6bd24-1d54-4e87-b09b-4d91a5927ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:43.280524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6bd24-1d54-4e87-b09b-4d91a5927ec2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:43.291239 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6bd24-1d54-4e87-b09b-4d91a5927ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-49c6bd24-1d54-4e87-b09b-4d91a5927ec2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:43.299428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:43.300382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:43.301244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:43.301244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:43.301244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:43.301244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:43.301244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:43.301244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:43.301244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:43.301244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:43.301244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:43.301244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:43.301244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:29:43.301244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:43.301244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 423/835] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:29:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:43.306412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0335bd-5a02-4a88-acfb-5bd1b874abda None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:43.405099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0335bd-5a02-4a88-acfb-5bd1b874abda None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:43.443662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fce852-87e4-4f0b-99f3-0f2c219bc2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:43.444966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fce852-87e4-4f0b-99f3-0f2c219bc2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:43.445504 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fce852-87e4-4f0b-99f3-0f2c219bc2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:43.445983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fce852-87e4-4f0b-99f3-0f2c219bc2d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:43.446983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fce852-87e4-4f0b-99f3-0f2c219bc2d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:43.447496 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fce852-87e4-4f0b-99f3-0f2c219bc2d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:43.449109 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fce852-87e4-4f0b-99f3-0f2c219bc2d6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:43.458582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 413/836] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:29:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:43.468721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6bd24-1d54-4e87-b09b-4d91a5927ec2 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:43.564085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6bd24-1d54-4e87-b09b-4d91a5927ec2 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:43.597094 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333a115-bc16-4d75-932f-d676e4a38e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:43.597885 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a115-bc16-4d75-932f-d676e4a38e06 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:43.598167 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a115-bc16-4d75-932f-d676e4a38e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:43.598442 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a115-bc16-4d75-932f-d676e4a38e06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:43.608869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333a115-bc16-4d75-932f-d676e4a38e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:43.610316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333a115-bc16-4d75-932f-d676e4a38e06 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-5333a115-bc16-4d75-932f-d676e4a38e06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:43.628064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:43.629011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:43.629930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:43.629930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:43.629930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:43.629930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:43.629930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 424/837] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:43.635460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fce852-87e4-4f0b-99f3-0f2c219bc2d6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:43.741149 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fce852-87e4-4f0b-99f3-0f2c219bc2d6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:43.776310 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d8063-cad7-4555-be9d-e955b37c0098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:43.777338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8063-cad7-4555-be9d-e955b37c0098 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:43.777825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8063-cad7-4555-be9d-e955b37c0098 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:43.778302 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8063-cad7-4555-be9d-e955b37c0098 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:43.779287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d8063-cad7-4555-be9d-e955b37c0098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:43.779797 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d8063-cad7-4555-be9d-e955b37c0098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:43.781367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d8063-cad7-4555-be9d-e955b37c0098 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:43.794308 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 414/838] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:43.800144 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333a115-bc16-4d75-932f-d676e4a38e06 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:43.910697 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333a115-bc16-4d75-932f-d676e4a38e06 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:43.944231 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337ac02-428e-4690-84d5-c7841c80a2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:43.945087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337ac02-428e-4690-84d5-c7841c80a2df None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:43.945367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337ac02-428e-4690-84d5-c7841c80a2df None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:43.945695 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337ac02-428e-4690-84d5-c7841c80a2df None admin] PATH_INFO: `/v3/users/swift` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:43.953344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337ac02-428e-4690-84d5-c7841c80a2df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:43.955368 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337ac02-428e-4690-84d5-c7841c80a2df None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-5337ac02-428e-4690-84d5-c7841c80a2df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:43.970632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:43.971788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:43.972733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:43.972733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:43.972733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:43.972733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:43.972733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:43.972733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:43.972733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:43.972733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:43.972733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 17:29:43.972733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:43.972733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 425/839] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:29:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:43.979912 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d8063-cad7-4555-be9d-e955b37c0098 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:44.019462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e6f73-6e19-44d0-95e8-244f532a7962 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:44.020093 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e6f73-6e19-44d0-95e8-244f532a7962 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:44.021050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e6f73-6e19-44d0-95e8-244f532a7962 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:44.023128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 426/840] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:29:44.028403 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c958b-e38e-4069-a72f-d42112c48a85 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:44.028949 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c958b-e38e-4069-a72f-d42112c48a85 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:44.029424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c958b-e38e-4069-a72f-d42112c48a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:44.047856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-de3c958b-e38e-4069-a72f-d42112c48a85 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:44.049661 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-de3c958b-e38e-4069-a72f-d42112c48a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:44.085641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d8063-cad7-4555-be9d-e955b37c0098 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:44.120235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1fc2e-c76c-4f6b-b145-ff9fd3ce1b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:44.120903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1fc2e-c76c-4f6b-b145-ff9fd3ce1b01 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:44.121185 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1fc2e-c76c-4f6b-b145-ff9fd3ce1b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:44.121458 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1fc2e-c76c-4f6b-b145-ff9fd3ce1b01 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:44.122341 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1fc2e-c76c-4f6b-b145-ff9fd3ce1b01 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:44.122726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1fc2e-c76c-4f6b-b145-ff9fd3ce1b01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:44.124171 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1fc2e-c76c-4f6b-b145-ff9fd3ce1b01 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:44.130971 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 427/841] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:29:44.144494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 415/842] 10.222.0.76 () {56 vars in 1135 bytes} [Thu May 12 17:29:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:44.148993 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c958b-e38e-4069-a72f-d42112c48a85 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:44.149818 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1fc2e-c76c-4f6b-b145-ff9fd3ce1b01 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:44.265959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c958b-e38e-4069-a72f-d42112c48a85 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:44.271051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1fc2e-c76c-4f6b-b145-ff9fd3ce1b01 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:44.320836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619db455-3b11-4168-b102-bd0066a59eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:44.321163 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda654bf-407c-4a12-b689-8b123bfc9a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:44.321692 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda654bf-407c-4a12-b689-8b123bfc9a09 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:44.321973 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda654bf-407c-4a12-b689-8b123bfc9a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:44.322297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda654bf-407c-4a12-b689-8b123bfc9a09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:44.322951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619db455-3b11-4168-b102-bd0066a59eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:44.323443 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619db455-3b11-4168-b102-bd0066a59eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:44.323925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619db455-3b11-4168-b102-bd0066a59eb5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:44.324792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619db455-3b11-4168-b102-bd0066a59eb5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:44.326377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619db455-3b11-4168-b102-bd0066a59eb5 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-619db455-3b11-4168-b102-bd0066a59eb5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:44.340495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:44.341654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:44.342581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:44.342581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:44.342581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:44.342581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:44.342581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:44.342581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:44.342581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:44.342581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:44.342581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:44.342581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:44.342581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:44.342581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:44.342581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 17:29:44.342581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:44.350503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 428/843] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:29:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:44.351809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619db455-3b11-4168-b102-bd0066a59eb5 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:44.411618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda654bf-407c-4a12-b689-8b123bfc9a09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:44.413474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda654bf-407c-4a12-b689-8b123bfc9a09 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:44.479252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619db455-3b11-4168-b102-bd0066a59eb5 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:44.514389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded9eab-b453-4924-942b-11f810b2ec40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:44.515015 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded9eab-b453-4924-942b-11f810b2ec40 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:44.515304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded9eab-b453-4924-942b-11f810b2ec40 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:44.515573 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded9eab-b453-4924-942b-11f810b2ec40 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:44.516280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded9eab-b453-4924-942b-11f810b2ec40 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:44.516591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded9eab-b453-4924-942b-11f810b2ec40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:44.518706 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded9eab-b453-4924-942b-11f810b2ec40 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:44.530936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 416/844] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 17:29:44.531126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 429/845] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:29:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:44.531215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4902-4491-4987-8f8d-6754e4395f57 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:44.531215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4902-4491-4987-8f8d-6754e4395f57 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:44.531215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4902-4491-4987-8f8d-6754e4395f57 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:44.531433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded9eab-b453-4924-942b-11f810b2ec40 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:44.532765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 417/846] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:44.534140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a4902-4491-4987-8f8d-6754e4395f57 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:44.629559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded9eab-b453-4924-942b-11f810b2ec40 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:44.648510 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a4902-4491-4987-8f8d-6754e4395f57 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:44.663289 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d1094-73d5-4064-b686-1f86e8027e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:44.664084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d1094-73d5-4064-b686-1f86e8027e63 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:44.664370 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d1094-73d5-4064-b686-1f86e8027e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:44.664640 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d1094-73d5-4064-b686-1f86e8027e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:44.676793 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d1094-73d5-4064-b686-1f86e8027e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:44.678235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d1094-73d5-4064-b686-1f86e8027e63 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:44.683154 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddf210-349d-4d42-870b-d32bbb2ba328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:44.683806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddf210-349d-4d42-870b-d32bbb2ba328 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:44.684081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddf210-349d-4d42-870b-d32bbb2ba328 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:44.684350 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddf210-349d-4d42-870b-d32bbb2ba328 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:44.685044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddf210-349d-4d42-870b-d32bbb2ba328 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:44.685340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddf210-349d-4d42-870b-d32bbb2ba328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:44.686709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddf210-349d-4d42-870b-d32bbb2ba328 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:44.698715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 418/847] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:29:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:44.698715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586751b-f420-4356-a0b0-b74e4b2b3a71 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:44.698715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586751b-f420-4356-a0b0-b74e4b2b3a71 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:44.698715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586751b-f420-4356-a0b0-b74e4b2b3a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-843d1094-73d5-4064-b686-1f86e8027e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:44.699183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:44.700207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:44.701314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:44.701314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:44.701314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:44.701314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:44.701314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 430/848] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:44.706827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d1094-73d5-4064-b686-1f86e8027e63 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:44.726060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-5586751b-f420-4356-a0b0-b74e4b2b3a71 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:44.727310 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-5586751b-f420-4356-a0b0-b74e4b2b3a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:44.802504 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 419/849] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:44.829335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586751b-f420-4356-a0b0-b74e4b2b3a71 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:44.843322 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d1094-73d5-4064-b686-1f86e8027e63 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:44.890504 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9fc7c-0f96-4a66-a8b6-4b7951ed3010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:44.891209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9fc7c-0f96-4a66-a8b6-4b7951ed3010 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:44.891490 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9fc7c-0f96-4a66-a8b6-4b7951ed3010 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:44.891809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9fc7c-0f96-4a66-a8b6-4b7951ed3010 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:44.892726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9fc7c-0f96-4a66-a8b6-4b7951ed3010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:44.893040 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9fc7c-0f96-4a66-a8b6-4b7951ed3010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:44.894430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9fc7c-0f96-4a66-a8b6-4b7951ed3010 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:44.911599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 431/850] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:44.915188 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9fc7c-0f96-4a66-a8b6-4b7951ed3010 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:44.957177 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586751b-f420-4356-a0b0-b74e4b2b3a71 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:44.994186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2135bf-3db1-49b7-87e3-6f10945ae819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:44.995015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2135bf-3db1-49b7-87e3-6f10945ae819 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:44.995296 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2135bf-3db1-49b7-87e3-6f10945ae819 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:44.995568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2135bf-3db1-49b7-87e3-6f10945ae819 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:45.006146 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2135bf-3db1-49b7-87e3-6f10945ae819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-4f2135bf-3db1-49b7-87e3-6f10945ae819 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:45.014144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:45.015155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:45.016031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:45.016031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:45.016031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:45.016031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:45.016031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:45.016031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:45.016031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:45.016031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:45.016031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:45.016031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:45.016031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:29:45.016031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:45.016031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 420/851] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:29:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:45.020219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9fc7c-0f96-4a66-a8b6-4b7951ed3010 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:45.027653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2135bf-3db1-49b7-87e3-6f10945ae819 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:45.056330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45991e-dedf-4c64-8c5d-107d72f548b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:45.057038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45991e-dedf-4c64-8c5d-107d72f548b0 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:45.057319 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45991e-dedf-4c64-8c5d-107d72f548b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:45.057603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45991e-dedf-4c64-8c5d-107d72f548b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:45.064772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45991e-dedf-4c64-8c5d-107d72f548b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:45.066205 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45991e-dedf-4c64-8c5d-107d72f548b0 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-1a45991e-dedf-4c64-8c5d-107d72f548b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:45.080327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:45.081581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:45.082968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:45.082968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:45.082968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:45.082968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:45.082968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:45.082968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:45.082968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:45.082968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:45.082968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 432/852] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:45.082968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660cab9-ad8e-4a7f-b6aa-cb1e79bef6a7 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:45.083542 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660cab9-ad8e-4a7f-b6aa-cb1e79bef6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:45.083542 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660cab9-ad8e-4a7f-b6aa-cb1e79bef6a7 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:45.084720 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 433/853] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:45.087361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660cab9-ad8e-4a7f-b6aa-cb1e79bef6a7 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:45.139187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2135bf-3db1-49b7-87e3-6f10945ae819 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:45.175754 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da9db2-d9de-481b-9f06-f4fd802c80f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:45.176435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9db2-d9de-481b-9f06-f4fd802c80f3 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:45.176717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9db2-d9de-481b-9f06-f4fd802c80f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:45.176990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9db2-d9de-481b-9f06-f4fd802c80f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:45.177828 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da9db2-d9de-481b-9f06-f4fd802c80f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:45.182211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da9db2-d9de-481b-9f06-f4fd802c80f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:45.183624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da9db2-d9de-481b-9f06-f4fd802c80f3 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:45.191451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660cab9-ad8e-4a7f-b6aa-cb1e79bef6a7 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:45.204081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 421/854] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:29:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:45.204081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fc0d0-6925-4a2f-a564-da6b1d64a25a None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:45.204081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fc0d0-6925-4a2f-a564-da6b1d64a25a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:45.204081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fc0d0-6925-4a2f-a564-da6b1d64a25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:45.222200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ad6fc0d0-6925-4a2f-a564-da6b1d64a25a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:45.223674 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ad6fc0d0-6925-4a2f-a564-da6b1d64a25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:45.232405 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d6c2b-de41-4342-8df0-2fd271674b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:45.233072 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d6c2b-de41-4342-8df0-2fd271674b8c None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:45.233356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d6c2b-de41-4342-8df0-2fd271674b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:45.233641 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d6c2b-de41-4342-8df0-2fd271674b8c None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:45.234548 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d6c2b-de41-4342-8df0-2fd271674b8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:45.234890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d6c2b-de41-4342-8df0-2fd271674b8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:45.236436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d6c2b-de41-4342-8df0-2fd271674b8c None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:45.249472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 434/855] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:45.249778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d6c2b-de41-4342-8df0-2fd271674b8c None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:45.307083 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 422/856] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:45.308652 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fc0d0-6925-4a2f-a564-da6b1d64a25a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:45.360854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d6c2b-de41-4342-8df0-2fd271674b8c None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:45.400596 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0786b7-1533-4f82-9e3e-17dd0ad749ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:45.401675 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0786b7-1533-4f82-9e3e-17dd0ad749ae None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:45.402126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0786b7-1533-4f82-9e3e-17dd0ad749ae None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:45.402397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0786b7-1533-4f82-9e3e-17dd0ad749ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:45.409048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fc0d0-6925-4a2f-a564-da6b1d64a25a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:45.415753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0786b7-1533-4f82-9e3e-17dd0ad749ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:45.417223 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0786b7-1533-4f82-9e3e-17dd0ad749ae None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-5c0786b7-1533-4f82-9e3e-17dd0ad749ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:45.435103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:45.436043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:45.436963 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:45.436963 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:45.436963 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:45.436963 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:45.441665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 435/857] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:45.442259 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0786b7-1533-4f82-9e3e-17dd0ad749ae None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:45.442361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f490752-4c30-46bd-a94c-3a7610ff01c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:45.443017 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f490752-4c30-46bd-a94c-3a7610ff01c5 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:45.443298 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f490752-4c30-46bd-a94c-3a7610ff01c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:45.443569 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f490752-4c30-46bd-a94c-3a7610ff01c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:45.444454 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f490752-4c30-46bd-a94c-3a7610ff01c5 None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=745af7d676704a179668d6685724ed78, user.id=0e679573cc984993b98e416fabd586d4) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:45.444904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f490752-4c30-46bd-a94c-3a7610ff01c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:45.446223 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f490752-4c30-46bd-a94c-3a7610ff01c5 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:45.452152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 423/858] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:45 2022] GET /identity/v3/role_assignments?user.id=0e679573cc984993b98e416fabd586d4&scope.project.id=745af7d676704a179668d6685724ed78&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:45.452922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f490752-4c30-46bd-a94c-3a7610ff01c5 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:45.558275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0786b7-1533-4f82-9e3e-17dd0ad749ae None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:45.558876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f490752-4c30-46bd-a94c-3a7610ff01c5 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:45.597239 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e137ed-0a64-4c78-a416-66ed82342ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:45.597917 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e137ed-0a64-4c78-a416-66ed82342ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:45.598197 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e137ed-0a64-4c78-a416-66ed82342ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:45.598469 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e137ed-0a64-4c78-a416-66ed82342ea3 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:45.599418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e137ed-0a64-4c78-a416-66ed82342ea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:45.599729 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e137ed-0a64-4c78-a416-66ed82342ea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:45.600077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9077833-e319-4cab-ab37-612b90027031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:45.601092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9077833-e319-4cab-ab37-612b90027031 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:45.601232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e137ed-0a64-4c78-a416-66ed82342ea3 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:45.601713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9077833-e319-4cab-ab37-612b90027031 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:45.602211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9077833-e319-4cab-ab37-612b90027031 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:45.603104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9077833-e319-4cab-ab37-612b90027031 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:45.604698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9077833-e319-4cab-ab37-612b90027031 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:45.614716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 424/859] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:45.619196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e137ed-0a64-4c78-a416-66ed82342ea3 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-b9077833-e319-4cab-ab37-612b90027031 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:45.623883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:45.625103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 17:29:45.626652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:45.631405 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 436/860] 10.222.0.76 () {56 vars in 1132 bytes} [Thu May 12 17:29:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:45.633211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9077833-e319-4cab-ab37-612b90027031 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:45.739268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e137ed-0a64-4c78-a416-66ed82342ea3 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:45.750283 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9077833-e319-4cab-ab37-612b90027031 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:45.780167 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668deaac-e98b-4ed1-a21c-91e62be86112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:45.781076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668deaac-e98b-4ed1-a21c-91e62be86112 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:45.781420 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668deaac-e98b-4ed1-a21c-91e62be86112 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:45.781764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668deaac-e98b-4ed1-a21c-91e62be86112 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:45.791210 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668deaac-e98b-4ed1-a21c-91e62be86112 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:45.792682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668deaac-e98b-4ed1-a21c-91e62be86112 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:45.795488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57d0b0-ee7d-412b-88e7-f112b227fd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:45.796148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57d0b0-ee7d-412b-88e7-f112b227fd6d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:45.796426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57d0b0-ee7d-412b-88e7-f112b227fd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:45.796696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57d0b0-ee7d-412b-88e7-f112b227fd6d None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:45.797406 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57d0b0-ee7d-412b-88e7-f112b227fd6d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:45.797710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57d0b0-ee7d-412b-88e7-f112b227fd6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:45.799660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57d0b0-ee7d-412b-88e7-f112b227fd6d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:45.804887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 437/861] 10.222.0.76 () {56 vars in 1126 bytes} [Thu May 12 17:29:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:45.811806 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57d0b0-ee7d-412b-88e7-f112b227fd6d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-668deaac-e98b-4ed1-a21c-91e62be86112 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:45.815104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:45.816359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:45.817557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:45.817557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:45.817557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:45.817557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:45.817557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:45.817557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:45.817557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:45.817557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:45.817557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 17:29:45.817557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:45.817557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 425/862] 10.222.0.76 () {56 vars in 1117 bytes} [Thu May 12 17:29:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:45.824394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668deaac-e98b-4ed1-a21c-91e62be86112 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:45.921020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57d0b0-ee7d-412b-88e7-f112b227fd6d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:45.956930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668deaac-e98b-4ed1-a21c-91e62be86112 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:45.957210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579591e8-9146-4bdf-983f-b222e8c114d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:45.957877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579591e8-9146-4bdf-983f-b222e8c114d3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:45.958153 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579591e8-9146-4bdf-983f-b222e8c114d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:45.958425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579591e8-9146-4bdf-983f-b222e8c114d3 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:45.959163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579591e8-9146-4bdf-983f-b222e8c114d3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:45.959558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579591e8-9146-4bdf-983f-b222e8c114d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:45.961127 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579591e8-9146-4bdf-983f-b222e8c114d3 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:45.970700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 438/863] 10.222.0.76 () {56 vars in 1126 bytes} [Thu May 12 17:29:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:45.998258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b2d08-5f15-4da3-af0b-d1396c4bf499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:45.999076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b2d08-5f15-4da3-af0b-d1396c4bf499 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:45.999425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b2d08-5f15-4da3-af0b-d1396c4bf499 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:45.999767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b2d08-5f15-4da3-af0b-d1396c4bf499 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:46.000731 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b2d08-5f15-4da3-af0b-d1396c4bf499 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:46.001554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b2d08-5f15-4da3-af0b-d1396c4bf499 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:46.003254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b2d08-5f15-4da3-af0b-d1396c4bf499 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:46.024366 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 426/864] 10.222.0.76 () {56 vars in 1149 bytes} [Thu May 12 17:29:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:46.029810 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579591e8-9146-4bdf-983f-b222e8c114d3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:46.143538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579591e8-9146-4bdf-983f-b222e8c114d3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:46.180215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8c8f1-f723-4ab5-bb33-3760c8cf3fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:46.180872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8c8f1-f723-4ab5-bb33-3760c8cf3fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:46.181150 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8c8f1-f723-4ab5-bb33-3760c8cf3fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:46.181423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8c8f1-f723-4ab5-bb33-3760c8cf3fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:46.248554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8c8f1-f723-4ab5-bb33-3760c8cf3fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:46.250189 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8c8f1-f723-4ab5-bb33-3760c8cf3fd7 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:46.351628 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 439/865] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 17:29:46.357200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b2d08-5f15-4da3-af0b-d1396c4bf499 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:46.469160 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b2d08-5f15-4da3-af0b-d1396c4bf499 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:46.504252 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4dc03f-d50b-4353-8112-096e21dc4ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:46.505042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dc03f-d50b-4353-8112-096e21dc4ffc None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:46.505327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dc03f-d50b-4353-8112-096e21dc4ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:46.505599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dc03f-d50b-4353-8112-096e21dc4ffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:46.516027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4dc03f-d50b-4353-8112-096e21dc4ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:46.517495 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4dc03f-d50b-4353-8112-096e21dc4ffc None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-bc4dc03f-d50b-4353-8112-096e21dc4ffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:46.535082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:46.536054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:46.537435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:46.537435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:46.537435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:46.537435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:46.537435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 427/866] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:46.541868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8c8f1-f723-4ab5-bb33-3760c8cf3fd7 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:46.644150 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8c8f1-f723-4ab5-bb33-3760c8cf3fd7 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:46.679909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cceb9-14b1-44bb-85af-cdd7db0a865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:46.680937 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cceb9-14b1-44bb-85af-cdd7db0a865a None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:46.681424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cceb9-14b1-44bb-85af-cdd7db0a865a None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:46.681900 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cceb9-14b1-44bb-85af-cdd7db0a865a None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:46.682860 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cceb9-14b1-44bb-85af-cdd7db0a865a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:46.683390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cceb9-14b1-44bb-85af-cdd7db0a865a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:46.684976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cceb9-14b1-44bb-85af-cdd7db0a865a None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:46.701925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 440/867] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:46.703567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4dc03f-d50b-4353-8112-096e21dc4ffc None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:46.810663 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4dc03f-d50b-4353-8112-096e21dc4ffc None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:46.845939 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b414-274e-4a9d-9680-73b785ae3002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:46.846824 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b414-274e-4a9d-9680-73b785ae3002 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:46.847105 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b414-274e-4a9d-9680-73b785ae3002 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:46.847376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b414-274e-4a9d-9680-73b785ae3002 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:46.855762 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6b414-274e-4a9d-9680-73b785ae3002 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:46.857256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6b414-274e-4a9d-9680-73b785ae3002 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-2eb6b414-274e-4a9d-9680-73b785ae3002 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:46.873153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:46.874132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:46.875329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:46.875329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:46.875329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:46.875329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:46.875329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:46.875329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:46.875329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:46.875329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:46.875329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 428/868] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:46.882351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cceb9-14b1-44bb-85af-cdd7db0a865a None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:46.984195 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cceb9-14b1-44bb-85af-cdd7db0a865a None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:47.018403 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd583acb-08da-484e-9c83-296d438f4789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:47.019464 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd583acb-08da-484e-9c83-296d438f4789 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:47.019958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd583acb-08da-484e-9c83-296d438f4789 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:47.020459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd583acb-08da-484e-9c83-296d438f4789 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:47.021553 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd583acb-08da-484e-9c83-296d438f4789 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:47.022084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd583acb-08da-484e-9c83-296d438f4789 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:47.023762 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd583acb-08da-484e-9c83-296d438f4789 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:47.041532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 441/869] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:47.043159 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b414-274e-4a9d-9680-73b785ae3002 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:47.060569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea748-16c9-45a1-bcf7-771dafd9f81f None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:47.060909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea748-16c9-45a1-bcf7-771dafd9f81f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:47.061136 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea748-16c9-45a1-bcf7-771dafd9f81f None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:47.063236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 442/870] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:29:47.068329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a6e0-936b-4e0d-ae3b-990a6b3b7498 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:47.068609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a6e0-936b-4e0d-ae3b-990a6b3b7498 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:47.068996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a6e0-936b-4e0d-ae3b-990a6b3b7498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:47.085614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-3568a6e0-936b-4e0d-ae3b-990a6b3b7498 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:47.086420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3568a6e0-936b-4e0d-ae3b-990a6b3b7498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:47.159073 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 443/871] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:29:47.165090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b414-274e-4a9d-9680-73b785ae3002 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:47.178298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a6e0-936b-4e0d-ae3b-990a6b3b7498 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:47.208787 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9f190-aebe-4ac0-8843-19dc154cf35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:47.210350 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9f190-aebe-4ac0-8843-19dc154cf35c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:47.210877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9f190-aebe-4ac0-8843-19dc154cf35c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:47.211368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9f190-aebe-4ac0-8843-19dc154cf35c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:47.212573 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9f190-aebe-4ac0-8843-19dc154cf35c None admin] RBAC: Adding query filter params (role.id=511b62180d4c4881999e65dfab877783, scope.project.id=745af7d676704a179668d6685724ed78, user.id=a74c44dd215a4f318baf6768c2b3d932) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:47.213851 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9f190-aebe-4ac0-8843-19dc154cf35c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:47.215519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9f190-aebe-4ac0-8843-19dc154cf35c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:47.230919 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 429/872] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:47 2022] GET /identity/v3/role_assignments?user.id=a74c44dd215a4f318baf6768c2b3d932&scope.project.id=745af7d676704a179668d6685724ed78&role.id=511b62180d4c4881999e65dfab877783 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:47.296931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a6e0-936b-4e0d-ae3b-990a6b3b7498 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:47.335100 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5daa7-0d81-45bd-87ed-a27c67d66ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:47.335782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5daa7-0d81-45bd-87ed-a27c67d66ac5 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:47.336064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5daa7-0d81-45bd-87ed-a27c67d66ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:47.336338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5daa7-0d81-45bd-87ed-a27c67d66ac5 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:47.337083 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5daa7-0d81-45bd-87ed-a27c67d66ac5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:47.338469 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5daa7-0d81-45bd-87ed-a27c67d66ac5 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:47.355602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 444/873] 10.222.0.76 () {60 vars in 1141 bytes} [Thu May 12 17:29:47 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:29:47.908467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efee26d-4661-4cb9-988b-5c6528f6f788 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:47.908991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efee26d-4661-4cb9-988b-5c6528f6f788 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:47.909069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efee26d-4661-4cb9-988b-5c6528f6f788 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:47.910615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 430/874] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:47.916158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d6e01-9860-4956-a8ff-2d66bf1f5920 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:47.916570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d6e01-9860-4956-a8ff-2d66bf1f5920 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:47.916743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d6e01-9860-4956-a8ff-2d66bf1f5920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:47.934039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-217d6e01-9860-4956-a8ff-2d66bf1f5920 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:47.935246 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-217d6e01-9860-4956-a8ff-2d66bf1f5920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:48.013718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 445/875] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:47 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:48.035676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efee26d-4661-4cb9-988b-5c6528f6f788 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:48.140968 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efee26d-4661-4cb9-988b-5c6528f6f788 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:48.179502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96ed28-0ec4-4953-a8dd-f052d31ef63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:48.180247 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ed28-0ec4-4953-a8dd-f052d31ef63f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:48.180531 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ed28-0ec4-4953-a8dd-f052d31ef63f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:48.180794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ed28-0ec4-4953-a8dd-f052d31ef63f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:48.181457 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96ed28-0ec4-4953-a8dd-f052d31ef63f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:48.182920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96ed28-0ec4-4953-a8dd-f052d31ef63f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-be96ed28-0ec4-4953-a8dd-f052d31ef63f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:48.197235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:48.198297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:48.199189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:48.199189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:48.199189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:48.199189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:48.199189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:48.199189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:48.199189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:48.199189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:48.199189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:48.199189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:48.199189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:48.199189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:48.199189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:29:48.199189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:48.202872 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 431/876] 10.222.0.76 () {56 vars in 1126 bytes} [Thu May 12 17:29:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:48.207783 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d6e01-9860-4956-a8ff-2d66bf1f5920 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:48.315488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d6e01-9860-4956-a8ff-2d66bf1f5920 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:48.349371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b9d54-b419-4fc3-9e87-b175551e06d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:48.350041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b9d54-b419-4fc3-9e87-b175551e06d6 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:48.350336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b9d54-b419-4fc3-9e87-b175551e06d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:48.350592 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b9d54-b419-4fc3-9e87-b175551e06d6 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:48.351324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b9d54-b419-4fc3-9e87-b175551e06d6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:48.351629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b9d54-b419-4fc3-9e87-b175551e06d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:48.353004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b9d54-b419-4fc3-9e87-b175551e06d6 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:48.358202 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 446/877] 10.222.0.76 () {56 vars in 1122 bytes} [Thu May 12 17:29:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:48.364369 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96ed28-0ec4-4953-a8dd-f052d31ef63f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:48.387566 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a2ff-615b-4274-aa1f-4842f180d16e None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:48.387865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a2ff-615b-4274-aa1f-4842f180d16e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:48.388113 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a2ff-615b-4274-aa1f-4842f180d16e None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:48.389721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 447/878] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:29:48.394766 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a070b-189d-4b34-ab9b-c7929bacd5c0 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:48.395059 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a070b-189d-4b34-ab9b-c7929bacd5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:48.395342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a070b-189d-4b34-ab9b-c7929bacd5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:48.412504 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-a93a070b-189d-4b34-ab9b-c7929bacd5c0 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:48.413765 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a93a070b-189d-4b34-ab9b-c7929bacd5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:48.479024 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96ed28-0ec4-4953-a8dd-f052d31ef63f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:48.493800 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 448/879] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:29:48.517455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a070b-189d-4b34-ab9b-c7929bacd5c0 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:48.528162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e8419-bee5-4f14-89b8-e27bbb8efd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:48.528855 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e8419-bee5-4f14-89b8-e27bbb8efd17 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:48.529138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e8419-bee5-4f14-89b8-e27bbb8efd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:48.529413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e8419-bee5-4f14-89b8-e27bbb8efd17 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:48.530132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e8419-bee5-4f14-89b8-e27bbb8efd17 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:48.530495 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e8419-bee5-4f14-89b8-e27bbb8efd17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:48.531993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e8419-bee5-4f14-89b8-e27bbb8efd17 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:48.538070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 432/880] 10.222.0.76 () {56 vars in 1122 bytes} [Thu May 12 17:29:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:48.632703 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a070b-189d-4b34-ab9b-c7929bacd5c0 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:48.669994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4484f-fe97-44d6-98bc-de32800ead90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:48.671076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4484f-fe97-44d6-98bc-de32800ead90 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:48.671567 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4484f-fe97-44d6-98bc-de32800ead90 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:48.672078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4484f-fe97-44d6-98bc-de32800ead90 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:48.673605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4484f-fe97-44d6-98bc-de32800ead90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:48.675581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4484f-fe97-44d6-98bc-de32800ead90 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:48.693113 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 449/881] 10.222.0.76 () {60 vars in 1141 bytes} [Thu May 12 17:29:48 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:29:49.634883 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f0d8a-4fa4-4ad3-b8b2-0904603eabca None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:49.635938 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f0d8a-4fa4-4ad3-b8b2-0904603eabca None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:49.636424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f0d8a-4fa4-4ad3-b8b2-0904603eabca None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:49.638265 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 433/882] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:49.643924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55a34f-ba3c-4489-9180-603e55c1edb3 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:49.644780 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55a34f-ba3c-4489-9180-603e55c1edb3 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:49.645259 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55a34f-ba3c-4489-9180-603e55c1edb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:49.662173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-4f55a34f-ba3c-4489-9180-603e55c1edb3 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:49.663698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4f55a34f-ba3c-4489-9180-603e55c1edb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:49.673874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519f128-bc95-40bc-8277-31f0affcd909 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:49.674487 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519f128-bc95-40bc-8277-31f0affcd909 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:49.675018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519f128-bc95-40bc-8277-31f0affcd909 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:49.676845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 434/883] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:29:49.682045 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1a1c9-8b9f-4b5f-b3db-b36fa8d59e80 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:49.682557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1a1c9-8b9f-4b5f-b3db-b36fa8d59e80 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:49.683114 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1a1c9-8b9f-4b5f-b3db-b36fa8d59e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:49.704884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-27a1a1c9-8b9f-4b5f-b3db-b36fa8d59e80 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:49.706555 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-27a1a1c9-8b9f-4b5f-b3db-b36fa8d59e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:49.750775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 450/884] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:29:49.770623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55a34f-ba3c-4489-9180-603e55c1edb3 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:49.776773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 435/885] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:49.799816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1a1c9-8b9f-4b5f-b3db-b36fa8d59e80 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:49.891845 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55a34f-ba3c-4489-9180-603e55c1edb3 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:49.921461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1a1c9-8b9f-4b5f-b3db-b36fa8d59e80 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:49.933876 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069e899-5fd4-4ca5-ae39-977d19c4b59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:49.934992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069e899-5fd4-4ca5-ae39-977d19c4b59d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:49.935276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069e899-5fd4-4ca5-ae39-977d19c4b59d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:49.935553 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069e899-5fd4-4ca5-ae39-977d19c4b59d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:49.948685 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069e899-5fd4-4ca5-ae39-977d19c4b59d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:49.957453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea49bb-6483-4bc0-8e34-447af52eae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-4069e899-5fd4-4ca5-ae39-977d19c4b59d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:49.958435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:49.959625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:49.960502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:49.960502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:49.960502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:49.960502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:49.960502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:49.960502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:49.960502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:49.960502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:49.960502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:49.960502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:49.960502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 17:29:49.960502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:49.960502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 451/886] 10.222.0.76 () {56 vars in 1120 bytes} [Thu May 12 17:29:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:49.961559 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea49bb-6483-4bc0-8e34-447af52eae08 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:49.962006 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea49bb-6483-4bc0-8e34-447af52eae08 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:49.962285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea49bb-6483-4bc0-8e34-447af52eae08 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:49.962995 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea49bb-6483-4bc0-8e34-447af52eae08 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:49.964516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea49bb-6483-4bc0-8e34-447af52eae08 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:49.965507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069e899-5fd4-4ca5-ae39-977d19c4b59d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-25ea49bb-6483-4bc0-8e34-447af52eae08 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:49.977741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:49.978811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:49.979677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:49.979677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:49.979677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:49.979677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:49.979677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:49.979677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:49.979677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:49.979677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:49.979677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:49.979677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:49.979677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:49.979677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:49.979677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 17:29:49.979677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:49.986803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 436/887] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:29:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:49.991600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea49bb-6483-4bc0-8e34-447af52eae08 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:50.084633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069e899-5fd4-4ca5-ae39-977d19c4b59d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:50.088448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea49bb-6483-4bc0-8e34-447af52eae08 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:50.127437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e4df3-f6d4-4a9b-b5cc-ebe0bfcbe8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:50.128420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e4df3-f6d4-4a9b-b5cc-ebe0bfcbe8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:50.128854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e4df3-f6d4-4a9b-b5cc-ebe0bfcbe8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:50.129281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e4df3-f6d4-4a9b-b5cc-ebe0bfcbe8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:50.130235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e4df3-f6d4-4a9b-b5cc-ebe0bfcbe8a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:50.130706 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e4df3-f6d4-4a9b-b5cc-ebe0bfcbe8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:50.131403 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a90c7e-f6a0-4115-a61a-a7b81ddc747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:50.132061 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a90c7e-f6a0-4115-a61a-a7b81ddc747d None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:50.132340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a90c7e-f6a0-4115-a61a-a7b81ddc747d None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:50.132612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a90c7e-f6a0-4115-a61a-a7b81ddc747d None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:50.132954 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e4df3-f6d4-4a9b-b5cc-ebe0bfcbe8a3 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:50.133312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a90c7e-f6a0-4115-a61a-a7b81ddc747d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:50.133615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a90c7e-f6a0-4115-a61a-a7b81ddc747d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:50.135457 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a90c7e-f6a0-4115-a61a-a7b81ddc747d None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:50.141733 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 437/888] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:29:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:50.144050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 452/889] 10.222.0.76 () {56 vars in 1115 bytes} [Thu May 12 17:29:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:50.147636 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a90c7e-f6a0-4115-a61a-a7b81ddc747d None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:50.149506 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e4df3-f6d4-4a9b-b5cc-ebe0bfcbe8a3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:50.258026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e4df3-f6d4-4a9b-b5cc-ebe0bfcbe8a3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:50.271420 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a90c7e-f6a0-4115-a61a-a7b81ddc747d None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:50.302706 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313718fc-c5a0-4e53-b45f-88c8814a84be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:50.303525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313718fc-c5a0-4e53-b45f-88c8814a84be None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:50.303949 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313718fc-c5a0-4e53-b45f-88c8814a84be None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:50.304354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313718fc-c5a0-4e53-b45f-88c8814a84be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:50.311124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09495441-e056-4786-a758-372274c8e825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:50.312031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09495441-e056-4786-a758-372274c8e825 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:50.312498 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09495441-e056-4786-a758-372274c8e825 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:50.312967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09495441-e056-4786-a758-372274c8e825 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:50.314643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09495441-e056-4786-a758-372274c8e825 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:50.315538 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09495441-e056-4786-a758-372274c8e825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:50.316864 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313718fc-c5a0-4e53-b45f-88c8814a84be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:50.317302 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09495441-e056-4786-a758-372274c8e825 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:50.318299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313718fc-c5a0-4e53-b45f-88c8814a84be None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:50.323066 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 438/890] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:29:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:50.328746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09495441-e056-4786-a758-372274c8e825 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-313718fc-c5a0-4e53-b45f-88c8814a84be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:50.337713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:50.338653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:50.339587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:50.339587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:50.339587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:50.339587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:50.342760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 453/891] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:50.346917 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313718fc-c5a0-4e53-b45f-88c8814a84be None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:50.436768 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09495441-e056-4786-a758-372274c8e825 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:50.455105 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313718fc-c5a0-4e53-b45f-88c8814a84be None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:50.471618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc828cd-5c11-42c5-96ef-fd8813813c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:50.472269 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc828cd-5c11-42c5-96ef-fd8813813c62 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:50.472551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc828cd-5c11-42c5-96ef-fd8813813c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:50.472825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc828cd-5c11-42c5-96ef-fd8813813c62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:50.473620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc828cd-5c11-42c5-96ef-fd8813813c62 None admin] RBAC: Adding query filter params (interface=public, service_id=bb2763d19c3742afbaf0a99bd892a2b5, region_id=RegionOne) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:50.474227 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc828cd-5c11-42c5-96ef-fd8813813c62 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:50.475346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc828cd-5c11-42c5-96ef-fd8813813c62 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:50.480931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 439/892] 10.222.0.76 () {56 vars in 1251 bytes} [Thu May 12 17:29:50 2022] GET /identity/v3/endpoints?service_id=bb2763d19c3742afbaf0a99bd892a2b5&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:50.490694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc828cd-5c11-42c5-96ef-fd8813813c62 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:50.498228 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7fe83-28ad-49cb-a653-c05339816137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:50.499363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7fe83-28ad-49cb-a653-c05339816137 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:50.500015 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7fe83-28ad-49cb-a653-c05339816137 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:50.500418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7fe83-28ad-49cb-a653-c05339816137 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:50.502019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7fe83-28ad-49cb-a653-c05339816137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:50.502433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7fe83-28ad-49cb-a653-c05339816137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:50.504635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7fe83-28ad-49cb-a653-c05339816137 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:50.522785 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 454/893] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:50.526808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7fe83-28ad-49cb-a653-c05339816137 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:50.616769 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc828cd-5c11-42c5-96ef-fd8813813c62 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:50.628466 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7fe83-28ad-49cb-a653-c05339816137 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:50.659896 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed9beb-0344-4513-b14e-c181123eae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:50.661279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed9beb-0344-4513-b14e-c181123eae2a None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:50.661633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed9beb-0344-4513-b14e-c181123eae2a None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:50.662235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed9beb-0344-4513-b14e-c181123eae2a None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:50.663093 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed9beb-0344-4513-b14e-c181123eae2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:50.664589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed9beb-0344-4513-b14e-c181123eae2a None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:50.666227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9037c-8a61-4990-8ba4-9cba6121dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:50.667094 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9037c-8a61-4990-8ba4-9cba6121dec6 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:50.667372 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9037c-8a61-4990-8ba4-9cba6121dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:50.667640 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9037c-8a61-4990-8ba4-9cba6121dec6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:50.672373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 440/894] 10.222.0.76 () {56 vars in 1087 bytes} [Thu May 12 17:29:50 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:29:50.678017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9037c-8a61-4990-8ba4-9cba6121dec6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:50.679569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9037c-8a61-4990-8ba4-9cba6121dec6 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-19e9037c-8a61-4990-8ba4-9cba6121dec6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:50.703357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:50.705737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:50.708134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:50.708134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:50.708134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:50.708134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:50.708134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:50.708134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:50.708134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:50.708134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:50.708134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 17:29:50.708134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:50.711577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 455/895] 10.222.0.76 () {56 vars in 1117 bytes} [Thu May 12 17:29:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:50.711743 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed9beb-0344-4513-b14e-c181123eae2a None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:50.822147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed9beb-0344-4513-b14e-c181123eae2a None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:50.864022 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e1668-fb82-433a-a5b0-51931049b4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:50.865112 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e1668-fb82-433a-a5b0-51931049b4ce None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:50.865647 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e1668-fb82-433a-a5b0-51931049b4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:50.866123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e1668-fb82-433a-a5b0-51931049b4ce None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:50.867232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e1668-fb82-433a-a5b0-51931049b4ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:50.869217 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259c797-00e7-4977-8db6-35466a8340a1 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:50.869489 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259c797-00e7-4977-8db6-35466a8340a1 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:50.869775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259c797-00e7-4977-8db6-35466a8340a1 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:50.871411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e1668-fb82-433a-a5b0-51931049b4ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:50.871598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 456/896] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:50.872803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e1668-fb82-433a-a5b0-51931049b4ce None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:50.878618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9439-137a-4bf0-bac0-1c1225045762 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:50.878910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9439-137a-4bf0-bac0-1c1225045762 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:50.879191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9439-137a-4bf0-bac0-1c1225045762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:50.898605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 441/897] 10.222.0.76 () {56 vars in 1149 bytes} [Thu May 12 17:29:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:50.903233 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-6c0a9439-137a-4bf0-bac0-1c1225045762 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:50.904437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6c0a9439-137a-4bf0-bac0-1c1225045762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:50.906660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e1668-fb82-433a-a5b0-51931049b4ce None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:50.982833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 457/898] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:29:50.997410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a9439-137a-4bf0-bac0-1c1225045762 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:51.010771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e1668-fb82-433a-a5b0-51931049b4ce None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:51.045910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4c39d-cffb-47dc-852e-a2ea7dae21f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:51.046654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4c39d-cffb-47dc-852e-a2ea7dae21f0 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:51.046985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4c39d-cffb-47dc-852e-a2ea7dae21f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:51.047262 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4c39d-cffb-47dc-852e-a2ea7dae21f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:51.099186 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a9439-137a-4bf0-bac0-1c1225045762 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:51.118473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4c39d-cffb-47dc-852e-a2ea7dae21f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:51.119977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4c39d-cffb-47dc-852e-a2ea7dae21f0 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:51.133332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84458096-e727-4f43-82f2-07dfd97feae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:51.133992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84458096-e727-4f43-82f2-07dfd97feae8 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:51.134545 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84458096-e727-4f43-82f2-07dfd97feae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:51.134849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84458096-e727-4f43-82f2-07dfd97feae8 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:51.135576 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84458096-e727-4f43-82f2-07dfd97feae8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:51.136930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84458096-e727-4f43-82f2-07dfd97feae8 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:51.152477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 458/899] 10.222.0.76 () {60 vars in 1141 bytes} [Thu May 12 17:29:50 2022] POST /identity/v3/services => generated 241 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:29:51.153765 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952e8ba-3790-450a-8734-bca5ae3740cf None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:51.154055 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952e8ba-3790-450a-8734-bca5ae3740cf None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:51.154329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952e8ba-3790-450a-8734-bca5ae3740cf None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:51.160639 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 459/900] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:51.162099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08db28b-42b3-41d6-a340-81e1b93e00f8 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:51.162391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08db28b-42b3-41d6-a340-81e1b93e00f8 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:51.162697 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08db28b-42b3-41d6-a340-81e1b93e00f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:51.184020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-c08db28b-42b3-41d6-a340-81e1b93e00f8 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:51.185465 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c08db28b-42b3-41d6-a340-81e1b93e00f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:51.239776 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 442/901] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:29:50 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:29:51.245849 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4c39d-cffb-47dc-852e-a2ea7dae21f0 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:51.300476 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 460/902] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:51.323511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08db28b-42b3-41d6-a340-81e1b93e00f8 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:51.378389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4c39d-cffb-47dc-852e-a2ea7dae21f0 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:51.431551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46053661-001e-4e36-8b4c-e26fe44791ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:51.432343 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46053661-001e-4e36-8b4c-e26fe44791ff None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:51.432612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46053661-001e-4e36-8b4c-e26fe44791ff None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:51.432886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46053661-001e-4e36-8b4c-e26fe44791ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:51.443813 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46053661-001e-4e36-8b4c-e26fe44791ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:51.445213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46053661-001e-4e36-8b4c-e26fe44791ff None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:51.450601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08db28b-42b3-41d6-a340-81e1b93e00f8 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-46053661-001e-4e36-8b4c-e26fe44791ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:51.463621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:51.464601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:51.465523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:51.465523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:51.465523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:51.465523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:51.465523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 443/903] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:51.470338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46053661-001e-4e36-8b4c-e26fe44791ff None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:51.493584 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc316e6-0e20-4812-85e6-5cc22910c1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:51.494324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc316e6-0e20-4812-85e6-5cc22910c1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:51.494609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc316e6-0e20-4812-85e6-5cc22910c1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:51.494908 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc316e6-0e20-4812-85e6-5cc22910c1d6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:51.495619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc316e6-0e20-4812-85e6-5cc22910c1d6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:51.496984 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc316e6-0e20-4812-85e6-5cc22910c1d6 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-5bc316e6-0e20-4812-85e6-5cc22910c1d6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:51.510123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:51.511163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:51.512019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 461/904] 10.222.0.76 () {56 vars in 1132 bytes} [Thu May 12 17:29:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:51.518158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc316e6-0e20-4812-85e6-5cc22910c1d6 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:51.608709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46053661-001e-4e36-8b4c-e26fe44791ff None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:51.621178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc316e6-0e20-4812-85e6-5cc22910c1d6 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:51.652301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0dabbd-0e3d-4944-93f8-5484fdeaa0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:51.653281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dabbd-0e3d-4944-93f8-5484fdeaa0be None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:51.653735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dabbd-0e3d-4944-93f8-5484fdeaa0be None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:51.654168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dabbd-0e3d-4944-93f8-5484fdeaa0be None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:51.655014 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0dabbd-0e3d-4944-93f8-5484fdeaa0be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:51.655326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0dabbd-0e3d-4944-93f8-5484fdeaa0be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:51.656821 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0dabbd-0e3d-4944-93f8-5484fdeaa0be None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:51.657169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b72f6-e14d-4f14-bba1-ac5a22200093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:51.658355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b72f6-e14d-4f14-bba1-ac5a22200093 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:51.658868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b72f6-e14d-4f14-bba1-ac5a22200093 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:51.659341 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b72f6-e14d-4f14-bba1-ac5a22200093 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:51.660240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b72f6-e14d-4f14-bba1-ac5a22200093 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:51.660793 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b72f6-e14d-4f14-bba1-ac5a22200093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:51.662347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b72f6-e14d-4f14-bba1-ac5a22200093 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:51.674718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 444/905] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:51.675218 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 462/906] 10.222.0.76 () {56 vars in 1126 bytes} [Thu May 12 17:29:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:51.675556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0dabbd-0e3d-4944-93f8-5484fdeaa0be None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:51.679546 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b72f6-e14d-4f14-bba1-ac5a22200093 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:51.778205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0dabbd-0e3d-4944-93f8-5484fdeaa0be None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:51.800336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b72f6-e14d-4f14-bba1-ac5a22200093 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:51.812255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ebdad-dfe8-4e38-a4ea-1c531b24c5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:51.812984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebdad-dfe8-4e38-a4ea-1c531b24c5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:51.813264 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebdad-dfe8-4e38-a4ea-1c531b24c5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:51.813574 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebdad-dfe8-4e38-a4ea-1c531b24c5b3 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:51.814455 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ebdad-dfe8-4e38-a4ea-1c531b24c5b3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:51.814864 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ebdad-dfe8-4e38-a4ea-1c531b24c5b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:51.816250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ebdad-dfe8-4e38-a4ea-1c531b24c5b3 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:51.821465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 445/907] 10.222.0.76 () {56 vars in 1126 bytes} [Thu May 12 17:29:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:51.827466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ebdad-dfe8-4e38-a4ea-1c531b24c5b3 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:51.838286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dd82f-0e0a-4855-bba0-f4c405a74d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:51.839433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dd82f-0e0a-4855-bba0-f4c405a74d80 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:51.839997 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dd82f-0e0a-4855-bba0-f4c405a74d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:51.840477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dd82f-0e0a-4855-bba0-f4c405a74d80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:51.849070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346dd82f-0e0a-4855-bba0-f4c405a74d80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:51.850892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346dd82f-0e0a-4855-bba0-f4c405a74d80 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-346dd82f-0e0a-4855-bba0-f4c405a74d80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:51.866115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:51.867106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:51.868008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:51.868008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:51.868008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:51.868008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:51.868008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:51.868008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:51.868008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:51.868008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:51.874636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 463/908] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:51.875625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dd82f-0e0a-4855-bba0-f4c405a74d80 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:51.931359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ebdad-dfe8-4e38-a4ea-1c531b24c5b3 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:51.965475 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844f574-fd40-4dc4-a294-1780067aa747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:51.966175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844f574-fd40-4dc4-a294-1780067aa747 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:51.966456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844f574-fd40-4dc4-a294-1780067aa747 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:51.966750 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844f574-fd40-4dc4-a294-1780067aa747 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:51.967571 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844f574-fd40-4dc4-a294-1780067aa747 None admin] RBAC: Adding query filter params (interface=public, service_id=af1915e8d4ed4b35a26884ead76c2b30, region_id=RegionOne) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:51.967876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844f574-fd40-4dc4-a294-1780067aa747 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:51.969288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844f574-fd40-4dc4-a294-1780067aa747 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:51.978056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dd82f-0e0a-4855-bba0-f4c405a74d80 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:51.979716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 446/909] 10.222.0.76 () {56 vars in 1251 bytes} [Thu May 12 17:29:51 2022] GET /identity/v3/endpoints?service_id=af1915e8d4ed4b35a26884ead76c2b30&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:51.980605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844f574-fd40-4dc4-a294-1780067aa747 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:52.013739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6419fd7-e8b6-444c-ad26-d592e6396498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:52.014647 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6419fd7-e8b6-444c-ad26-d592e6396498 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:52.015100 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6419fd7-e8b6-444c-ad26-d592e6396498 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:52.015521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6419fd7-e8b6-444c-ad26-d592e6396498 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:52.016476 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6419fd7-e8b6-444c-ad26-d592e6396498 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:52.017693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6419fd7-e8b6-444c-ad26-d592e6396498 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:52.019439 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6419fd7-e8b6-444c-ad26-d592e6396498 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:52.034990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 464/910] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:52.038399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6419fd7-e8b6-444c-ad26-d592e6396498 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:52.083033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844f574-fd40-4dc4-a294-1780067aa747 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:52.116400 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84096fb5-be1c-47b6-826a-8683523d3f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:52.117057 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84096fb5-be1c-47b6-826a-8683523d3f79 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:52.117593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84096fb5-be1c-47b6-826a-8683523d3f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:52.117593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84096fb5-be1c-47b6-826a-8683523d3f79 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:52.118250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84096fb5-be1c-47b6-826a-8683523d3f79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:52.119619 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84096fb5-be1c-47b6-826a-8683523d3f79 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:52.134784 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 447/911] 10.222.0.76 () {56 vars in 1087 bytes} [Thu May 12 17:29:51 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:29:52.143383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6419fd7-e8b6-444c-ad26-d592e6396498 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:52.180704 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9efceb-009d-4842-8c1e-65782b3688c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:52.181745 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9efceb-009d-4842-8c1e-65782b3688c4 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:52.182173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9efceb-009d-4842-8c1e-65782b3688c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:52.182593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9efceb-009d-4842-8c1e-65782b3688c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:52.183620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9efceb-009d-4842-8c1e-65782b3688c4 None admin] RBAC: Adding query filter params (role.id=50b2b4554d83430cabf65ad4a394d646, scope.project.id=745af7d676704a179668d6685724ed78, user.id=a74c44dd215a4f318baf6768c2b3d932) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:52.184109 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9efceb-009d-4842-8c1e-65782b3688c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:52.185874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9efceb-009d-4842-8c1e-65782b3688c4 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:52.193760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 465/912] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:29:52 2022] GET /identity/v3/role_assignments?user.id=a74c44dd215a4f318baf6768c2b3d932&scope.project.id=745af7d676704a179668d6685724ed78&role.id=50b2b4554d83430cabf65ad4a394d646 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:52.989048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe4db7-6dd0-4d85-aade-1a3cadd1a069 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:52.989573 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe4db7-6dd0-4d85-aade-1a3cadd1a069 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:52.989573 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe4db7-6dd0-4d85-aade-1a3cadd1a069 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:52.991368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 448/913] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:52.997006 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81309083-5c91-4fc4-8920-4626400075de None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:52.997418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81309083-5c91-4fc4-8920-4626400075de None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:52.997561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81309083-5c91-4fc4-8920-4626400075de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:53.015376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-81309083-5c91-4fc4-8920-4626400075de None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:53.016570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-81309083-5c91-4fc4-8920-4626400075de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:53.090796 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 466/914] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:29:53.107077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe4db7-6dd0-4d85-aade-1a3cadd1a069 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:53.212741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe4db7-6dd0-4d85-aade-1a3cadd1a069 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:53.246364 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6473ed-3489-4396-ad38-f2dc596deede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:53.247191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6473ed-3489-4396-ad38-f2dc596deede None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:53.247465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6473ed-3489-4396-ad38-f2dc596deede None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:53.247733 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6473ed-3489-4396-ad38-f2dc596deede None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:53.248438 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6473ed-3489-4396-ad38-f2dc596deede None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:53.249797 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6473ed-3489-4396-ad38-f2dc596deede None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-5a6473ed-3489-4396-ad38-f2dc596deede None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:53.262479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:53.263502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:53.264357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 449/915] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:29:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:53.270276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81309083-5c91-4fc4-8920-4626400075de None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:53.381339 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81309083-5c91-4fc4-8920-4626400075de None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:53.417901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701f6fa-65eb-4b89-9b98-88f64e33fbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:53.418570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701f6fa-65eb-4b89-9b98-88f64e33fbad None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:53.418883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701f6fa-65eb-4b89-9b98-88f64e33fbad None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:53.419158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701f6fa-65eb-4b89-9b98-88f64e33fbad None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:53.419866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701f6fa-65eb-4b89-9b98-88f64e33fbad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:53.420173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701f6fa-65eb-4b89-9b98-88f64e33fbad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:53.421536 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701f6fa-65eb-4b89-9b98-88f64e33fbad None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:53.431632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 467/916] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:29:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:53.433032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6473ed-3489-4396-ad38-f2dc596deede None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:53.537180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c739b-c645-42ac-94be-7ab94128ae7d None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:53.537376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c739b-c645-42ac-94be-7ab94128ae7d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:53.537651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c739b-c645-42ac-94be-7ab94128ae7d None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:53.539316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 468/917] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:29:53.542549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6473ed-3489-4396-ad38-f2dc596deede None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:53.544388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58b72f-c9da-4e20-8a8f-15cf957d1adc None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:53.544684 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58b72f-c9da-4e20-8a8f-15cf957d1adc None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:53.544966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58b72f-c9da-4e20-8a8f-15cf957d1adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:53.561909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-9a58b72f-c9da-4e20-8a8f-15cf957d1adc None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:53.563135 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9a58b72f-c9da-4e20-8a8f-15cf957d1adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:53.584531 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64aac8-5b86-4837-bd8d-4c226b5da9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:53.585812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64aac8-5b86-4837-bd8d-4c226b5da9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:53.586320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64aac8-5b86-4837-bd8d-4c226b5da9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:53.586952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64aac8-5b86-4837-bd8d-4c226b5da9a8 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:53.588322 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64aac8-5b86-4837-bd8d-4c226b5da9a8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:53.588881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64aac8-5b86-4837-bd8d-4c226b5da9a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:53.591001 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64aac8-5b86-4837-bd8d-4c226b5da9a8 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:53.597977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 450/918] 10.222.0.76 () {56 vars in 1114 bytes} [Thu May 12 17:29:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:53.604742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64aac8-5b86-4837-bd8d-4c226b5da9a8 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:53.646935 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 469/919] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:53.663709 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58b72f-c9da-4e20-8a8f-15cf957d1adc None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:53.720783 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64aac8-5b86-4837-bd8d-4c226b5da9a8 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:53.754866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab60c1e-5eb0-4c4c-b3e2-b97f3102df03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:53.755526 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab60c1e-5eb0-4c4c-b3e2-b97f3102df03 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:53.755806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab60c1e-5eb0-4c4c-b3e2-b97f3102df03 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:53.756078 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab60c1e-5eb0-4c4c-b3e2-b97f3102df03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:53.756819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab60c1e-5eb0-4c4c-b3e2-b97f3102df03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:53.758190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab60c1e-5eb0-4c4c-b3e2-b97f3102df03 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:53.786820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 451/920] 10.222.0.76 () {60 vars in 1144 bytes} [Thu May 12 17:29:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:29:53.787048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58b72f-c9da-4e20-8a8f-15cf957d1adc None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:53.836693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a84ed-927c-48ff-8687-2a4e2d516eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:53.837577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a84ed-927c-48ff-8687-2a4e2d516eba None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:53.837898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a84ed-927c-48ff-8687-2a4e2d516eba None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:53.838245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a84ed-927c-48ff-8687-2a4e2d516eba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:53.838945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a84ed-927c-48ff-8687-2a4e2d516eba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:53.840518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a84ed-927c-48ff-8687-2a4e2d516eba None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-048a84ed-927c-48ff-8687-2a4e2d516eba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:53.855846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:53.856925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:53.857792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 470/921] 10.222.0.76 () {56 vars in 1126 bytes} [Thu May 12 17:29:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:53.864255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab60c1e-5eb0-4c4c-b3e2-b97f3102df03 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:53.979153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab60c1e-5eb0-4c4c-b3e2-b97f3102df03 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:54.015063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfeb0a-9547-4b13-a1f6-c90e2106667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:54.016500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfeb0a-9547-4b13-a1f6-c90e2106667d None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:54.017007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfeb0a-9547-4b13-a1f6-c90e2106667d None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:54.017433 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfeb0a-9547-4b13-a1f6-c90e2106667d None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:54.018293 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfeb0a-9547-4b13-a1f6-c90e2106667d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:54.018800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfeb0a-9547-4b13-a1f6-c90e2106667d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:54.020357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfeb0a-9547-4b13-a1f6-c90e2106667d None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:54.025828 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 452/922] 10.222.0.76 () {56 vars in 1122 bytes} [Thu May 12 17:29:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:54.031700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a84ed-927c-48ff-8687-2a4e2d516eba None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:54.137400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a84ed-927c-48ff-8687-2a4e2d516eba None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:54.171694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be8568-c4db-4e9a-9172-ff7dd601379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:54.172682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be8568-c4db-4e9a-9172-ff7dd601379e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:54.173654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be8568-c4db-4e9a-9172-ff7dd601379e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:54.174077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be8568-c4db-4e9a-9172-ff7dd601379e None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:54.175049 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be8568-c4db-4e9a-9172-ff7dd601379e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:54.175505 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be8568-c4db-4e9a-9172-ff7dd601379e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:54.177023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be8568-c4db-4e9a-9172-ff7dd601379e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:54.186170 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 471/923] 10.222.0.76 () {56 vars in 1122 bytes} [Thu May 12 17:29:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:54.189824 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfeb0a-9547-4b13-a1f6-c90e2106667d None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:54.296742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfeb0a-9547-4b13-a1f6-c90e2106667d None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:54.333519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfa98a-d53c-48cf-8903-fd6626ee57ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:54.334178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa98a-d53c-48cf-8903-fd6626ee57ea None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:54.334499 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa98a-d53c-48cf-8903-fd6626ee57ea None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:54.334815 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa98a-d53c-48cf-8903-fd6626ee57ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:54.335605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfa98a-d53c-48cf-8903-fd6626ee57ea None admin] RBAC: Adding query filter params (interface=public, service_id=52aa6896085d4623a40ae57722afd00d, region_id=RegionOne) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:54.335915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfa98a-d53c-48cf-8903-fd6626ee57ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:54.337350 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfa98a-d53c-48cf-8903-fd6626ee57ea None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:54.343090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 453/924] 10.222.0.76 () {56 vars in 1251 bytes} [Thu May 12 17:29:54 2022] GET /identity/v3/endpoints?service_id=52aa6896085d4623a40ae57722afd00d&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:54.349485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be8568-c4db-4e9a-9172-ff7dd601379e None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:54.457996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be8568-c4db-4e9a-9172-ff7dd601379e None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:54.465435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff93e8-7883-4947-b7db-3b36126dbeff None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:54.466152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff93e8-7883-4947-b7db-3b36126dbeff None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:54.466152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff93e8-7883-4947-b7db-3b36126dbeff None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:54.467836 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 454/925] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:29:54.473860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80357c-c0d4-46fc-b684-6ab8bbab5d02 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:54.474214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80357c-c0d4-46fc-b684-6ab8bbab5d02 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:54.474880 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80357c-c0d4-46fc-b684-6ab8bbab5d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:54.494863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f43c2e-4288-47e2-8847-968848dff746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:54.495273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-6c80357c-c0d4-46fc-b684-6ab8bbab5d02 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:54.495952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f43c2e-4288-47e2-8847-968848dff746 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:54.496384 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f43c2e-4288-47e2-8847-968848dff746 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:54.496666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-6c80357c-c0d4-46fc-b684-6ab8bbab5d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:54.496966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f43c2e-4288-47e2-8847-968848dff746 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:54.497791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f43c2e-4288-47e2-8847-968848dff746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:54.499334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f43c2e-4288-47e2-8847-968848dff746 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:54.505941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 472/926] 10.222.0.76 () {56 vars in 1087 bytes} [Thu May 12 17:29:54 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:29:54.548994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5b9d1-9245-47fc-9ccf-cbfcc98618ec None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:54.549365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5b9d1-9245-47fc-9ccf-cbfcc98618ec None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:54.549554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5b9d1-9245-47fc-9ccf-cbfcc98618ec None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:54.551400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 473/927] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:29:54.562700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b520ca-d60c-4703-8512-36dfa4a29b04 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:54.562700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b520ca-d60c-4703-8512-36dfa4a29b04 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:54.562700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b520ca-d60c-4703-8512-36dfa4a29b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:54.579259 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 455/928] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:29:54.579559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-f6b520ca-d60c-4703-8512-36dfa4a29b04 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:54.580878 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f6b520ca-d60c-4703-8512-36dfa4a29b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:54.611507 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80357c-c0d4-46fc-b684-6ab8bbab5d02 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:54.668248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 474/929] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:54.691337 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b520ca-d60c-4703-8512-36dfa4a29b04 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:54.741489 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80357c-c0d4-46fc-b684-6ab8bbab5d02 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:54.787583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eecc48-a573-41df-bf34-45b36bb58b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:54.788397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eecc48-a573-41df-bf34-45b36bb58b70 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:54.788839 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eecc48-a573-41df-bf34-45b36bb58b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:54.789099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eecc48-a573-41df-bf34-45b36bb58b70 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:54.790043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eecc48-a573-41df-bf34-45b36bb58b70 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:54.791440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eecc48-a573-41df-bf34-45b36bb58b70 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-30eecc48-a573-41df-bf34-45b36bb58b70 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:54.805717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:54.806701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:54.807600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 456/930] 10.222.0.76 () {56 vars in 1132 bytes} [Thu May 12 17:29:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:54.808474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b520ca-d60c-4703-8512-36dfa4a29b04 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:54.816768 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eecc48-a573-41df-bf34-45b36bb58b70 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:54.848408 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f4480-31b2-4242-82cd-a9d4fbaf651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:54.849368 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4480-31b2-4242-82cd-a9d4fbaf651e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:54.849753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4480-31b2-4242-82cd-a9d4fbaf651e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:54.850128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4480-31b2-4242-82cd-a9d4fbaf651e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:54.860435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f4480-31b2-4242-82cd-a9d4fbaf651e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-3c9f4480-31b2-4242-82cd-a9d4fbaf651e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:54.868822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:54.869881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:54.870773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:54.870773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:54.870773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:54.870773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:54.870773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:54.870773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:54.870773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:54.870773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:54.870773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:54.870773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:54.870773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 17:29:54.870773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:54.870773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 475/931] 10.222.0.76 () {56 vars in 1120 bytes} [Thu May 12 17:29:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:54.876038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f4480-31b2-4242-82cd-a9d4fbaf651e None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:54.940961 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eecc48-a573-41df-bf34-45b36bb58b70 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:54.978782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f4480-31b2-4242-82cd-a9d4fbaf651e None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:54.983592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa707e6-a957-4fd8-9a41-f2146f94e649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:54.984255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa707e6-a957-4fd8-9a41-f2146f94e649 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:54.984532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa707e6-a957-4fd8-9a41-f2146f94e649 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:54.984805 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa707e6-a957-4fd8-9a41-f2146f94e649 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:54.985543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa707e6-a957-4fd8-9a41-f2146f94e649 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:54.986470 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa707e6-a957-4fd8-9a41-f2146f94e649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:54.987877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa707e6-a957-4fd8-9a41-f2146f94e649 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:54.997541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 457/932] 10.222.0.76 () {56 vars in 1126 bytes} [Thu May 12 17:29:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:54.998317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa707e6-a957-4fd8-9a41-f2146f94e649 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:55.013530 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3f9bc-9eac-46ce-b9f5-56b90021b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:55.014338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3f9bc-9eac-46ce-b9f5-56b90021b981 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:55.014701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3f9bc-9eac-46ce-b9f5-56b90021b981 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:55.015041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3f9bc-9eac-46ce-b9f5-56b90021b981 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:55.015944 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3f9bc-9eac-46ce-b9f5-56b90021b981 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:55.016307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3f9bc-9eac-46ce-b9f5-56b90021b981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:55.018625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3f9bc-9eac-46ce-b9f5-56b90021b981 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:55.032353 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 476/933] 10.222.0.76 () {56 vars in 1115 bytes} [Thu May 12 17:29:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:55.034575 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3f9bc-9eac-46ce-b9f5-56b90021b981 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:55.109703 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa707e6-a957-4fd8-9a41-f2146f94e649 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:55.139773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3f9bc-9eac-46ce-b9f5-56b90021b981 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:55.144631 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033e6cf-155f-4404-b4c9-3935b7f67959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:55.145301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033e6cf-155f-4404-b4c9-3935b7f67959 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:55.145580 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033e6cf-155f-4404-b4c9-3935b7f67959 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:55.145856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033e6cf-155f-4404-b4c9-3935b7f67959 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:55.146575 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033e6cf-155f-4404-b4c9-3935b7f67959 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:55.146975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033e6cf-155f-4404-b4c9-3935b7f67959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:55.148427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033e6cf-155f-4404-b4c9-3935b7f67959 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:55.154015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 458/934] 10.222.0.76 () {56 vars in 1126 bytes} [Thu May 12 17:29:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:55.162061 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033e6cf-155f-4404-b4c9-3935b7f67959 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:55.183970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cffaf-09ff-4620-8e9f-92853d266d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:55.185029 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cffaf-09ff-4620-8e9f-92853d266d26 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:55.185331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cffaf-09ff-4620-8e9f-92853d266d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:55.185606 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cffaf-09ff-4620-8e9f-92853d266d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:55.200622 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cffaf-09ff-4620-8e9f-92853d266d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:55.202408 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cffaf-09ff-4620-8e9f-92853d266d26 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-850cffaf-09ff-4620-8e9f-92853d266d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:55.224760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:55.225701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:55.226607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:55.226607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:55.226607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:55.226607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:55.226607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 477/935] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:55.231307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cffaf-09ff-4620-8e9f-92853d266d26 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:55.284101 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033e6cf-155f-4404-b4c9-3935b7f67959 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:55.324283 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10035a-2e53-4024-adb0-cf3a50add1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:55.325339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10035a-2e53-4024-adb0-cf3a50add1f4 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:55.325826 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10035a-2e53-4024-adb0-cf3a50add1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:55.326304 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10035a-2e53-4024-adb0-cf3a50add1f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:55.327287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10035a-2e53-4024-adb0-cf3a50add1f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:55.328884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10035a-2e53-4024-adb0-cf3a50add1f4 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:55.340002 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cffaf-09ff-4620-8e9f-92853d266d26 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:55.350663 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 459/936] 10.222.0.76 () {60 vars in 1144 bytes} [Thu May 12 17:29:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:29:55.393850 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f00afb-590f-4601-b628-c79fe168ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:55.394927 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f00afb-590f-4601-b628-c79fe168ecb7 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:55.395536 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f00afb-590f-4601-b628-c79fe168ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:55.396020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f00afb-590f-4601-b628-c79fe168ecb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:55.396977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f00afb-590f-4601-b628-c79fe168ecb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:55.397496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f00afb-590f-4601-b628-c79fe168ecb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:55.399147 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f00afb-590f-4601-b628-c79fe168ecb7 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:55.413715 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 478/937] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:55.419835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10035a-2e53-4024-adb0-cf3a50add1f4 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:55.531239 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10035a-2e53-4024-adb0-cf3a50add1f4 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:55.567030 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318bfb7-0818-45c3-a224-763fc878b47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:55.567763 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318bfb7-0818-45c3-a224-763fc878b47a None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:55.568037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318bfb7-0818-45c3-a224-763fc878b47a None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:55.568305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318bfb7-0818-45c3-a224-763fc878b47a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:55.576125 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318bfb7-0818-45c3-a224-763fc878b47a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:55.577561 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318bfb7-0818-45c3-a224-763fc878b47a None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-d318bfb7-0818-45c3-a224-763fc878b47a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:29:55.593989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:55.595376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:55.596727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:55.596727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:55.596727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:29:55.596727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:29:55.596727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:29:55.596727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:29:55.596727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:29:55.596727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:29:55.596727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 17:29:55.596727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:55.596727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 460/938] 10.222.0.76 () {56 vars in 1117 bytes} [Thu May 12 17:29:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:55.602795 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f00afb-590f-4601-b628-c79fe168ecb7 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:55.710564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f00afb-590f-4601-b628-c79fe168ecb7 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:55.747371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327f210-c4ea-41de-86f8-2403000f75c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:55.748103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327f210-c4ea-41de-86f8-2403000f75c3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:55.748384 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327f210-c4ea-41de-86f8-2403000f75c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:55.748653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327f210-c4ea-41de-86f8-2403000f75c3 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:55.749487 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327f210-c4ea-41de-86f8-2403000f75c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:55.749786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327f210-c4ea-41de-86f8-2403000f75c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:55.752040 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327f210-c4ea-41de-86f8-2403000f75c3 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:55.774805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 479/939] 10.222.0.76 () {56 vars in 1149 bytes} [Thu May 12 17:29:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:29:55.776873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318bfb7-0818-45c3-a224-763fc878b47a None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:55.878686 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318bfb7-0818-45c3-a224-763fc878b47a None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:55.912504 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278ad35-a49f-42e1-bc28-d59ed270f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:55.913396 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278ad35-a49f-42e1-bc28-d59ed270f60e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:55.913676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278ad35-a49f-42e1-bc28-d59ed270f60e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:55.913948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278ad35-a49f-42e1-bc28-d59ed270f60e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:55.930305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278ad35-a49f-42e1-bc28-d59ed270f60e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:55.931802 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278ad35-a49f-42e1-bc28-d59ed270f60e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-b278ad35-a49f-42e1-bc28-d59ed270f60e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:55.949943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:55.950903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:55.952194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:55.952194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:55.952194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:55.952194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:55.952194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 461/940] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:55.957635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327f210-c4ea-41de-86f8-2403000f75c3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:56.058030 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327f210-c4ea-41de-86f8-2403000f75c3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:56.093247 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bf436-cc00-45df-8dac-cb6a13af1230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:56.093915 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bf436-cc00-45df-8dac-cb6a13af1230 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:56.094193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bf436-cc00-45df-8dac-cb6a13af1230 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:56.094464 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bf436-cc00-45df-8dac-cb6a13af1230 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:56.095280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bf436-cc00-45df-8dac-cb6a13af1230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:56.095584 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bf436-cc00-45df-8dac-cb6a13af1230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:56.096987 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bf436-cc00-45df-8dac-cb6a13af1230 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:56.110608 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 480/941] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:56.116740 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278ad35-a49f-42e1-bc28-d59ed270f60e None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:56.221062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278ad35-a49f-42e1-bc28-d59ed270f60e None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:56.262327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4cd44-2541-4e9d-ab85-d6724aceed18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:56.263400 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4cd44-2541-4e9d-ab85-d6724aceed18 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:56.263831 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4cd44-2541-4e9d-ab85-d6724aceed18 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:56.264278 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4cd44-2541-4e9d-ab85-d6724aceed18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:56.271797 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4cd44-2541-4e9d-ab85-d6724aceed18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:56.273474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4cd44-2541-4e9d-ab85-d6724aceed18 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-7bd4cd44-2541-4e9d-ab85-d6724aceed18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:56.294360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:56.295535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:56.296672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:56.296672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:56.296672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:56.296672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:56.296672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:56.296672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:56.296672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:56.296672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:56.299441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 462/942] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:56.308849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bf436-cc00-45df-8dac-cb6a13af1230 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:56.311276 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e98678-230c-4bf9-9e47-61d78cfd4e2b None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:56.311720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e98678-230c-4bf9-9e47-61d78cfd4e2b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:56.312162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e98678-230c-4bf9-9e47-61d78cfd4e2b None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:56.314378 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 463/943] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:29:56.319919 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6558f-422c-4cb3-86b8-781b852e8de9 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:56.320377 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6558f-422c-4cb3-86b8-781b852e8de9 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:56.320828 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6558f-422c-4cb3-86b8-781b852e8de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:56.341478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-88d6558f-422c-4cb3-86b8-781b852e8de9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:56.342922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-88d6558f-422c-4cb3-86b8-781b852e8de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:56.409528 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bf436-cc00-45df-8dac-cb6a13af1230 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:56.412374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 464/944] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:56.436347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6558f-422c-4cb3-86b8-781b852e8de9 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:56.450058 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9ecab-9777-4417-a1b8-533d76d42d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:56.450893 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9ecab-9777-4417-a1b8-533d76d42d59 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:56.451267 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9ecab-9777-4417-a1b8-533d76d42d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:56.451646 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9ecab-9777-4417-a1b8-533d76d42d59 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:56.452507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9ecab-9777-4417-a1b8-533d76d42d59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:56.452959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9ecab-9777-4417-a1b8-533d76d42d59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:56.454502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9ecab-9777-4417-a1b8-533d76d42d59 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:56.471184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 481/945] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:29:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:56.473669 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9ecab-9777-4417-a1b8-533d76d42d59 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:56.547244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6558f-422c-4cb3-86b8-781b852e8de9 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:56.578171 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9ecab-9777-4417-a1b8-533d76d42d59 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:56.584749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5e758-7ee3-48d9-b3d5-11ac404babd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:56.585585 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5e758-7ee3-48d9-b3d5-11ac404babd9 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:56.586043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5e758-7ee3-48d9-b3d5-11ac404babd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:56.586569 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5e758-7ee3-48d9-b3d5-11ac404babd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:56.587519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5e758-7ee3-48d9-b3d5-11ac404babd9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:56.589152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5e758-7ee3-48d9-b3d5-11ac404babd9 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:56.590746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: WARNING keystone.server.flask.common [None req-cae5e758-7ee3-48d9-b3d5-11ac404babd9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 17:29:56.610403 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.sql.core [None req-cae5e758-7ee3-48d9-b3d5-11ac404babd9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 17:29:56.610403 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 17:29:56.610403 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [parameters: {'id': '4d2815ba91684c199b7a2c4f6850dea2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 17:29:56.610403 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80137) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 17:29:56.614910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4f9ef-4d77-4416-9722-bef6ead476e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:56.615952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4f9ef-4d77-4416-9722-bef6ead476e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:56.616230 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4f9ef-4d77-4416-9722-bef6ead476e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:56.616515 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4f9ef-4d77-4416-9722-bef6ead476e3 None admin] PATH_INFO: `/v3/projects/745af7d676704a179668d6685724ed78/users/a74c44dd215a4f318baf6768c2b3d932/roles/50b2b4554d83430cabf65ad4a394d646` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:56.619449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4f9ef-4d77-4416-9722-bef6ead476e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=745af7d676704a179668d6685724ed78, user_id=a74c44dd215a4f318baf6768c2b3d932, role_id=50b2b4554d83430cabf65ad4a394d646)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:56.620958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4f9ef-4d77-4416-9722-bef6ead476e3 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:56.632861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-cae5e758-7ee3-48d9-b3d5-11ac404babd9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4d2815ba91684c199b7a2c4f6850dea2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4d2815ba91684c199b7a2c4f6850dea2. May 12 17:29:56.632861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:56.632861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 17:29:56.632861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 17:29:56.632861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 17:29:56.632861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 17:29:56.632861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 17:29:56.632861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application result = self._query(query) May 12 17:29:56.632861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 17:29:56.632861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application conn.query(q) May 12 17:29:56.632861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 17:29:56.632861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 17:29:56.632861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application result.read() May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 12 17:29:56.633897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return project_ref.to_dict() May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application next(self.gen) May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application yield resource May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application next(self.gen) May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self.session.rollback() May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self.force_reraise() May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise self.value May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application session.commit() May 12 17:29:56.635256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._prepare_impl() May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self.session.flush() May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._flush(objects) May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application compat.raise_( May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application flush_context.execute() May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 17:29:56.636190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rec.execute(self) May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 17:29:56.638303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application result = self._query(query) May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application conn.query(q) May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application result.read() May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 17:29:56.640348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [parameters: {'id': '4d2815ba91684c199b7a2c4f6850dea2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:56.642708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:56.644717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:56.648037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:56.648037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 12 17:29:56.648037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 12 17:29:56.648037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:56.648037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:56.648037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 12 17:29:56.648037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.Conflict( May 12 17:29:56.648037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4d2815ba91684c199b7a2c4f6850dea2. May 12 17:29:56.648037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:56.649258 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 482/946] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:29:56 2022] PUT /identity/v3/projects/745af7d676704a179668d6685724ed78/users/a74c44dd215a4f318baf6768c2b3d932/roles/50b2b4554d83430cabf65ad4a394d646 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:29:56.650626 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 465/947] 10.222.0.76 () {60 vars in 1140 bytes} [Thu May 12 17:29:56 2022] POST /identity/v3/projects => generated 262 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:56.662782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4f9ef-4d77-4416-9722-bef6ead476e3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:56.773297 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4f9ef-4d77-4416-9722-bef6ead476e3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:56.811459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcef43-ba42-423e-8070-58927a7845cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:56.812251 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcef43-ba42-423e-8070-58927a7845cf None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:56.812530 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcef43-ba42-423e-8070-58927a7845cf None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:56.812800 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcef43-ba42-423e-8070-58927a7845cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:56.821043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bcef43-ba42-423e-8070-58927a7845cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:56.822513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bcef43-ba42-423e-8070-58927a7845cf None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-96bcef43-ba42-423e-8070-58927a7845cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:29:56.837142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:56.839359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:56.841708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:29:56.841708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:29:56.841708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:29:56.841708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:29:56.841708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:29:56.841708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:29:56.841708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:29:56.841708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:56.846272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 483/948] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:56.846473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5e758-7ee3-48d9-b3d5-11ac404babd9 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:56.928957 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9780ae-8d07-42af-b527-3995b1fd1948 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:56.929240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9780ae-8d07-42af-b527-3995b1fd1948 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:56.929518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9780ae-8d07-42af-b527-3995b1fd1948 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:56.934643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 484/949] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:29:56.936093 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a94ed-36b6-4404-92b8-8f62e80363d9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:56.936378 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a94ed-36b6-4404-92b8-8f62e80363d9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:56.936650 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a94ed-36b6-4404-92b8-8f62e80363d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:56.953737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-439a94ed-36b6-4404-92b8-8f62e80363d9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:56.956053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-439a94ed-36b6-4404-92b8-8f62e80363d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:56.964651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5e758-7ee3-48d9-b3d5-11ac404babd9 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:57.004534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec05bc8-0429-4546-9a00-f5acbca612bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:57.005787 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec05bc8-0429-4546-9a00-f5acbca612bf None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:57.006315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec05bc8-0429-4546-9a00-f5acbca612bf None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:57.006701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec05bc8-0429-4546-9a00-f5acbca612bf None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:57.007897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec05bc8-0429-4546-9a00-f5acbca612bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:57.008609 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec05bc8-0429-4546-9a00-f5acbca612bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:57.011074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec05bc8-0429-4546-9a00-f5acbca612bf None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:57.037867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 466/951] 10.222.0.76 () {56 vars in 1112 bytes} [Thu May 12 17:29:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:57.042863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 485/951] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:29:57.059052 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec05bc8-0429-4546-9a00-f5acbca612bf None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:57.175075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec05bc8-0429-4546-9a00-f5acbca612bf None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:57.213280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc095b1d-313a-4a89-a977-99e381e277aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:57.214100 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc095b1d-313a-4a89-a977-99e381e277aa None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:57.214374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc095b1d-313a-4a89-a977-99e381e277aa None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:57.214647 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc095b1d-313a-4a89-a977-99e381e277aa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:57.215332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc095b1d-313a-4a89-a977-99e381e277aa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:57.216719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc095b1d-313a-4a89-a977-99e381e277aa None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-cc095b1d-313a-4a89-a977-99e381e277aa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:57.230604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:57.233099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:57.235361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 467/952] 10.222.0.76 () {56 vars in 1126 bytes} [Thu May 12 17:29:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:57.241444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a94ed-36b6-4404-92b8-8f62e80363d9 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:57.351310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a94ed-36b6-4404-92b8-8f62e80363d9 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:57.385926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac86c45-12f5-47e8-8c26-1c72bcd1560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:57.386874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac86c45-12f5-47e8-8c26-1c72bcd1560b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:57.387329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac86c45-12f5-47e8-8c26-1c72bcd1560b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:57.387828 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac86c45-12f5-47e8-8c26-1c72bcd1560b None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:57.388685 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac86c45-12f5-47e8-8c26-1c72bcd1560b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:57.389139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac86c45-12f5-47e8-8c26-1c72bcd1560b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:57.390648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac86c45-12f5-47e8-8c26-1c72bcd1560b None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:57.396649 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 486/953] 10.222.0.76 () {56 vars in 1122 bytes} [Thu May 12 17:29:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:57.401924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc095b1d-313a-4a89-a977-99e381e277aa None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:57.508629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc095b1d-313a-4a89-a977-99e381e277aa None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:57.548724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385277b-daac-471c-bfb4-3d0eeb5604e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:57.549412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385277b-daac-471c-bfb4-3d0eeb5604e2 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:57.549697 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385277b-daac-471c-bfb4-3d0eeb5604e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:57.549973 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385277b-daac-471c-bfb4-3d0eeb5604e2 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:57.550705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385277b-daac-471c-bfb4-3d0eeb5604e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:57.551020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385277b-daac-471c-bfb4-3d0eeb5604e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:57.552404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385277b-daac-471c-bfb4-3d0eeb5604e2 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:57.558213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 468/954] 10.222.0.76 () {56 vars in 1122 bytes} [Thu May 12 17:29:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:57.564474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac86c45-12f5-47e8-8c26-1c72bcd1560b None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:57.666721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac86c45-12f5-47e8-8c26-1c72bcd1560b None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:57.702599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7306b-64b9-4281-b870-a5f70594f538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:57.703527 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7306b-64b9-4281-b870-a5f70594f538 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:57.703953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7306b-64b9-4281-b870-a5f70594f538 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:57.704485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7306b-64b9-4281-b870-a5f70594f538 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:57.705441 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7306b-64b9-4281-b870-a5f70594f538 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:57.706970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7306b-64b9-4281-b870-a5f70594f538 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:57.712630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ce8b0-d427-42b8-a576-dd6cc34b11a5 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:57.712917 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ce8b0-d427-42b8-a576-dd6cc34b11a5 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:57.713207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ce8b0-d427-42b8-a576-dd6cc34b11a5 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:57.718048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 469/955] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:29:57.720414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03643a26-5363-47ce-bcbe-b19e1a42adbe None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:57.720631 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03643a26-5363-47ce-bcbe-b19e1a42adbe None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:57.720901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03643a26-5363-47ce-bcbe-b19e1a42adbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:57.729965 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 487/956] 10.222.0.76 () {60 vars in 1144 bytes} [Thu May 12 17:29:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:29:57.742324 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-03643a26-5363-47ce-bcbe-b19e1a42adbe None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:57.744081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-03643a26-5363-47ce-bcbe-b19e1a42adbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:57.826866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 470/957] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:29:57.851069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7306b-64b9-4281-b870-a5f70594f538 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:57.965062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7306b-64b9-4281-b870-a5f70594f538 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:57.999376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250251c-a832-49dd-83ee-5e2b056b3876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:58.000224 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250251c-a832-49dd-83ee-5e2b056b3876 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:58.000502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250251c-a832-49dd-83ee-5e2b056b3876 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:58.000775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250251c-a832-49dd-83ee-5e2b056b3876 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:58.002225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250251c-a832-49dd-83ee-5e2b056b3876 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:58.003722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250251c-a832-49dd-83ee-5e2b056b3876 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-3250251c-a832-49dd-83ee-5e2b056b3876 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:58.016078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:58.017388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:29:58.018356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 488/958] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:29:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:58.024847 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03643a26-5363-47ce-bcbe-b19e1a42adbe None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:58.131808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03643a26-5363-47ce-bcbe-b19e1a42adbe None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:58.166247 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe40dd1-4abd-4884-8a96-005e4c1df4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:58.167392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe40dd1-4abd-4884-8a96-005e4c1df4ca None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:58.167899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe40dd1-4abd-4884-8a96-005e4c1df4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:58.168388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe40dd1-4abd-4884-8a96-005e4c1df4ca None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:58.169304 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe40dd1-4abd-4884-8a96-005e4c1df4ca None admin] RBAC: Adding query filter params (name=compute) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:58.169824 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe40dd1-4abd-4884-8a96-005e4c1df4ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:58.171434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe40dd1-4abd-4884-8a96-005e4c1df4ca None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:58.177345 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 471/959] 10.222.0.76 () {56 vars in 1112 bytes} [Thu May 12 17:29:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:58.183546 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250251c-a832-49dd-83ee-5e2b056b3876 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:58.284626 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250251c-a832-49dd-83ee-5e2b056b3876 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:58.319070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659bd2c-6c8b-4e39-bddc-77facdb154b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:58.319734 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659bd2c-6c8b-4e39-bddc-77facdb154b5 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:58.320011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659bd2c-6c8b-4e39-bddc-77facdb154b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:58.320289 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659bd2c-6c8b-4e39-bddc-77facdb154b5 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:58.320989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659bd2c-6c8b-4e39-bddc-77facdb154b5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:58.321289 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659bd2c-6c8b-4e39-bddc-77facdb154b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:58.322646 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659bd2c-6c8b-4e39-bddc-77facdb154b5 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:58.327812 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 489/960] 10.222.0.76 () {56 vars in 1112 bytes} [Thu May 12 17:29:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:58.989114 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727e7e6-0675-4196-8ac2-49fc2d2bef39 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:58.989540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727e7e6-0675-4196-8ac2-49fc2d2bef39 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:58.989662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727e7e6-0675-4196-8ac2-49fc2d2bef39 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:58.991323 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 472/961] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:58.997064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6e63a-d8d2-4ad8-82d5-8e880ae7b7fd None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:58.997351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6e63a-d8d2-4ad8-82d5-8e880ae7b7fd None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:58.997625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6e63a-d8d2-4ad8-82d5-8e880ae7b7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:59.015481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-d6b6e63a-d8d2-4ad8-82d5-8e880ae7b7fd None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:59.017191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d6b6e63a-d8d2-4ad8-82d5-8e880ae7b7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:59.088977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 490/962] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:29:59.112210 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727e7e6-0675-4196-8ac2-49fc2d2bef39 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:59.214432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727e7e6-0675-4196-8ac2-49fc2d2bef39 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:59.248632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc319be-8c9a-45e2-b4db-41595c1de638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:59.249374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc319be-8c9a-45e2-b4db-41595c1de638 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:59.249652 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc319be-8c9a-45e2-b4db-41595c1de638 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:59.249919 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc319be-8c9a-45e2-b4db-41595c1de638 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:59.260939 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc319be-8c9a-45e2-b4db-41595c1de638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-afc319be-8c9a-45e2-b4db-41595c1de638 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:29:59.269405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:59.270348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:59.271637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:59.271637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:59.271637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:59.271637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:59.271637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:29:59.271637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:29:59.271637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:29:59.271637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:29:59.271637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:29:59.271637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:29:59.271637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 17:29:59.271637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:59.271637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 473/963] 10.222.0.76 () {56 vars in 1120 bytes} [Thu May 12 17:29:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:59.276876 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6e63a-d8d2-4ad8-82d5-8e880ae7b7fd None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:59.383991 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6e63a-d8d2-4ad8-82d5-8e880ae7b7fd None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:59.418552 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5e11c-e071-4083-91ec-003a4d0600ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:59.419238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5e11c-e071-4083-91ec-003a4d0600ca None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:59.419515 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5e11c-e071-4083-91ec-003a4d0600ca None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:59.419784 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5e11c-e071-4083-91ec-003a4d0600ca None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:59.420519 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5e11c-e071-4083-91ec-003a4d0600ca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:59.420818 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5e11c-e071-4083-91ec-003a4d0600ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:59.422180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5e11c-e071-4083-91ec-003a4d0600ca None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:59.431678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 491/964] 10.222.0.76 () {56 vars in 1115 bytes} [Thu May 12 17:29:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:59.436931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc319be-8c9a-45e2-b4db-41595c1de638 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:59.503114 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce1b9b-69c4-4e27-bb45-a8511bb35a4b None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:59.503306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce1b9b-69c4-4e27-bb45-a8511bb35a4b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:59.503567 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce1b9b-69c4-4e27-bb45-a8511bb35a4b None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:59.505348 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 492/965] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:29:59.510732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae2102-b63d-449a-b2e0-86c5ae51da5c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:59.511019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae2102-b63d-449a-b2e0-86c5ae51da5c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:59.511292 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae2102-b63d-449a-b2e0-86c5ae51da5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:59.528037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-4fae2102-b63d-449a-b2e0-86c5ae51da5c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:29:59.529220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4fae2102-b63d-449a-b2e0-86c5ae51da5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:29:59.544402 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc319be-8c9a-45e2-b4db-41595c1de638 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:59.581808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f246b-b97f-4d84-bc7a-504684628dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:59.582810 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f246b-b97f-4d84-bc7a-504684628dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:59.583201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f246b-b97f-4d84-bc7a-504684628dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:59.583583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f246b-b97f-4d84-bc7a-504684628dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:59.595407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f246b-b97f-4d84-bc7a-504684628dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:59.597087 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f246b-b97f-4d84-bc7a-504684628dd6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:59.607016 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 493/966] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:29:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-e04f246b-b97f-4d84-bc7a-504684628dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:29:59.615891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:29:59.616918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:29:59.618004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:29:59.618004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:29:59.618004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:29:59.618004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:59.619683 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 474/967] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:29:59.624917 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae2102-b63d-449a-b2e0-86c5ae51da5c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:59.638966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f246b-b97f-4d84-bc7a-504684628dd6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:59.750995 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae2102-b63d-449a-b2e0-86c5ae51da5c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:59.751569 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f246b-b97f-4d84-bc7a-504684628dd6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:59.787721 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39c1d-eb88-46bb-9c42-408341cb7074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:59.787922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0934f-54b0-4f0c-b793-b13ac907cc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:59.788323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0934f-54b0-4f0c-b793-b13ac907cc83 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:59.788598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0934f-54b0-4f0c-b793-b13ac907cc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:59.788868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0934f-54b0-4f0c-b793-b13ac907cc83 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:59.789529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39c1d-eb88-46bb-9c42-408341cb7074 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:59.789635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0934f-54b0-4f0c-b793-b13ac907cc83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:29:59.789860 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0934f-54b0-4f0c-b793-b13ac907cc83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:59.790313 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39c1d-eb88-46bb-9c42-408341cb7074 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:59.790814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39c1d-eb88-46bb-9c42-408341cb7074 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:29:59.791280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0934f-54b0-4f0c-b793-b13ac907cc83 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:59.791962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc39c1d-eb88-46bb-9c42-408341cb7074 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:29:59.793572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc39c1d-eb88-46bb-9c42-408341cb7074 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:29:59.809118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.sql.core [None req-bdc39c1d-eb88-46bb-9c42-408341cb7074 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 17:29:59.809118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 17:29:59.809118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [parameters: {'user_id': '30fccc32b45643b48d3085b981e698ca', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 17:29:59.809118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80137) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 17:29:59.809743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 494/968] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:29:59.810480 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0934f-54b0-4f0c-b793-b13ac907cc83 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-bdc39c1d-eb88-46bb-9c42-408341cb7074 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application result = self._query(query) May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application conn.query(q) May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application result.read() May 12 17:29:59.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 17:29:59.819536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application next(self.gen) May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application yield resource May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application next(self.gen) May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self.session.rollback() May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self.force_reraise() May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise self.value May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application session.commit() May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 17:29:59.820726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._prepare_impl() May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self.session.flush() May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._flush(objects) May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application compat.raise_( May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application flush_context.execute() May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rec.execute(self) May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 17:29:59.821742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application result = connection._execute_20( May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 17:29:59.823383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application result = self._query(query) May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application conn.query(q) May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application result.read() May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 17:29:59.824413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [parameters: {'user_id': '30fccc32b45643b48d3085b981e698ca', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:29:59.825519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 12 17:29:59.826544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 12 17:29:59.828893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 12 17:29:59.828893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 12 17:29:59.828893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 17:29:59.828893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 17:29:59.828893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 17:29:59.828893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:29:59.830788 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 475/969] 10.222.0.76 () {60 vars in 1131 bytes} [Thu May 12 17:29:59 2022] POST /identity/v3/users => generated 160 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 12 17:29:59.836730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39c1d-eb88-46bb-9c42-408341cb7074 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:29:59.952245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0934f-54b0-4f0c-b793-b13ac907cc83 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:59.954615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39c1d-eb88-46bb-9c42-408341cb7074 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:29:59.994477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118ba4e-92df-4ea1-9ce1-cfc140091c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:29:59.995470 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ba4e-92df-4ea1-9ce1-cfc140091c71 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:29:59.995908 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ba4e-92df-4ea1-9ce1-cfc140091c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:29:59.996280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ba4e-92df-4ea1-9ce1-cfc140091c71 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:00.002351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182f190-55a2-4a09-88f5-baab04ca586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:00.003382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182f190-55a2-4a09-88f5-baab04ca586d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:00.003811 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182f190-55a2-4a09-88f5-baab04ca586d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:00.004230 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182f190-55a2-4a09-88f5-baab04ca586d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:00.005844 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118ba4e-92df-4ea1-9ce1-cfc140091c71 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:00.008308 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118ba4e-92df-4ea1-9ce1-cfc140091c71 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:00.013812 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182f190-55a2-4a09-88f5-baab04ca586d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:00.015754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182f190-55a2-4a09-88f5-baab04ca586d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-7118ba4e-92df-4ea1-9ce1-cfc140091c71 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:30:00.025651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:00.026875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:00.028192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:00.028192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:00.028192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:30:00.028192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:30:00.028192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:30:00.028192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:30:00.028192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:30:00.028192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:30:00.028192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 17:30:00.028192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-3182f190-55a2-4a09-88f5-baab04ca586d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:30:00.035151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:00.036084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:00.037037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:00.037037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:00.037037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:30:00.037037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:30:00.037037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:30:00.037037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:30:00.037037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:30:00.037037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:30:00.037037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 17:30:00.037037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:00.037598 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 476/970] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:29:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:30:00.037598 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118ba4e-92df-4ea1-9ce1-cfc140091c71 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:00.040164 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 495/971] 10.222.0.76 () {56 vars in 1117 bytes} [Thu May 12 17:29:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:00.049768 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182f190-55a2-4a09-88f5-baab04ca586d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:00.158432 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182f190-55a2-4a09-88f5-baab04ca586d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:00.161815 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118ba4e-92df-4ea1-9ce1-cfc140091c71 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:00.192872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3d6b9-b673-46e3-8c4c-10299c414204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:00.193910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3d6b9-b673-46e3-8c4c-10299c414204 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:00.194435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3d6b9-b673-46e3-8c4c-10299c414204 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:00.194964 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3d6b9-b673-46e3-8c4c-10299c414204 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:00.195153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f317f9-2f4c-4af2-986b-a076eaf3ce79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:00.195817 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f317f9-2f4c-4af2-986b-a076eaf3ce79 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:00.196093 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f317f9-2f4c-4af2-986b-a076eaf3ce79 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:00.196421 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f317f9-2f4c-4af2-986b-a076eaf3ce79 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:00.196966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3d6b9-b673-46e3-8c4c-10299c414204 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:00.197146 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f317f9-2f4c-4af2-986b-a076eaf3ce79 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:00.197447 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f317f9-2f4c-4af2-986b-a076eaf3ce79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:00.197882 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3d6b9-b673-46e3-8c4c-10299c414204 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:00.198892 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f317f9-2f4c-4af2-986b-a076eaf3ce79 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:00.199797 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3d6b9-b673-46e3-8c4c-10299c414204 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:00.223008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 496/972] 10.222.0.76 () {56 vars in 1149 bytes} [Thu May 12 17:30:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:00.223008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d5fab-f9d4-4a26-8df7-34c827bc9698 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:00.223008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d5fab-f9d4-4a26-8df7-34c827bc9698 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:00.223008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d5fab-f9d4-4a26-8df7-34c827bc9698 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:00.223008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 497/973] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:00.225101 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d5fab-f9d4-4a26-8df7-34c827bc9698 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:00.243542 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 477/974] 10.222.0.76 () {56 vars in 1101 bytes} [Thu May 12 17:30:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:00.244915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37b042-c28f-4805-a9d4-d8f3beb380ca None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:00.245202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37b042-c28f-4805-a9d4-d8f3beb380ca None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:00.245476 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37b042-c28f-4805-a9d4-d8f3beb380ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:00.264904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-dc37b042-c28f-4805-a9d4-d8f3beb380ca None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:00.267074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-dc37b042-c28f-4805-a9d4-d8f3beb380ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:00.348084 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 478/975] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:00.375814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37b042-c28f-4805-a9d4-d8f3beb380ca None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:00.390206 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d5fab-f9d4-4a26-8df7-34c827bc9698 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:00.430778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c3a38-a726-43e8-b584-3f08120323a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:00.431928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c3a38-a726-43e8-b584-3f08120323a3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:00.432219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c3a38-a726-43e8-b584-3f08120323a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:00.432496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c3a38-a726-43e8-b584-3f08120323a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:00.491904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37b042-c28f-4805-a9d4-d8f3beb380ca None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:00.512102 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c3a38-a726-43e8-b584-3f08120323a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:00.513594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c3a38-a726-43e8-b584-3f08120323a3 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:00.532589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b30b1-8753-48a4-8164-a7d6b5a02e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:00.532589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b30b1-8753-48a4-8164-a7d6b5a02e41 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:00.532589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b30b1-8753-48a4-8164-a7d6b5a02e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:00.532994 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b30b1-8753-48a4-8164-a7d6b5a02e41 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:00.533456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b30b1-8753-48a4-8164-a7d6b5a02e41 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:00.534944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b30b1-8753-48a4-8164-a7d6b5a02e41 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-c17b30b1-8753-48a4-8164-a7d6b5a02e41 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:00.551046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:00.552196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:00.553075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:00.553075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:00.553075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:00.553075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:00.553075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:00.553075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:00.553075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:00.553075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:00.553075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:00.553075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:00.553075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:30:00.553075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:30:00.553075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:30:00.553075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:00.555746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 479/976] 10.222.0.76 () {56 vars in 1126 bytes} [Thu May 12 17:30:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:30:00.561928 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b30b1-8753-48a4-8164-a7d6b5a02e41 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:00.646486 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 498/977] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:30:00 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 17:30:00.651769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c3a38-a726-43e8-b584-3f08120323a3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:00.694628 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b30b1-8753-48a4-8164-a7d6b5a02e41 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:00.728050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b918bfa-1e79-4a4d-8466-86ad2285f910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:00.728715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b918bfa-1e79-4a4d-8466-86ad2285f910 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:00.728996 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b918bfa-1e79-4a4d-8466-86ad2285f910 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:00.729270 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b918bfa-1e79-4a4d-8466-86ad2285f910 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:00.729975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b918bfa-1e79-4a4d-8466-86ad2285f910 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:00.730279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b918bfa-1e79-4a4d-8466-86ad2285f910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:00.731670 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b918bfa-1e79-4a4d-8466-86ad2285f910 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:00.737070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 480/978] 10.222.0.76 () {56 vars in 1122 bytes} [Thu May 12 17:30:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:00.738278 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad35830-c6ed-4d48-96fa-9e94439d7c2d None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:00.738567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad35830-c6ed-4d48-96fa-9e94439d7c2d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:00.738874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad35830-c6ed-4d48-96fa-9e94439d7c2d None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:00.740255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 481/979] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:00.742956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad35830-c6ed-4d48-96fa-9e94439d7c2d None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:00.750438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c3a38-a726-43e8-b584-3f08120323a3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:00.785042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684afe6-f267-411c-85a4-4405698b4948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:00.785824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684afe6-f267-411c-85a4-4405698b4948 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:00.786102 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684afe6-f267-411c-85a4-4405698b4948 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:00.786373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684afe6-f267-411c-85a4-4405698b4948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:00.796003 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684afe6-f267-411c-85a4-4405698b4948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:00.797432 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684afe6-f267-411c-85a4-4405698b4948 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-c684afe6-f267-411c-85a4-4405698b4948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:30:00.815375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:00.816514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:00.817672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:30:00.817672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:30:00.817672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:00.817672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:00.817672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 499/980] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:00.817974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208458-3582-4d2e-9c84-49d3d9900ae1 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:00.818044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208458-3582-4d2e-9c84-49d3d9900ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:00.818260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208458-3582-4d2e-9c84-49d3d9900ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:00.833791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-cd208458-3582-4d2e-9c84-49d3d9900ae1 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:00.835008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-cd208458-3582-4d2e-9c84-49d3d9900ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:00.842654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad35830-c6ed-4d48-96fa-9e94439d7c2d None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:00.874828 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c6443-53ea-49f6-aa46-731210e00443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:00.875478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c6443-53ea-49f6-aa46-731210e00443 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:00.875759 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c6443-53ea-49f6-aa46-731210e00443 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:00.876689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c6443-53ea-49f6-aa46-731210e00443 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:00.877386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c6443-53ea-49f6-aa46-731210e00443 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:00.877690 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c6443-53ea-49f6-aa46-731210e00443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:00.879088 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c6443-53ea-49f6-aa46-731210e00443 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:00.883759 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 482/981] 10.222.0.76 () {56 vars in 1122 bytes} [Thu May 12 17:30:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:00.885950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c6443-53ea-49f6-aa46-731210e00443 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:00.899024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 500/982] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:00.899875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd208458-3582-4d2e-9c84-49d3d9900ae1 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:00.981072 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c6443-53ea-49f6-aa46-731210e00443 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:00.998329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd208458-3582-4d2e-9c84-49d3d9900ae1 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:01.013671 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71326e1-3890-494e-a58e-e5159558bf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:01.014321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71326e1-3890-494e-a58e-e5159558bf34 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:01.014609 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71326e1-3890-494e-a58e-e5159558bf34 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:01.014914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71326e1-3890-494e-a58e-e5159558bf34 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:01.015630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71326e1-3890-494e-a58e-e5159558bf34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:01.015934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71326e1-3890-494e-a58e-e5159558bf34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:01.017332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71326e1-3890-494e-a58e-e5159558bf34 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:01.028793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 483/983] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:01.029716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71326e1-3890-494e-a58e-e5159558bf34 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:01.035325 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a6933-22ee-4a29-b21a-fb28d63668a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:01.035976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a6933-22ee-4a29-b21a-fb28d63668a1 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:01.036259 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a6933-22ee-4a29-b21a-fb28d63668a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:01.036532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a6933-22ee-4a29-b21a-fb28d63668a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:01.037330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a6933-22ee-4a29-b21a-fb28d63668a1 None admin] RBAC: Adding query filter params (interface=admin, service_id=52aa6896085d4623a40ae57722afd00d, region_id=RegionOne) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:01.037642 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a6933-22ee-4a29-b21a-fb28d63668a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:01.039028 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a6933-22ee-4a29-b21a-fb28d63668a1 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:01.044294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 501/984] 10.222.0.76 () {56 vars in 1249 bytes} [Thu May 12 17:30:00 2022] GET /identity/v3/endpoints?service_id=52aa6896085d4623a40ae57722afd00d&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:01.044879 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a6933-22ee-4a29-b21a-fb28d63668a1 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:01.126519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71326e1-3890-494e-a58e-e5159558bf34 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:01.138080 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a6933-22ee-4a29-b21a-fb28d63668a1 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:01.158738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b73f10-2aac-4c57-917b-9dc8f63b5c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:01.159329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b73f10-2aac-4c57-917b-9dc8f63b5c48 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:01.159609 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b73f10-2aac-4c57-917b-9dc8f63b5c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:01.159881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b73f10-2aac-4c57-917b-9dc8f63b5c48 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:01.160590 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b73f10-2aac-4c57-917b-9dc8f63b5c48 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:01.161949 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b73f10-2aac-4c57-917b-9dc8f63b5c48 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:01.170900 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fcadc-794f-468f-86be-374be741bc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:01.171678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fcadc-794f-468f-86be-374be741bc5a None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:01.171958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fcadc-794f-468f-86be-374be741bc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:01.172230 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fcadc-794f-468f-86be-374be741bc5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:01.175338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 484/985] 10.222.0.76 () {60 vars in 1141 bytes} [Thu May 12 17:30:01 2022] POST /identity/v3/services => generated 242 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:30:01.176115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b73f10-2aac-4c57-917b-9dc8f63b5c48 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:01.179575 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fcadc-794f-468f-86be-374be741bc5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:01.181038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fcadc-794f-468f-86be-374be741bc5a None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-fd9fcadc-794f-468f-86be-374be741bc5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:30:01.198039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:01.199334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:01.200433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:30:01.200433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:30:01.200433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:30:01.200433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:30:01.200433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:30:01.200433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:30:01.200433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:30:01.200433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:01.200433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 502/986] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:01.205305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fcadc-794f-468f-86be-374be741bc5a None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:01.307996 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b73f10-2aac-4c57-917b-9dc8f63b5c48 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:01.316719 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fcadc-794f-468f-86be-374be741bc5a None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:01.346827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c71c-163c-4610-9aea-2cc96e19d9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:01.347502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c71c-163c-4610-9aea-2cc96e19d9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:01.347779 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c71c-163c-4610-9aea-2cc96e19d9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:01.348049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c71c-163c-4610-9aea-2cc96e19d9d4 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:01.348742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7c71c-163c-4610-9aea-2cc96e19d9d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:01.350269 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7c71c-163c-4610-9aea-2cc96e19d9d4 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:01.352257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cf3b0-0716-4eda-9d14-13a6ef596bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:01.352924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cf3b0-0716-4eda-9d14-13a6ef596bea None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:01.353205 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cf3b0-0716-4eda-9d14-13a6ef596bea None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:01.353542 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cf3b0-0716-4eda-9d14-13a6ef596bea None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:01.354332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cf3b0-0716-4eda-9d14-13a6ef596bea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:01.354639 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cf3b0-0716-4eda-9d14-13a6ef596bea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:01.356110 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cf3b0-0716-4eda-9d14-13a6ef596bea None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:01.357172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 485/987] 10.222.0.76 () {56 vars in 1087 bytes} [Thu May 12 17:30:01 2022] GET /identity/v3/services => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:30:01.372034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 503/988] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:30:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:01.379234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c71c-163c-4610-9aea-2cc96e19d9d4 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:01.489271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c71c-163c-4610-9aea-2cc96e19d9d4 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:01.524746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae13d93-eb12-49e4-9352-2140bfc2877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:01.525410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae13d93-eb12-49e4-9352-2140bfc2877e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:01.525697 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae13d93-eb12-49e4-9352-2140bfc2877e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:01.525960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae13d93-eb12-49e4-9352-2140bfc2877e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:01.526831 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae13d93-eb12-49e4-9352-2140bfc2877e None admin] RBAC: Adding query filter params (role.id=50b2b4554d83430cabf65ad4a394d646, scope.project.id=745af7d676704a179668d6685724ed78, user.id=a74c44dd215a4f318baf6768c2b3d932) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:01.527137 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae13d93-eb12-49e4-9352-2140bfc2877e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:01.528585 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae13d93-eb12-49e4-9352-2140bfc2877e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:01.542708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 486/989] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:30:01 2022] GET /identity/v3/role_assignments?user.id=a74c44dd215a4f318baf6768c2b3d932&scope.project.id=745af7d676704a179668d6685724ed78&role.id=50b2b4554d83430cabf65ad4a394d646 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:03.473667 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d96e1-09f4-4ecb-b527-1de79864c0b1 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:03.474188 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d96e1-09f4-4ecb-b527-1de79864c0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:03.474188 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d96e1-09f4-4ecb-b527-1de79864c0b1 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:03.475733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 504/990] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:03.480768 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04042d6-5ade-447c-a365-ce68a48d59ce None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:03.481162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04042d6-5ade-447c-a365-ce68a48d59ce None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:03.481323 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04042d6-5ade-447c-a365-ce68a48d59ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:03.498501 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-d04042d6-5ade-447c-a365-ce68a48d59ce None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:03.499637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d04042d6-5ade-447c-a365-ce68a48d59ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:03.566336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 487/991] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:03.588367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d96e1-09f4-4ecb-b527-1de79864c0b1 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:03.618902 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef423-868a-4dbe-9f8a-74a022839660 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:03.619277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef423-868a-4dbe-9f8a-74a022839660 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:03.619605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef423-868a-4dbe-9f8a-74a022839660 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:03.620893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 488/992] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:30:03.627108 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36fc45-f429-448a-a5f0-489f2c1398d6 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:03.627425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36fc45-f429-448a-a5f0-489f2c1398d6 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:03.627660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36fc45-f429-448a-a5f0-489f2c1398d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:03.645592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ba36fc45-f429-448a-a5f0-489f2c1398d6 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:03.646880 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ba36fc45-f429-448a-a5f0-489f2c1398d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:03.700369 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d96e1-09f4-4ecb-b527-1de79864c0b1 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:03.716170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 489/993] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:30:03.734390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de692b-78f1-4ecd-bf52-7f92356a6c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:03.735225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de692b-78f1-4ecd-bf52-7f92356a6c27 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:03.735605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de692b-78f1-4ecd-bf52-7f92356a6c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:03.736026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de692b-78f1-4ecd-bf52-7f92356a6c27 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:03.736671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de692b-78f1-4ecd-bf52-7f92356a6c27 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:03.738017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de692b-78f1-4ecd-bf52-7f92356a6c27 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:03.739404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36fc45-f429-448a-a5f0-489f2c1398d6 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-10de692b-78f1-4ecd-bf52-7f92356a6c27 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:03.750046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:03.751424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:03.752419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 505/994] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:30:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:03.757225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de692b-78f1-4ecd-bf52-7f92356a6c27 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:03.837468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36fc45-f429-448a-a5f0-489f2c1398d6 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:03.854180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de692b-78f1-4ecd-bf52-7f92356a6c27 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:03.870354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18eed8-fafb-4b64-98cd-8e227c558bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:03.871179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18eed8-fafb-4b64-98cd-8e227c558bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:03.871459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18eed8-fafb-4b64-98cd-8e227c558bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:03.871726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18eed8-fafb-4b64-98cd-8e227c558bc4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:03.872361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18eed8-fafb-4b64-98cd-8e227c558bc4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:03.873707 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18eed8-fafb-4b64-98cd-8e227c558bc4 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:03.885583 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337baa8-bda9-4093-a02a-4581799f9af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-ef18eed8-fafb-4b64-98cd-8e227c558bc4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:03.885716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:03.886871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:03.887730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:03.887730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:03.887730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:03.887730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:03.887730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:03.887730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:03.887730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:03.887730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:03.887730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:03.887730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:03.887730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:30:03.887730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:30:03.887730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 17:30:03.887730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:03.888491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337baa8-bda9-4093-a02a-4581799f9af0 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:03.888491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337baa8-bda9-4093-a02a-4581799f9af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:03.888491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337baa8-bda9-4093-a02a-4581799f9af0 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:03.888683 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 490/995] 10.222.0.76 () {56 vars in 1126 bytes} [Thu May 12 17:30:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:30:03.888759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337baa8-bda9-4093-a02a-4581799f9af0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:03.888759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337baa8-bda9-4093-a02a-4581799f9af0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:03.888893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289dcbd-ed4d-4063-9067-a09bc68ae139 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:03.888893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289dcbd-ed4d-4063-9067-a09bc68ae139 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:03.888893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289dcbd-ed4d-4063-9067-a09bc68ae139 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:03.889540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337baa8-bda9-4093-a02a-4581799f9af0 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:03.890038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 491/996] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:03.898937 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 506/997] 10.222.0.76 () {56 vars in 1112 bytes} [Thu May 12 17:30:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:03.899212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289dcbd-ed4d-4063-9067-a09bc68ae139 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:03.900359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998463-f79a-487b-b30a-22357e78b25c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:03.900641 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998463-f79a-487b-b30a-22357e78b25c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:03.900916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998463-f79a-487b-b30a-22357e78b25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:03.917325 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-36998463-f79a-487b-b30a-22357e78b25c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:03.918509 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-36998463-f79a-487b-b30a-22357e78b25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:03.994697 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 507/998] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:03.994697 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36998463-f79a-487b-b30a-22357e78b25c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:03.994965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289dcbd-ed4d-4063-9067-a09bc68ae139 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:04.026434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eae1e-e11f-4b9d-b692-d647b9895463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:04.027041 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eae1e-e11f-4b9d-b692-d647b9895463 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:04.027320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eae1e-e11f-4b9d-b692-d647b9895463 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:04.027593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eae1e-e11f-4b9d-b692-d647b9895463 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:04.028288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eae1e-e11f-4b9d-b692-d647b9895463 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:04.028588 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eae1e-e11f-4b9d-b692-d647b9895463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:04.029937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eae1e-e11f-4b9d-b692-d647b9895463 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:04.035370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 492/999] 10.222.0.76 () {56 vars in 1122 bytes} [Thu May 12 17:30:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:04.035990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eae1e-e11f-4b9d-b692-d647b9895463 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:04.075172 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36998463-f79a-487b-b30a-22357e78b25c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:04.107446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3755273-aa71-4235-87e4-09ce333a9d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:04.108097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3755273-aa71-4235-87e4-09ce333a9d53 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:04.108377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3755273-aa71-4235-87e4-09ce333a9d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:04.108651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3755273-aa71-4235-87e4-09ce333a9d53 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:04.109346 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3755273-aa71-4235-87e4-09ce333a9d53 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:04.109650 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3755273-aa71-4235-87e4-09ce333a9d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:04.111186 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3755273-aa71-4235-87e4-09ce333a9d53 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:04.115916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 508/1000] 10.222.0.76 () {56 vars in 1112 bytes} [Thu May 12 17:30:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:04.116758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3755273-aa71-4235-87e4-09ce333a9d53 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:04.133559 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eae1e-e11f-4b9d-b692-d647b9895463 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:04.165739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d23fd-671b-49b4-a862-a4049cb800b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:04.166527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d23fd-671b-49b4-a862-a4049cb800b4 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:04.166837 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d23fd-671b-49b4-a862-a4049cb800b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:04.167111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d23fd-671b-49b4-a862-a4049cb800b4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:04.167752 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d23fd-671b-49b4-a862-a4049cb800b4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:04.169133 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d23fd-671b-49b4-a862-a4049cb800b4 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-982d23fd-671b-49b4-a862-a4049cb800b4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:04.180275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:04.181359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:04.182194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 493/1001] 10.222.0.76 () {56 vars in 1105 bytes} [Thu May 12 17:30:04 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:04.183051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d23fd-671b-49b4-a862-a4049cb800b4 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:04.212074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3755273-aa71-4235-87e4-09ce333a9d53 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:04.244385 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bfc3d-7ce5-4ddc-bb45-f235db4cbc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:04.245038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bfc3d-7ce5-4ddc-bb45-f235db4cbc70 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:04.245315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bfc3d-7ce5-4ddc-bb45-f235db4cbc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:04.245584 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bfc3d-7ce5-4ddc-bb45-f235db4cbc70 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:04.246280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bfc3d-7ce5-4ddc-bb45-f235db4cbc70 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:04.246579 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bfc3d-7ce5-4ddc-bb45-f235db4cbc70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:04.247969 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bfc3d-7ce5-4ddc-bb45-f235db4cbc70 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:04.253236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 509/1002] 10.222.0.76 () {56 vars in 1122 bytes} [Thu May 12 17:30:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:04.253996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bfc3d-7ce5-4ddc-bb45-f235db4cbc70 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:04.280212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d23fd-671b-49b4-a862-a4049cb800b4 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:04.312575 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a4e9-afd1-4a70-b34a-e7b6e8a2352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:04.313063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a4e9-afd1-4a70-b34a-e7b6e8a2352a None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:04.313834 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a4e9-afd1-4a70-b34a-e7b6e8a2352a None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:04.314177 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a4e9-afd1-4a70-b34a-e7b6e8a2352a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:04.315133 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63a4e9-afd1-4a70-b34a-e7b6e8a2352a None admin] RBAC: Adding query filter params (interface=public, service_id=722474ccf9bd461d8591bf3a4da349d5, region_id=RegionOne) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:04.315443 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63a4e9-afd1-4a70-b34a-e7b6e8a2352a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:04.316805 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63a4e9-afd1-4a70-b34a-e7b6e8a2352a None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:04.321712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 494/1003] 10.222.0.76 () {56 vars in 1251 bytes} [Thu May 12 17:30:04 2022] GET /identity/v3/endpoints?service_id=722474ccf9bd461d8591bf3a4da349d5&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:04.322458 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a4e9-afd1-4a70-b34a-e7b6e8a2352a None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:04.350716 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bfc3d-7ce5-4ddc-bb45-f235db4cbc70 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:04.384684 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9c0fb-d717-4d0e-86f7-881de9f43acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:04.385341 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9c0fb-d717-4d0e-86f7-881de9f43acb None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:04.385617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9c0fb-d717-4d0e-86f7-881de9f43acb None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:04.385894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9c0fb-d717-4d0e-86f7-881de9f43acb None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:04.386586 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9c0fb-d717-4d0e-86f7-881de9f43acb None admin] RBAC: Adding query filter params (name=image) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:04.386915 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9c0fb-d717-4d0e-86f7-881de9f43acb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:04.388281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9c0fb-d717-4d0e-86f7-881de9f43acb None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:04.394061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 510/1004] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:04.394875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9c0fb-d717-4d0e-86f7-881de9f43acb None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:04.418335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a4e9-afd1-4a70-b34a-e7b6e8a2352a None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:04.450141 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c055f-52cb-4011-b73a-03e1036b6ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:04.450824 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c055f-52cb-4011-b73a-03e1036b6ffb None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:04.451103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c055f-52cb-4011-b73a-03e1036b6ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:04.451375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c055f-52cb-4011-b73a-03e1036b6ffb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:04.452103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c055f-52cb-4011-b73a-03e1036b6ffb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:04.453466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c055f-52cb-4011-b73a-03e1036b6ffb None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:04.468254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 495/1005] 10.222.0.76 () {60 vars in 1144 bytes} [Thu May 12 17:30:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:30:04.469058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c055f-52cb-4011-b73a-03e1036b6ffb None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:04.495100 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9c0fb-d717-4d0e-86f7-881de9f43acb None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:04.538885 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8207fe-74d7-4276-b729-9f45098a152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:04.539503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8207fe-74d7-4276-b729-9f45098a152e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:04.539746 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8207fe-74d7-4276-b729-9f45098a152e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:04.540009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8207fe-74d7-4276-b729-9f45098a152e None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:04.540726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8207fe-74d7-4276-b729-9f45098a152e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:04.542128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8207fe-74d7-4276-b729-9f45098a152e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:04.559000 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 511/1006] 10.222.0.76 () {56 vars in 1087 bytes} [Thu May 12 17:30:04 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:30:04.595221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c055f-52cb-4011-b73a-03e1036b6ffb None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:04.636194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b187c-0297-4be8-93cb-de4d858442dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:04.637365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b187c-0297-4be8-93cb-de4d858442dc None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:04.637865 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b187c-0297-4be8-93cb-de4d858442dc None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:04.638337 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b187c-0297-4be8-93cb-de4d858442dc None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:04.639774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b187c-0297-4be8-93cb-de4d858442dc None admin] RBAC: Adding query filter params (type=image) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:04.640323 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b187c-0297-4be8-93cb-de4d858442dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:04.643019 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b187c-0297-4be8-93cb-de4d858442dc None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:04.650634 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 496/1007] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:06.774572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9011463-9006-474d-843c-e016228417e1 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:06.775141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9011463-9006-474d-843c-e016228417e1 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:06.775141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9011463-9006-474d-843c-e016228417e1 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:06.776547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 512/1008] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:06.783340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f45136-bc53-43a1-8493-b3fdd470460e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:06.783855 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f45136-bc53-43a1-8493-b3fdd470460e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:06.783930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f45136-bc53-43a1-8493-b3fdd470460e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:06.801247 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-10f45136-bc53-43a1-8493-b3fdd470460e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:06.802434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-10f45136-bc53-43a1-8493-b3fdd470460e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:06.850648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c5208-feef-4096-a61d-410ddaa165c4 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:06.850988 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c5208-feef-4096-a61d-410ddaa165c4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:06.851225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c5208-feef-4096-a61d-410ddaa165c4 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:06.852618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 513/1009] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:30:06.857619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df844-9ead-40bd-8c58-aaf6fb6b60f9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:06.857910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df844-9ead-40bd-8c58-aaf6fb6b60f9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:06.858189 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df844-9ead-40bd-8c58-aaf6fb6b60f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:06.866701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 497/1010] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:06.875218 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-905df844-9ead-40bd-8c58-aaf6fb6b60f9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:06.877121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-905df844-9ead-40bd-8c58-aaf6fb6b60f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:06.891299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f45136-bc53-43a1-8493-b3fdd470460e None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:06.942721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 514/1011] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:30:06.956164 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b66e9-2792-4466-aa35-858b28cde0e2 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:06.956447 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b66e9-2792-4466-aa35-858b28cde0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:06.956722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b66e9-2792-4466-aa35-858b28cde0e2 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:06.958164 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 515/1012] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:30:06.962912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ac2e-809d-472b-a901-c8c35155e5b4 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:06.963196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ac2e-809d-472b-a901-c8c35155e5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:06.963468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ac2e-809d-472b-a901-c8c35155e5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:06.979962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-fa37ac2e-809d-472b-a901-c8c35155e5b4 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:06.981136 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-fa37ac2e-809d-472b-a901-c8c35155e5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:06.987083 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f45136-bc53-43a1-8493-b3fdd470460e None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:07.019480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92718a1-7d35-4e46-8b17-50871cef8ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:07.020258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92718a1-7d35-4e46-8b17-50871cef8ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:07.020539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92718a1-7d35-4e46-8b17-50871cef8ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:07.020808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92718a1-7d35-4e46-8b17-50871cef8ae6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:07.021981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92718a1-7d35-4e46-8b17-50871cef8ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:07.023430 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92718a1-7d35-4e46-8b17-50871cef8ae6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:07.030042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 498/1013] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:07.030042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92718a1-7d35-4e46-8b17-50871cef8ae6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:07.046399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 516/1014] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:30:07.047238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37ac2e-809d-472b-a901-c8c35155e5b4 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:07.123085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92718a1-7d35-4e46-8b17-50871cef8ae6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:07.143866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37ac2e-809d-472b-a901-c8c35155e5b4 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:07.154951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c447bc2-78a3-4561-8e8d-0abe9822163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:07.155734 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447bc2-78a3-4561-8e8d-0abe9822163e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:07.156018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447bc2-78a3-4561-8e8d-0abe9822163e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:07.156345 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c447bc2-78a3-4561-8e8d-0abe9822163e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:07.157498 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c447bc2-78a3-4561-8e8d-0abe9822163e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:07.158980 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c447bc2-78a3-4561-8e8d-0abe9822163e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-8c447bc2-78a3-4561-8e8d-0abe9822163e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:07.170392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:07.171484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:07.172347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 499/1015] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:30:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:07.173846 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c447bc2-78a3-4561-8e8d-0abe9822163e None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:07.177486 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0602153-9168-4b12-8695-f877a29a70b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:07.178125 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0602153-9168-4b12-8695-f877a29a70b9 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:07.178403 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0602153-9168-4b12-8695-f877a29a70b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:07.178696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0602153-9168-4b12-8695-f877a29a70b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:07.179416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0602153-9168-4b12-8695-f877a29a70b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:07.180848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0602153-9168-4b12-8695-f877a29a70b9 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:07.206099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 517/1016] 10.222.0.76 () {60 vars in 1141 bytes} [Thu May 12 17:30:07 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:30:07.206972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0602153-9168-4b12-8695-f877a29a70b9 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:07.280449 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c447bc2-78a3-4561-8e8d-0abe9822163e None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:07.315286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0602153-9168-4b12-8695-f877a29a70b9 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:07.317876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364c63-48df-4b96-9afa-e1a21d92b848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:07.318556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364c63-48df-4b96-9afa-e1a21d92b848 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:07.318941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364c63-48df-4b96-9afa-e1a21d92b848 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:07.319216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364c63-48df-4b96-9afa-e1a21d92b848 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:07.319952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1364c63-48df-4b96-9afa-e1a21d92b848 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:07.321355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1364c63-48df-4b96-9afa-e1a21d92b848 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:07.336985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 500/1017] 10.222.0.76 () {60 vars in 1141 bytes} [Thu May 12 17:30:07 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:30:07.364074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20be864-b8ef-45b4-9217-4f83c9c59572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:07.364775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20be864-b8ef-45b4-9217-4f83c9c59572 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:07.365057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20be864-b8ef-45b4-9217-4f83c9c59572 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:07.365330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20be864-b8ef-45b4-9217-4f83c9c59572 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:07.366066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20be864-b8ef-45b4-9217-4f83c9c59572 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:07.366375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20be864-b8ef-45b4-9217-4f83c9c59572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:07.367899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20be864-b8ef-45b4-9217-4f83c9c59572 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:07.379178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 518/1018] 10.222.0.76 () {56 vars in 1112 bytes} [Thu May 12 17:30:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:07.380264 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364c63-48df-4b96-9afa-e1a21d92b848 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:07.492764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364c63-48df-4b96-9afa-e1a21d92b848 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:07.528147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c3a7e-ad7e-4368-90c6-1363359bb669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:07.529603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c3a7e-ad7e-4368-90c6-1363359bb669 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:07.529603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c3a7e-ad7e-4368-90c6-1363359bb669 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:07.529603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c3a7e-ad7e-4368-90c6-1363359bb669 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:07.530044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c3a7e-ad7e-4368-90c6-1363359bb669 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:07.530345 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c3a7e-ad7e-4368-90c6-1363359bb669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:07.532464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c3a7e-ad7e-4368-90c6-1363359bb669 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:07.537095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 501/1019] 10.222.0.76 () {56 vars in 1112 bytes} [Thu May 12 17:30:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:07.542511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20be864-b8ef-45b4-9217-4f83c9c59572 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:07.641099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20be864-b8ef-45b4-9217-4f83c9c59572 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:07.674419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48434cc8-f408-495c-bbf3-385abd100f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:07.675101 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48434cc8-f408-495c-bbf3-385abd100f8e None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:07.675377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48434cc8-f408-495c-bbf3-385abd100f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:07.675648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48434cc8-f408-495c-bbf3-385abd100f8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:07.676384 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48434cc8-f408-495c-bbf3-385abd100f8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:07.677869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48434cc8-f408-495c-bbf3-385abd100f8e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:07.696916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 519/1020] 10.222.0.76 () {60 vars in 1144 bytes} [Thu May 12 17:30:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:30:09.522187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024d94e-8993-426c-a40b-d979f7e4d4fe None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:09.522933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024d94e-8993-426c-a40b-d979f7e4d4fe None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:09.522933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024d94e-8993-426c-a40b-d979f7e4d4fe None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:09.524207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 502/1021] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:09.529355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ffb0b-c00a-41b8-a198-ce83861e7d1b None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:09.529767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ffb0b-c00a-41b8-a198-ce83861e7d1b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:09.529929 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ffb0b-c00a-41b8-a198-ce83861e7d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:09.547657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-d13ffb0b-c00a-41b8-a198-ce83861e7d1b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:09.549392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d13ffb0b-c00a-41b8-a198-ce83861e7d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:09.620304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 520/1022] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:09.629231 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c48a6-af70-42f8-8649-b0994062c5e9 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:09.629516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c48a6-af70-42f8-8649-b0994062c5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:09.629789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c48a6-af70-42f8-8649-b0994062c5e9 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:09.631295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 503/1023] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:09.636526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c47ff-8507-4aec-82ff-d0e3aef520df None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:09.636818 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c47ff-8507-4aec-82ff-d0e3aef520df None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:09.637086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c47ff-8507-4aec-82ff-d0e3aef520df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:09.644862 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c48a6-af70-42f8-8649-b0994062c5e9 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:09.654129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-307c47ff-8507-4aec-82ff-d0e3aef520df None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:09.655353 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-307c47ff-8507-4aec-82ff-d0e3aef520df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:09.724494 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 521/1024] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:09.747293 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c47ff-8507-4aec-82ff-d0e3aef520df None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:09.748552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c48a6-af70-42f8-8649-b0994062c5e9 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:09.782795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d163a4b-e8c7-4df8-9586-af85d9f660ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:09.783905 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d163a4b-e8c7-4df8-9586-af85d9f660ce None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:09.784406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d163a4b-e8c7-4df8-9586-af85d9f660ce None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:09.784882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d163a4b-e8c7-4df8-9586-af85d9f660ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:09.786288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d163a4b-e8c7-4df8-9586-af85d9f660ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:09.787967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d163a4b-e8c7-4df8-9586-af85d9f660ce None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:09.789795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 504/1025] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:09.795263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d163a4b-e8c7-4df8-9586-af85d9f660ce None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:09.845412 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c47ff-8507-4aec-82ff-d0e3aef520df None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:09.882777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc716067-bf98-4c4c-b646-5183d189608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:09.883568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc716067-bf98-4c4c-b646-5183d189608f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:09.883847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc716067-bf98-4c4c-b646-5183d189608f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:09.884118 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc716067-bf98-4c4c-b646-5183d189608f None admin] PATH_INFO: `/v3/services/image` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:09.885041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc716067-bf98-4c4c-b646-5183d189608f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:09.886415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc716067-bf98-4c4c-b646-5183d189608f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:09.896795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d163a4b-e8c7-4df8-9586-af85d9f660ce None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-fc716067-bf98-4c4c-b646-5183d189608f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:09.898390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:09.899543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:09.900416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 522/1026] 10.222.0.76 () {56 vars in 1105 bytes} [Thu May 12 17:30:09 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:30:09.905515 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc716067-bf98-4c4c-b646-5183d189608f None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:09.933428 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6e57a-a9e1-4409-98a7-4b4114c406e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:09.934097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6e57a-a9e1-4409-98a7-4b4114c406e6 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:09.934375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6e57a-a9e1-4409-98a7-4b4114c406e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:09.934646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6e57a-a9e1-4409-98a7-4b4114c406e6 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:09.935375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6e57a-a9e1-4409-98a7-4b4114c406e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:09.936799 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6e57a-a9e1-4409-98a7-4b4114c406e6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:09.959836 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 505/1027] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:30:09 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:30:10.008716 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc716067-bf98-4c4c-b646-5183d189608f None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:10.044521 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6e4b2-45e2-4c52-9305-874d3764099a None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:10.044730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6e4b2-45e2-4c52-9305-874d3764099a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:10.045000 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6e4b2-45e2-4c52-9305-874d3764099a None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:10.045684 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efa9d3-86da-4384-9104-af8422285a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:10.046555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efa9d3-86da-4384-9104-af8422285a75 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:10.046766 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 506/1028] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:30:10.046886 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efa9d3-86da-4384-9104-af8422285a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:10.047041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efa9d3-86da-4384-9104-af8422285a75 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:10.047858 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efa9d3-86da-4384-9104-af8422285a75 None admin] RBAC: Adding query filter params (name=image) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:10.048126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efa9d3-86da-4384-9104-af8422285a75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:10.049566 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efa9d3-86da-4384-9104-af8422285a75 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:10.052328 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f5a97-5728-422f-b84c-ce8300b4f929 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:10.052613 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f5a97-5728-422f-b84c-ce8300b4f929 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:10.052891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f5a97-5728-422f-b84c-ce8300b4f929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:10.055690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 523/1029] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:10.064563 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efa9d3-86da-4384-9104-af8422285a75 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:10.071038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-9f3f5a97-5728-422f-b84c-ce8300b4f929 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:10.072259 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9f3f5a97-5728-422f-b84c-ce8300b4f929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:10.142437 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 507/1030] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:30:10.166457 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f5a97-5728-422f-b84c-ce8300b4f929 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:10.170313 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efa9d3-86da-4384-9104-af8422285a75 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:10.207412 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b40c-c7aa-40ba-87c5-f72b2a8fdeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:10.208076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b40c-c7aa-40ba-87c5-f72b2a8fdeaa None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:10.208357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b40c-c7aa-40ba-87c5-f72b2a8fdeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:10.208623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b40c-c7aa-40ba-87c5-f72b2a8fdeaa None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:10.210045 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15b40c-c7aa-40ba-87c5-f72b2a8fdeaa None admin] RBAC: Adding query filter params (type=image) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:10.210045 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15b40c-c7aa-40ba-87c5-f72b2a8fdeaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:10.210990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15b40c-c7aa-40ba-87c5-f72b2a8fdeaa None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:10.215925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 524/1031] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:10.222898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b40c-c7aa-40ba-87c5-f72b2a8fdeaa None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:10.274988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f5a97-5728-422f-b84c-ce8300b4f929 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:10.313107 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576a8de-9a7d-4005-907c-e394fdbd1dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:10.314383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576a8de-9a7d-4005-907c-e394fdbd1dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:10.314742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576a8de-9a7d-4005-907c-e394fdbd1dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:10.315017 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576a8de-9a7d-4005-907c-e394fdbd1dc8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:10.324834 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576a8de-9a7d-4005-907c-e394fdbd1dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:30:10.325080 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b40c-c7aa-40ba-87c5-f72b2a8fdeaa None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-7576a8de-9a7d-4005-907c-e394fdbd1dc8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:30:10.333179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:10.334170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:10.335232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:10.335232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:10.335232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:10.335232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:10.335232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:30:10.335232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:30:10.335232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:30:10.335232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:30:10.335232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:30:10.335232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:30:10.335232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 17:30:10.335232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:10.335232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 508/1032] 10.222.0.76 () {56 vars in 1120 bytes} [Thu May 12 17:30:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:30:10.340263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576a8de-9a7d-4005-907c-e394fdbd1dc8 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:10.364586 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48c7db-5c10-449c-95cb-913202d94423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:10.365241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48c7db-5c10-449c-95cb-913202d94423 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:10.365526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48c7db-5c10-449c-95cb-913202d94423 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:10.365819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48c7db-5c10-449c-95cb-913202d94423 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:10.366605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48c7db-5c10-449c-95cb-913202d94423 None admin] RBAC: Adding query filter params (interface=public, service_id=7a06bd35b37046aea39f2e3631a838ad, region_id=RegionOne) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:10.366956 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48c7db-5c10-449c-95cb-913202d94423 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:10.368319 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48c7db-5c10-449c-95cb-913202d94423 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:10.373478 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 525/1033] 10.222.0.76 () {56 vars in 1251 bytes} [Thu May 12 17:30:10 2022] GET /identity/v3/endpoints?service_id=7a06bd35b37046aea39f2e3631a838ad&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:10.378702 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48c7db-5c10-449c-95cb-913202d94423 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:10.441936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576a8de-9a7d-4005-907c-e394fdbd1dc8 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:10.474938 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09e688-6cdd-4603-b091-23adfccc75d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:10.475603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e688-6cdd-4603-b091-23adfccc75d1 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:10.475881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e688-6cdd-4603-b091-23adfccc75d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:10.476225 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e688-6cdd-4603-b091-23adfccc75d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:10.476891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09e688-6cdd-4603-b091-23adfccc75d1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:10.477191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09e688-6cdd-4603-b091-23adfccc75d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:10.478562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09e688-6cdd-4603-b091-23adfccc75d1 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:10.479053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48c7db-5c10-449c-95cb-913202d94423 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:10.486873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 509/1034] 10.222.0.76 () {56 vars in 1115 bytes} [Thu May 12 17:30:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:10.492303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09e688-6cdd-4603-b091-23adfccc75d1 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:10.513402 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a42c9-3772-4e84-a138-8eb4f83d1a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:10.514067 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a42c9-3772-4e84-a138-8eb4f83d1a7c None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:10.514346 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a42c9-3772-4e84-a138-8eb4f83d1a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:10.514615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a42c9-3772-4e84-a138-8eb4f83d1a7c None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:10.515321 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a42c9-3772-4e84-a138-8eb4f83d1a7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:10.517233 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a42c9-3772-4e84-a138-8eb4f83d1a7c None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:10.523781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 526/1035] 10.222.0.76 () {56 vars in 1087 bytes} [Thu May 12 17:30:10 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:30:10.600538 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09e688-6cdd-4603-b091-23adfccc75d1 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:10.636215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330884c-5394-4766-8ccf-b1af9a698f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:10.637020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330884c-5394-4766-8ccf-b1af9a698f9b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:10.637300 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330884c-5394-4766-8ccf-b1af9a698f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:10.637574 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330884c-5394-4766-8ccf-b1af9a698f9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:10.649552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330884c-5394-4766-8ccf-b1af9a698f9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:10.651064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330884c-5394-4766-8ccf-b1af9a698f9b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-a330884c-5394-4766-8ccf-b1af9a698f9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:30:10.669530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:10.670528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:10.671497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:30:10.671497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:30:10.671497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:10.671497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:10.671497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 510/1036] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:30:10.679475 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a42c9-3772-4e84-a138-8eb4f83d1a7c None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:10.782883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a42c9-3772-4e84-a138-8eb4f83d1a7c None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:10.815100 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783fdfa-6cd2-43bd-9ecf-f016427f8bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:10.815768 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783fdfa-6cd2-43bd-9ecf-f016427f8bed None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:10.816045 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783fdfa-6cd2-43bd-9ecf-f016427f8bed None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:10.816318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783fdfa-6cd2-43bd-9ecf-f016427f8bed None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:10.817042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783fdfa-6cd2-43bd-9ecf-f016427f8bed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:10.817346 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783fdfa-6cd2-43bd-9ecf-f016427f8bed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:10.818735 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783fdfa-6cd2-43bd-9ecf-f016427f8bed None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:10.831277 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 527/1037] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:10.836787 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330884c-5394-4766-8ccf-b1af9a698f9b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:10.934217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330884c-5394-4766-8ccf-b1af9a698f9b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:10.966230 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0ede1-998d-489c-8f20-e90f6d3762a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:10.967044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0ede1-998d-489c-8f20-e90f6d3762a8 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:10.967327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0ede1-998d-489c-8f20-e90f6d3762a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:10.967599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0ede1-998d-489c-8f20-e90f6d3762a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:10.975046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0ede1-998d-489c-8f20-e90f6d3762a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:10.976475 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0ede1-998d-489c-8f20-e90f6d3762a8 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-29a0ede1-998d-489c-8f20-e90f6d3762a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:30:10.990427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:10.991570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:10.992543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:10.992543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:10.992543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:30:10.992543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:30:10.992543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:30:10.992543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:30:10.992543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:30:10.992543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:30:10.992543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 17:30:10.992543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:10.994751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 511/1038] 10.222.0.76 () {56 vars in 1093 bytes} [Thu May 12 17:30:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:10.997606 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783fdfa-6cd2-43bd-9ecf-f016427f8bed None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:11.094055 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783fdfa-6cd2-43bd-9ecf-f016427f8bed None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:11.128080 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2a34c-c150-4720-8a68-4e8949635dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:11.128747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a34c-c150-4720-8a68-4e8949635dea None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:11.129026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a34c-c150-4720-8a68-4e8949635dea None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:11.129299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a34c-c150-4720-8a68-4e8949635dea None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:11.130132 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2a34c-c150-4720-8a68-4e8949635dea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:11.130436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2a34c-c150-4720-8a68-4e8949635dea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:11.131906 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2a34c-c150-4720-8a68-4e8949635dea None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:11.154141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 528/1039] 10.222.0.76 () {56 vars in 1133 bytes} [Thu May 12 17:30:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:11.155708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0ede1-998d-489c-8f20-e90f6d3762a8 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:11.255936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0ede1-998d-489c-8f20-e90f6d3762a8 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:11.290945 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01438187-2cd0-4fd2-868d-e8c9d43cd180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:11.291609 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01438187-2cd0-4fd2-868d-e8c9d43cd180 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:11.291890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01438187-2cd0-4fd2-868d-e8c9d43cd180 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:11.292162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01438187-2cd0-4fd2-868d-e8c9d43cd180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:11.357346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01438187-2cd0-4fd2-868d-e8c9d43cd180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:11.358817 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01438187-2cd0-4fd2-868d-e8c9d43cd180 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:11.457894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 512/1040] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:30:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:30:11.459547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2a34c-c150-4720-8a68-4e8949635dea None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:11.561650 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2a34c-c150-4720-8a68-4e8949635dea None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:11.593796 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e3f54-5b5f-49c9-aa78-98a6bf360b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:11.595226 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e3f54-5b5f-49c9-aa78-98a6bf360b3e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:11.595508 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e3f54-5b5f-49c9-aa78-98a6bf360b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:11.595782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e3f54-5b5f-49c9-aa78-98a6bf360b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:11.605587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e3f54-5b5f-49c9-aa78-98a6bf360b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:11.607056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e3f54-5b5f-49c9-aa78-98a6bf360b3e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-fe5e3f54-5b5f-49c9-aa78-98a6bf360b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:30:11.624288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:11.625213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:11.626195 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:30:11.626195 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:30:11.626195 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:11.626195 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:11.630372 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 529/1041] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:11.631766 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01438187-2cd0-4fd2-868d-e8c9d43cd180 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:11.730403 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01438187-2cd0-4fd2-868d-e8c9d43cd180 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:11.763143 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477d130-a1e9-4f54-bbbd-edeb7e031d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:11.763807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477d130-a1e9-4f54-bbbd-edeb7e031d3f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:11.764087 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477d130-a1e9-4f54-bbbd-edeb7e031d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:11.764358 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477d130-a1e9-4f54-bbbd-edeb7e031d3f None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:11.765072 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477d130-a1e9-4f54-bbbd-edeb7e031d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:11.765373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477d130-a1e9-4f54-bbbd-edeb7e031d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:11.767342 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477d130-a1e9-4f54-bbbd-edeb7e031d3f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:11.784279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 513/1042] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:11.785920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e3f54-5b5f-49c9-aa78-98a6bf360b3e None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:11.881376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e3f54-5b5f-49c9-aa78-98a6bf360b3e None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:11.915586 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7b533-5783-4c21-b5e5-a0ca9ad84658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:11.916373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7b533-5783-4c21-b5e5-a0ca9ad84658 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:11.916650 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7b533-5783-4c21-b5e5-a0ca9ad84658 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:11.916920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7b533-5783-4c21-b5e5-a0ca9ad84658 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:11.923423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7b533-5783-4c21-b5e5-a0ca9ad84658 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:11.924885 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7b533-5783-4c21-b5e5-a0ca9ad84658 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-dfc7b533-5783-4c21-b5e5-a0ca9ad84658 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:30:11.938096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:11.939234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:11.940150 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:30:11.940150 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:30:11.940150 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:30:11.940150 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:30:11.940150 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:30:11.940150 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:30:11.940150 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:30:11.940150 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:11.942989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 530/1043] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:30:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:11.945440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477d130-a1e9-4f54-bbbd-edeb7e031d3f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:12.042968 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477d130-a1e9-4f54-bbbd-edeb7e031d3f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:12.075125 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d810a3c-9a70-4122-80a7-6d476c0fc586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:12.075775 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d810a3c-9a70-4122-80a7-6d476c0fc586 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:12.076053 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d810a3c-9a70-4122-80a7-6d476c0fc586 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:12.076323 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d810a3c-9a70-4122-80a7-6d476c0fc586 None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:12.077100 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d810a3c-9a70-4122-80a7-6d476c0fc586 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:12.077402 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d810a3c-9a70-4122-80a7-6d476c0fc586 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:12.078916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d810a3c-9a70-4122-80a7-6d476c0fc586 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:12.096108 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 514/1044] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:30:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:12.097639 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7b533-5783-4c21-b5e5-a0ca9ad84658 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:12.198945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7b533-5783-4c21-b5e5-a0ca9ad84658 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:12.231794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbd1a5-a1ba-4b51-a252-22479ae613e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:12.232460 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbd1a5-a1ba-4b51-a252-22479ae613e1 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:12.232741 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbd1a5-a1ba-4b51-a252-22479ae613e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:12.233014 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbd1a5-a1ba-4b51-a252-22479ae613e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:12.236607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbd1a5-a1ba-4b51-a252-22479ae613e1 None admin] RBAC: Adding query filter params (role.id=50b2b4554d83430cabf65ad4a394d646, scope.project.id=745af7d676704a179668d6685724ed78, user.id=04ad234318ad47589b844351cd3bb3e3) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:12.236607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbd1a5-a1ba-4b51-a252-22479ae613e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:12.236607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbd1a5-a1ba-4b51-a252-22479ae613e1 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:12.251303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 531/1045] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:30:12 2022] GET /identity/v3/role_assignments?user.id=04ad234318ad47589b844351cd3bb3e3&scope.project.id=745af7d676704a179668d6685724ed78&role.id=50b2b4554d83430cabf65ad4a394d646 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:12.314599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8cf11-fb17-4666-b454-9267b76f8450 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:12.314957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8cf11-fb17-4666-b454-9267b76f8450 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:12.315189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8cf11-fb17-4666-b454-9267b76f8450 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:12.316758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 515/1046] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:12.322372 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe68d59-5df7-47fe-ae4f-8fd113cde74c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:12.322731 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe68d59-5df7-47fe-ae4f-8fd113cde74c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:12.322975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe68d59-5df7-47fe-ae4f-8fd113cde74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:12.340856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-9fe68d59-5df7-47fe-ae4f-8fd113cde74c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:12.342081 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9fe68d59-5df7-47fe-ae4f-8fd113cde74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:12.416650 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 532/1047] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:12.441339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8cf11-fb17-4666-b454-9267b76f8450 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:12.540216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8cf11-fb17-4666-b454-9267b76f8450 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:12.573562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584498e3-7223-47dc-9d34-d50eb3a26425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:12.574344 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584498e3-7223-47dc-9d34-d50eb3a26425 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:12.574622 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584498e3-7223-47dc-9d34-d50eb3a26425 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:12.574931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584498e3-7223-47dc-9d34-d50eb3a26425 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:12.584882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584498e3-7223-47dc-9d34-d50eb3a26425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-584498e3-7223-47dc-9d34-d50eb3a26425 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:30:12.592440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:12.593357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:12.594243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:12.594243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:12.594243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:12.594243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:12.594243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:30:12.594243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:30:12.594243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:30:12.594243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:30:12.594243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:30:12.594243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:30:12.594243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:30:12.594243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:12.594243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 516/1048] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:30:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:12.601160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe68d59-5df7-47fe-ae4f-8fd113cde74c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:12.702091 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe68d59-5df7-47fe-ae4f-8fd113cde74c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:12.736936 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b65f8-5e03-4d3e-af13-296c47d5f86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:12.737603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b65f8-5e03-4d3e-af13-296c47d5f86f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:12.737882 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b65f8-5e03-4d3e-af13-296c47d5f86f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:12.738155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b65f8-5e03-4d3e-af13-296c47d5f86f None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:12.738926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b65f8-5e03-4d3e-af13-296c47d5f86f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:12.739231 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b65f8-5e03-4d3e-af13-296c47d5f86f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:12.740629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b65f8-5e03-4d3e-af13-296c47d5f86f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:12.749340 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 533/1049] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:30:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:12.755322 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584498e3-7223-47dc-9d34-d50eb3a26425 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:12.844289 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ac4f6-198c-4a43-880a-4cfd4bc411e4 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:12.845386 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ac4f6-198c-4a43-880a-4cfd4bc411e4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:12.845386 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ac4f6-198c-4a43-880a-4cfd4bc411e4 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:12.846881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 534/1050] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:12.851798 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591c4fd-a6be-4b8b-bd91-6f672205f1a5 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:12.852083 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591c4fd-a6be-4b8b-bd91-6f672205f1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:12.852361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591c4fd-a6be-4b8b-bd91-6f672205f1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:12.858616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584498e3-7223-47dc-9d34-d50eb3a26425 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:12.869093 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-8591c4fd-a6be-4b8b-bd91-6f672205f1a5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:12.870280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8591c4fd-a6be-4b8b-bd91-6f672205f1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:12.893516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518e30d-6011-4974-9812-91bc6b5116e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:12.894425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518e30d-6011-4974-9812-91bc6b5116e8 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:12.894728 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518e30d-6011-4974-9812-91bc6b5116e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:12.895003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518e30d-6011-4974-9812-91bc6b5116e8 None admin] PATH_INFO: `/v3/users/cf86764c54ff4d9b99631a2382cf753e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:12.909467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518e30d-6011-4974-9812-91bc6b5116e8 None admin] RBAC: Authorizing `identity:get_user(user_id=cf86764c54ff4d9b99631a2382cf753e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:12.910927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518e30d-6011-4974-9812-91bc6b5116e8 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:12.912635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 517/1051] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:30:12 2022] GET /identity/v3/users/cf86764c54ff4d9b99631a2382cf753e => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:12.918226 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518e30d-6011-4974-9812-91bc6b5116e8 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:12.937892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 535/1052] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:30:12.961056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591c4fd-a6be-4b8b-bd91-6f672205f1a5 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:13.020865 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518e30d-6011-4974-9812-91bc6b5116e8 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:13.054524 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a36fa-2e99-48c8-8316-b275e6f237a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:13.055212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a36fa-2e99-48c8-8316-b275e6f237a3 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:13.055551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a36fa-2e99-48c8-8316-b275e6f237a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:13.055829 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a36fa-2e99-48c8-8316-b275e6f237a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:13.059193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591c4fd-a6be-4b8b-bd91-6f672205f1a5 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:13.093580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c3c03-2d05-47c7-920d-7a48ea98bad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:13.094432 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3c03-2d05-47c7-920d-7a48ea98bad7 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:13.095248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3c03-2d05-47c7-920d-7a48ea98bad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:13.095527 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3c03-2d05-47c7-920d-7a48ea98bad7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:13.096178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c3c03-2d05-47c7-920d-7a48ea98bad7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:13.097558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c3c03-2d05-47c7-920d-7a48ea98bad7 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-c39c3c03-2d05-47c7-920d-7a48ea98bad7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:13.109156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:13.110389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:13.111285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 536/1053] 10.222.0.76 () {56 vars in 1105 bytes} [Thu May 12 17:30:12 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:30:13.116527 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c3c03-2d05-47c7-920d-7a48ea98bad7 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:13.125016 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a36fa-2e99-48c8-8316-b275e6f237a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:13.126510 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a36fa-2e99-48c8-8316-b275e6f237a3 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:13.215124 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c3c03-2d05-47c7-920d-7a48ea98bad7 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:13.232468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 518/1054] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:30:12 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:30:13.233344 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a36fa-2e99-48c8-8316-b275e6f237a3 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:13.250464 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd12e8-8ecd-4d78-aec7-93828ae03476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:13.251198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd12e8-8ecd-4d78-aec7-93828ae03476 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:13.251472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd12e8-8ecd-4d78-aec7-93828ae03476 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:13.251740 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd12e8-8ecd-4d78-aec7-93828ae03476 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:13.252436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd12e8-8ecd-4d78-aec7-93828ae03476 None admin] RBAC: Adding query filter params (name=image) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:13.252737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd12e8-8ecd-4d78-aec7-93828ae03476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:13.254121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd12e8-8ecd-4d78-aec7-93828ae03476 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:13.260129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 537/1055] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:13.265713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd12e8-8ecd-4d78-aec7-93828ae03476 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:13.332276 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a36fa-2e99-48c8-8316-b275e6f237a3 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:13.368366 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bc05d-b1e7-4cff-a90e-e2193fff9a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:13.369154 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bc05d-b1e7-4cff-a90e-e2193fff9a59 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:13.369436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bc05d-b1e7-4cff-a90e-e2193fff9a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:13.369710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bc05d-b1e7-4cff-a90e-e2193fff9a59 None admin] PATH_INFO: `/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:13.370989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bc05d-b1e7-4cff-a90e-e2193fff9a59 None admin] RBAC: Authorizing `identity:get_project(project_id=d2eb0f585e9c4c61ba8d4091e266a2e3)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:13.371670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd12e8-8ecd-4d78-aec7-93828ae03476 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:13.372445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bc05d-b1e7-4cff-a90e-e2193fff9a59 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:13.374190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 519/1056] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:30:13 2022] GET /identity/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:13.380295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bc05d-b1e7-4cff-a90e-e2193fff9a59 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:13.406615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d6249-9f90-4b2f-88b2-dcdd6bd756cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:13.407990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6249-9f90-4b2f-88b2-dcdd6bd756cb None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:13.408267 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6249-9f90-4b2f-88b2-dcdd6bd756cb None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:13.408541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6249-9f90-4b2f-88b2-dcdd6bd756cb None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:13.409241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d6249-9f90-4b2f-88b2-dcdd6bd756cb None admin] RBAC: Adding query filter params (type=image) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:13.409543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d6249-9f90-4b2f-88b2-dcdd6bd756cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:13.410926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d6249-9f90-4b2f-88b2-dcdd6bd756cb None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:13.420498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 538/1057] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:13.421278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d6249-9f90-4b2f-88b2-dcdd6bd756cb None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:13.482033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bc05d-b1e7-4cff-a90e-e2193fff9a59 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:13.515989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eb4da-7fb7-4e72-a6f4-7ec922157be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:13.517232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eb4da-7fb7-4e72-a6f4-7ec922157be8 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:13.517511 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eb4da-7fb7-4e72-a6f4-7ec922157be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:13.517784 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eb4da-7fb7-4e72-a6f4-7ec922157be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:13.518603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eb4da-7fb7-4e72-a6f4-7ec922157be8 None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=d2eb0f585e9c4c61ba8d4091e266a2e3, user.id=cf86764c54ff4d9b99631a2382cf753e) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:13.518940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eb4da-7fb7-4e72-a6f4-7ec922157be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:13.520207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d6249-9f90-4b2f-88b2-dcdd6bd756cb None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:13.520433 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eb4da-7fb7-4e72-a6f4-7ec922157be8 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:13.526088 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 520/1058] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:30:13 2022] GET /identity/v3/role_assignments?user.id=cf86764c54ff4d9b99631a2382cf753e&scope.project.id=d2eb0f585e9c4c61ba8d4091e266a2e3&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:13.566240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e938f-1614-427c-aa35-2660aa21b33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:13.566957 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e938f-1614-427c-aa35-2660aa21b33f None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:13.567239 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e938f-1614-427c-aa35-2660aa21b33f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:13.567515 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e938f-1614-427c-aa35-2660aa21b33f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:13.568277 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e938f-1614-427c-aa35-2660aa21b33f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:13.569756 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e938f-1614-427c-aa35-2660aa21b33f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:13.590491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 539/1059] 10.222.0.76 () {60 vars in 1144 bytes} [Thu May 12 17:30:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:30:14.488870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29cc8e-8ced-41c7-8a06-95cc6ea15efb None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:14.489399 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29cc8e-8ced-41c7-8a06-95cc6ea15efb None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:14.489399 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29cc8e-8ced-41c7-8a06-95cc6ea15efb None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:14.490702 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 521/1060] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:14.496068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff5c43-c9f1-4d36-90f3-0bc14df953e4 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:14.496485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff5c43-c9f1-4d36-90f3-0bc14df953e4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:14.496652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff5c43-c9f1-4d36-90f3-0bc14df953e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:14.513731 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-e1ff5c43-c9f1-4d36-90f3-0bc14df953e4 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:14.514956 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e1ff5c43-c9f1-4d36-90f3-0bc14df953e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:14.586700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 540/1061] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:14.606041 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29cc8e-8ced-41c7-8a06-95cc6ea15efb None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:14.706863 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29cc8e-8ced-41c7-8a06-95cc6ea15efb None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:14.740409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fef71-00ad-4d06-bbb9-52d56fc40daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:14.741576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fef71-00ad-4d06-bbb9-52d56fc40daf None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:14.742062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fef71-00ad-4d06-bbb9-52d56fc40daf None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:14.742537 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fef71-00ad-4d06-bbb9-52d56fc40daf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:14.755404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fef71-00ad-4d06-bbb9-52d56fc40daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-589fef71-00ad-4d06-bbb9-52d56fc40daf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:30:14.769853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:14.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:14.773612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:14.773612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:14.773612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:14.773612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:14.773612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:30:14.773612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:30:14.773612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:30:14.773612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:30:14.773612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:30:14.773612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:30:14.773612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 17:30:14.773612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:14.773612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 522/1062] 10.222.0.76 () {56 vars in 1120 bytes} [Thu May 12 17:30:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:14.777919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff5c43-c9f1-4d36-90f3-0bc14df953e4 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:14.875506 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff5c43-c9f1-4d36-90f3-0bc14df953e4 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:14.909068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed0f0f-41c9-4949-b3cd-76552a5b7199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:14.909833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed0f0f-41c9-4949-b3cd-76552a5b7199 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:14.910117 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed0f0f-41c9-4949-b3cd-76552a5b7199 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:14.910390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed0f0f-41c9-4949-b3cd-76552a5b7199 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:14.911158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed0f0f-41c9-4949-b3cd-76552a5b7199 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:14.911463 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed0f0f-41c9-4949-b3cd-76552a5b7199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:14.912824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed0f0f-41c9-4949-b3cd-76552a5b7199 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:14.920821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 541/1063] 10.222.0.76 () {56 vars in 1115 bytes} [Thu May 12 17:30:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:14.926959 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fef71-00ad-4d06-bbb9-52d56fc40daf None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:15.031029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fef71-00ad-4d06-bbb9-52d56fc40daf None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:15.062222 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67088d84-db63-4d30-8f7a-2e9ee24aaf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:15.063022 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67088d84-db63-4d30-8f7a-2e9ee24aaf88 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:15.063941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67088d84-db63-4d30-8f7a-2e9ee24aaf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:15.064593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67088d84-db63-4d30-8f7a-2e9ee24aaf88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:15.074559 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67088d84-db63-4d30-8f7a-2e9ee24aaf88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:15.076011 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67088d84-db63-4d30-8f7a-2e9ee24aaf88 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-67088d84-db63-4d30-8f7a-2e9ee24aaf88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:30:15.093557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:15.094592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:15.095615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:30:15.095615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:30:15.095615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:15.095615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:15.099031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 523/1064] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:15.101088 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed0f0f-41c9-4949-b3cd-76552a5b7199 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:15.200535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed0f0f-41c9-4949-b3cd-76552a5b7199 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:15.232850 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b2dac-8292-41af-939e-750b55440c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:15.233509 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b2dac-8292-41af-939e-750b55440c51 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:15.233788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b2dac-8292-41af-939e-750b55440c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:15.234062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b2dac-8292-41af-939e-750b55440c51 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:15.234804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b2dac-8292-41af-939e-750b55440c51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:15.235672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b2dac-8292-41af-939e-750b55440c51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:15.237075 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b2dac-8292-41af-939e-750b55440c51 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:15.252918 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 542/1065] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:15.258382 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67088d84-db63-4d30-8f7a-2e9ee24aaf88 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:15.359295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67088d84-db63-4d30-8f7a-2e9ee24aaf88 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:15.393637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323585f-cff2-494e-ba45-bd67ed52ee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:15.394429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323585f-cff2-494e-ba45-bd67ed52ee83 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:15.394731 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323585f-cff2-494e-ba45-bd67ed52ee83 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:15.395011 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323585f-cff2-494e-ba45-bd67ed52ee83 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:15.403655 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323585f-cff2-494e-ba45-bd67ed52ee83 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:15.405116 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323585f-cff2-494e-ba45-bd67ed52ee83 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-3323585f-cff2-494e-ba45-bd67ed52ee83 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:30:15.419986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:15.420972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:15.421975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:15.421975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:15.421975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:30:15.421975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:30:15.421975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:30:15.421975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:30:15.421975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:30:15.421975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:30:15.421975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 17:30:15.421975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:15.423294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 524/1066] 10.222.0.76 () {56 vars in 1093 bytes} [Thu May 12 17:30:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:15.428015 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b2dac-8292-41af-939e-750b55440c51 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:15.524757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b2dac-8292-41af-939e-750b55440c51 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:15.558168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eada13b-1457-49e2-b973-e21b7cc53e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:15.558860 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eada13b-1457-49e2-b973-e21b7cc53e47 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:15.559142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eada13b-1457-49e2-b973-e21b7cc53e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:15.559412 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eada13b-1457-49e2-b973-e21b7cc53e47 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:15.560241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eada13b-1457-49e2-b973-e21b7cc53e47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:15.560549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eada13b-1457-49e2-b973-e21b7cc53e47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:15.561976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eada13b-1457-49e2-b973-e21b7cc53e47 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:15.583497 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 543/1067] 10.222.0.76 () {56 vars in 1133 bytes} [Thu May 12 17:30:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:15.585184 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323585f-cff2-494e-ba45-bd67ed52ee83 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:15.687550 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323585f-cff2-494e-ba45-bd67ed52ee83 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:15.723175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161189-41f8-4bc8-8e68-de141af0c07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:15.723982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161189-41f8-4bc8-8e68-de141af0c07b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:15.724259 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161189-41f8-4bc8-8e68-de141af0c07b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:15.724531 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161189-41f8-4bc8-8e68-de141af0c07b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:15.736547 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59161189-41f8-4bc8-8e68-de141af0c07b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:15.738020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59161189-41f8-4bc8-8e68-de141af0c07b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-59161189-41f8-4bc8-8e68-de141af0c07b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:30:15.756217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:15.757178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:15.763193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:30:15.763193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:30:15.763193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:15.763193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:15.763193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 525/1068] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:15.764997 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eada13b-1457-49e2-b973-e21b7cc53e47 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:15.803241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c4ee7-bd23-43b4-827c-ab15737e5c8f None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:15.803597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c4ee7-bd23-43b4-827c-ab15737e5c8f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:15.803781 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c4ee7-bd23-43b4-827c-ab15737e5c8f None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:15.805325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 526/1069] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:30:15.810071 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ec96a-e896-4ddb-aa9b-182df1499e71 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:15.810361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ec96a-e896-4ddb-aa9b-182df1499e71 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:15.810639 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ec96a-e896-4ddb-aa9b-182df1499e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:15.829749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-a56ec96a-e896-4ddb-aa9b-182df1499e71 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:15.831179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a56ec96a-e896-4ddb-aa9b-182df1499e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:15.873956 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eada13b-1457-49e2-b973-e21b7cc53e47 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:15.899605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 527/1070] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:30:15.908670 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d159fe3-424c-4d83-bf28-52635f3f3585 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:15.909161 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d159fe3-424c-4d83-bf28-52635f3f3585 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:15.909499 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d159fe3-424c-4d83-bf28-52635f3f3585 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:15.910981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 528/1071] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:30:15.913630 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d1c85-975c-412a-8814-e512cb3354e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:15.914289 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d1c85-975c-412a-8814-e512cb3354e2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:15.914568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d1c85-975c-412a-8814-e512cb3354e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:15.914879 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d1c85-975c-412a-8814-e512cb3354e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:15.915600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d1c85-975c-412a-8814-e512cb3354e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:15.915903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d1c85-975c-412a-8814-e512cb3354e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:15.916328 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60863868-11c0-47d8-ab88-f268f0ea5059 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:15.916615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60863868-11c0-47d8-ab88-f268f0ea5059 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:15.916891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60863868-11c0-47d8-ab88-f268f0ea5059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:15.917273 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d1c85-975c-412a-8814-e512cb3354e2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:15.933200 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 544/1072] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:15.933200 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d1c85-975c-412a-8814-e512cb3354e2 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:15.934493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-60863868-11c0-47d8-ab88-f268f0ea5059 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:15.935730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-60863868-11c0-47d8-ab88-f268f0ea5059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:16.001630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 529/1073] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:16.002376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60863868-11c0-47d8-ab88-f268f0ea5059 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:16.028491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d1c85-975c-412a-8814-e512cb3354e2 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:16.059966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d91cc-68f8-42a1-9d7a-464927728fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:16.060744 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d91cc-68f8-42a1-9d7a-464927728fec None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:16.061024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d91cc-68f8-42a1-9d7a-464927728fec None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:16.061298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d91cc-68f8-42a1-9d7a-464927728fec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:16.071741 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d91cc-68f8-42a1-9d7a-464927728fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-935d91cc-68f8-42a1-9d7a-464927728fec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:30:16.079847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:16.080931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:16.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:16.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:16.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:16.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:16.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:30:16.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:30:16.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:30:16.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:30:16.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:30:16.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:30:16.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:30:16.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:16.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 545/1074] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:30:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:16.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d91cc-68f8-42a1-9d7a-464927728fec None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:16.097017 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60863868-11c0-47d8-ab88-f268f0ea5059 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:16.130308 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d754b-966e-4f59-b8ad-a142245180c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:16.131118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d754b-966e-4f59-b8ad-a142245180c0 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:16.131402 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d754b-966e-4f59-b8ad-a142245180c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:16.131671 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d754b-966e-4f59-b8ad-a142245180c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:16.138493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d754b-966e-4f59-b8ad-a142245180c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:16.139974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d754b-966e-4f59-b8ad-a142245180c0 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-df3d754b-966e-4f59-b8ad-a142245180c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:30:16.153335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:16.154391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:16.155461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:30:16.155461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:30:16.155461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:30:16.155461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:30:16.155461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:30:16.155461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:30:16.155461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:30:16.155461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:16.155461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 530/1075] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:30:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:16.155461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d754b-966e-4f59-b8ad-a142245180c0 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:16.182343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d91cc-68f8-42a1-9d7a-464927728fec None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:16.215105 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b6239-9184-4d47-9a45-371a8013120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:16.215750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b6239-9184-4d47-9a45-371a8013120f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:16.216033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b6239-9184-4d47-9a45-371a8013120f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:16.216310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b6239-9184-4d47-9a45-371a8013120f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:16.251409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d754b-966e-4f59-b8ad-a142245180c0 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:16.283043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b6239-9184-4d47-9a45-371a8013120f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:16.283329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20780bbb-d96e-452f-afd1-7b7b45c78d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:16.283993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20780bbb-d96e-452f-afd1-7b7b45c78d10 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:16.284274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20780bbb-d96e-452f-afd1-7b7b45c78d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:16.284427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b6239-9184-4d47-9a45-371a8013120f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:16.284538 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20780bbb-d96e-452f-afd1-7b7b45c78d10 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:16.285280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20780bbb-d96e-452f-afd1-7b7b45c78d10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:16.285586 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20780bbb-d96e-452f-afd1-7b7b45c78d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:16.287662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20780bbb-d96e-452f-afd1-7b7b45c78d10 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:16.295406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 531/1076] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:30:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:16.296211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20780bbb-d96e-452f-afd1-7b7b45c78d10 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:16.381467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 546/1077] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:30:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:30:16.382292 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b6239-9184-4d47-9a45-371a8013120f None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:16.391075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20780bbb-d96e-452f-afd1-7b7b45c78d10 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:16.424169 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70684a4-0c1b-4727-8383-35eb6f931c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:16.424925 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70684a4-0c1b-4727-8383-35eb6f931c3b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:16.425208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70684a4-0c1b-4727-8383-35eb6f931c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:16.425477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70684a4-0c1b-4727-8383-35eb6f931c3b None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:16.426259 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70684a4-0c1b-4727-8383-35eb6f931c3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:16.426563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70684a4-0c1b-4727-8383-35eb6f931c3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:16.428018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70684a4-0c1b-4727-8383-35eb6f931c3b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:16.439666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 532/1078] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:30:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:16.440448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70684a4-0c1b-4727-8383-35eb6f931c3b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:16.482330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b6239-9184-4d47-9a45-371a8013120f None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:16.514645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92467a2-79b2-42c4-a4ad-851b096f6cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:16.515526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92467a2-79b2-42c4-a4ad-851b096f6cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:16.515809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92467a2-79b2-42c4-a4ad-851b096f6cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:16.516073 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92467a2-79b2-42c4-a4ad-851b096f6cc2 None admin] PATH_INFO: `/v3/users/cf86764c54ff4d9b99631a2382cf753e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:16.517869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92467a2-79b2-42c4-a4ad-851b096f6cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=cf86764c54ff4d9b99631a2382cf753e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:16.519327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92467a2-79b2-42c4-a4ad-851b096f6cc2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:16.520948 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 547/1079] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:30:16 2022] GET /identity/v3/users/cf86764c54ff4d9b99631a2382cf753e => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:16.521666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92467a2-79b2-42c4-a4ad-851b096f6cc2 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:16.537541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70684a4-0c1b-4727-8383-35eb6f931c3b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:16.570025 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b6a41-1e52-415c-8346-de7422dc3b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:16.570832 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b6a41-1e52-415c-8346-de7422dc3b21 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:16.571111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b6a41-1e52-415c-8346-de7422dc3b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:16.571383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b6a41-1e52-415c-8346-de7422dc3b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:16.581617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b6a41-1e52-415c-8346-de7422dc3b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:16.583077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b6a41-1e52-415c-8346-de7422dc3b21 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-dc1b6a41-1e52-415c-8346-de7422dc3b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:30:16.599920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:16.601467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:16.602461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:30:16.602461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:30:16.602461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:16.602461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:16.602461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 533/1080] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:16.602461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b6a41-1e52-415c-8346-de7422dc3b21 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:16.617558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92467a2-79b2-42c4-a4ad-851b096f6cc2 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:16.650810 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55fa94-1526-4fa8-ae18-5dcb070c88d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:16.651677 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55fa94-1526-4fa8-ae18-5dcb070c88d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:16.651955 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55fa94-1526-4fa8-ae18-5dcb070c88d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:16.652224 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55fa94-1526-4fa8-ae18-5dcb070c88d6 None admin] PATH_INFO: `/v3/projects/745af7d676704a179668d6685724ed78/users/04ad234318ad47589b844351cd3bb3e3/roles/50b2b4554d83430cabf65ad4a394d646` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:16.654413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55fa94-1526-4fa8-ae18-5dcb070c88d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=745af7d676704a179668d6685724ed78, user_id=04ad234318ad47589b844351cd3bb3e3, role_id=50b2b4554d83430cabf65ad4a394d646)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:16.655875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55fa94-1526-4fa8-ae18-5dcb070c88d6 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:16.669705 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 548/1081] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:30:16 2022] PUT /identity/v3/projects/745af7d676704a179668d6685724ed78/users/04ad234318ad47589b844351cd3bb3e3/roles/50b2b4554d83430cabf65ad4a394d646 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:30:16.670487 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55fa94-1526-4fa8-ae18-5dcb070c88d6 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:16.701395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b6a41-1e52-415c-8346-de7422dc3b21 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:16.738160 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d103a-bd08-4edc-87f6-ab74d2c76cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:16.739076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d103a-bd08-4edc-87f6-ab74d2c76cdd None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:16.739359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d103a-bd08-4edc-87f6-ab74d2c76cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:16.739635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d103a-bd08-4edc-87f6-ab74d2c76cdd None admin] PATH_INFO: `/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:16.740888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d103a-bd08-4edc-87f6-ab74d2c76cdd None admin] RBAC: Authorizing `identity:get_project(project_id=d2eb0f585e9c4c61ba8d4091e266a2e3)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:16.742384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d103a-bd08-4edc-87f6-ab74d2c76cdd None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:16.744388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 534/1082] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:30:16 2022] GET /identity/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:16.750532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d103a-bd08-4edc-87f6-ab74d2c76cdd None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:16.778026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55fa94-1526-4fa8-ae18-5dcb070c88d6 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:16.815080 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afd816-2c1a-4d15-a8e0-953b6578d63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:16.815658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afd816-2c1a-4d15-a8e0-953b6578d63d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:16.815936 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afd816-2c1a-4d15-a8e0-953b6578d63d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:16.816208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afd816-2c1a-4d15-a8e0-953b6578d63d None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:16.816935 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afd816-2c1a-4d15-a8e0-953b6578d63d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:16.817238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afd816-2c1a-4d15-a8e0-953b6578d63d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:16.818635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afd816-2c1a-4d15-a8e0-953b6578d63d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:16.831233 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 549/1083] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:16.867192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d103a-bd08-4edc-87f6-ab74d2c76cdd None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:16.904841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c28f22-ccfd-4228-b35b-e181b4683171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:16.905745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c28f22-ccfd-4228-b35b-e181b4683171 None admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:16.906025 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c28f22-ccfd-4228-b35b-e181b4683171 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:16.906299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c28f22-ccfd-4228-b35b-e181b4683171 None admin] PATH_INFO: `/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3/users/cf86764c54ff4d9b99631a2382cf753e/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:16.908469 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c28f22-ccfd-4228-b35b-e181b4683171 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2eb0f585e9c4c61ba8d4091e266a2e3, user_id=cf86764c54ff4d9b99631a2382cf753e, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:16.909923 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c28f22-ccfd-4228-b35b-e181b4683171 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:16.926701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 535/1084] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:30:16 2022] PUT /identity/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3/users/cf86764c54ff4d9b99631a2382cf753e/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:30:18.936055 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2dc54-83af-43f0-a9a0-bb70e7be7ab3 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:18.936621 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2dc54-83af-43f0-a9a0-bb70e7be7ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:18.936621 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2dc54-83af-43f0-a9a0-bb70e7be7ab3 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:18.937957 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 550/1085] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:18.943734 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551014bb-9617-423e-9973-05c59079905b None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:18.944149 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551014bb-9617-423e-9973-05c59079905b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:18.944428 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551014bb-9617-423e-9973-05c59079905b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:18.961340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-551014bb-9617-423e-9973-05c59079905b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:18.962512 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-551014bb-9617-423e-9973-05c59079905b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:19.031287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 536/1086] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:30:19.055044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2dc54-83af-43f0-a9a0-bb70e7be7ab3 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:19.154613 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2dc54-83af-43f0-a9a0-bb70e7be7ab3 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:19.177843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcae9c-eb23-421f-9373-cfce8cc947cd None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:19.178131 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcae9c-eb23-421f-9373-cfce8cc947cd None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:19.178407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcae9c-eb23-421f-9373-cfce8cc947cd None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:19.179822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 537/1087] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:30:19.184616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388424f-501e-4df5-8421-46e151d9ab86 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:19.184905 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388424f-501e-4df5-8421-46e151d9ab86 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:19.185176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388424f-501e-4df5-8421-46e151d9ab86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:19.187804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c4b78-8105-4237-9749-52bc60d3f93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:19.188593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c4b78-8105-4237-9749-52bc60d3f93b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:19.188883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c4b78-8105-4237-9749-52bc60d3f93b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:19.189198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c4b78-8105-4237-9749-52bc60d3f93b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:19.199575 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c4b78-8105-4237-9749-52bc60d3f93b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:30:19.204593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-8388424f-501e-4df5-8421-46e151d9ab86 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:19.205778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-8388424f-501e-4df5-8421-46e151d9ab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-397c4b78-8105-4237-9749-52bc60d3f93b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:30:19.208209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:19.209330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:19.210219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:19.210219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:19.210219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:19.210219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:19.210219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:30:19.210219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:30:19.210219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:30:19.210219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:30:19.210219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:30:19.210219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:30:19.210219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 17:30:19.210219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:19.210219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 551/1088] 10.222.0.76 () {56 vars in 1120 bytes} [Thu May 12 17:30:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:19.215222 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c4b78-8105-4237-9749-52bc60d3f93b None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:19.272406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 538/1089] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:30:19.296475 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388424f-501e-4df5-8421-46e151d9ab86 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:19.311571 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c4b78-8105-4237-9749-52bc60d3f93b None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:19.344956 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b47e5-2ff3-4c28-8ca4-9ce006a3652f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:19.346088 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b47e5-2ff3-4c28-8ca4-9ce006a3652f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:19.346366 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b47e5-2ff3-4c28-8ca4-9ce006a3652f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:19.346637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b47e5-2ff3-4c28-8ca4-9ce006a3652f None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:19.347395 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b47e5-2ff3-4c28-8ca4-9ce006a3652f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:19.347697 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b47e5-2ff3-4c28-8ca4-9ce006a3652f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:19.349062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b47e5-2ff3-4c28-8ca4-9ce006a3652f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:19.356624 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 552/1090] 10.222.0.76 () {56 vars in 1115 bytes} [Thu May 12 17:30:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:19.362437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b47e5-2ff3-4c28-8ca4-9ce006a3652f None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:19.390682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388424f-501e-4df5-8421-46e151d9ab86 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:19.424094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e13ba-70e8-4282-ae1b-cef264cc5a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:19.424868 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e13ba-70e8-4282-ae1b-cef264cc5a27 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:19.425139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e13ba-70e8-4282-ae1b-cef264cc5a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:19.425401 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e13ba-70e8-4282-ae1b-cef264cc5a27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:19.434880 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e13ba-70e8-4282-ae1b-cef264cc5a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-8b8e13ba-70e8-4282-ae1b-cef264cc5a27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:30:19.442957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:19.444060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:19.445320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:19.445320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:19.445320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:19.445320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:19.445320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:30:19.445320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:30:19.445320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:30:19.445320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:30:19.445320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:30:19.445320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:30:19.445320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:30:19.445320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:19.445320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 539/1091] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:30:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:30:19.449829 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e13ba-70e8-4282-ae1b-cef264cc5a27 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:19.457000 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b47e5-2ff3-4c28-8ca4-9ce006a3652f None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:19.489317 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d28c88-50c9-4d10-b649-d76a196f5edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:19.490097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d28c88-50c9-4d10-b649-d76a196f5edf None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:19.490376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d28c88-50c9-4d10-b649-d76a196f5edf None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:19.490647 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d28c88-50c9-4d10-b649-d76a196f5edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:19.501336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d28c88-50c9-4d10-b649-d76a196f5edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:19.502817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d28c88-50c9-4d10-b649-d76a196f5edf None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-b7d28c88-50c9-4d10-b649-d76a196f5edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:30:19.519901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:19.520898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:19.522038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:30:19.522038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:30:19.522038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:19.522038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:19.522038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 553/1092] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:30:19.526732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d28c88-50c9-4d10-b649-d76a196f5edf None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:19.545423 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e13ba-70e8-4282-ae1b-cef264cc5a27 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:19.577326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254370ad-b225-40f0-9abd-e2163e9fd72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:19.577978 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254370ad-b225-40f0-9abd-e2163e9fd72a None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:19.578255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254370ad-b225-40f0-9abd-e2163e9fd72a None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:19.578523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254370ad-b225-40f0-9abd-e2163e9fd72a None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:19.580240 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254370ad-b225-40f0-9abd-e2163e9fd72a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:19.580543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254370ad-b225-40f0-9abd-e2163e9fd72a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:19.581887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254370ad-b225-40f0-9abd-e2163e9fd72a None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:19.589718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 540/1093] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:30:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:19.595780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254370ad-b225-40f0-9abd-e2163e9fd72a None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:19.620887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d28c88-50c9-4d10-b649-d76a196f5edf None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:19.654012 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa6174-1a9c-49ca-8923-4718a413efe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:19.654685 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa6174-1a9c-49ca-8923-4718a413efe3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:19.654988 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa6174-1a9c-49ca-8923-4718a413efe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:19.655261 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa6174-1a9c-49ca-8923-4718a413efe3 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:19.655973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa6174-1a9c-49ca-8923-4718a413efe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:19.656283 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa6174-1a9c-49ca-8923-4718a413efe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:19.657660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa6174-1a9c-49ca-8923-4718a413efe3 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:19.668925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 554/1094] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:19.674691 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa6174-1a9c-49ca-8923-4718a413efe3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:19.692348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254370ad-b225-40f0-9abd-e2163e9fd72a None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:19.724818 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a342d-db8e-44ce-b3f7-914d94970e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:19.725605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a342d-db8e-44ce-b3f7-914d94970e80 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:19.725887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a342d-db8e-44ce-b3f7-914d94970e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:19.726161 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a342d-db8e-44ce-b3f7-914d94970e80 None admin] PATH_INFO: `/v3/users/cf86764c54ff4d9b99631a2382cf753e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:19.727371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a342d-db8e-44ce-b3f7-914d94970e80 None admin] RBAC: Authorizing `identity:get_user(user_id=cf86764c54ff4d9b99631a2382cf753e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:19.728794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a342d-db8e-44ce-b3f7-914d94970e80 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:19.730435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 541/1095] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:30:19 2022] GET /identity/v3/users/cf86764c54ff4d9b99631a2382cf753e => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:19.736165 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a342d-db8e-44ce-b3f7-914d94970e80 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:19.772292 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa6174-1a9c-49ca-8923-4718a413efe3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:19.804029 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32507570-7367-451e-a801-db89a1b3dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:19.804798 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32507570-7367-451e-a801-db89a1b3dbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:19.805074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32507570-7367-451e-a801-db89a1b3dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:19.805341 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32507570-7367-451e-a801-db89a1b3dbb3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:19.812068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32507570-7367-451e-a801-db89a1b3dbb3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:19.814271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32507570-7367-451e-a801-db89a1b3dbb3 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-32507570-7367-451e-a801-db89a1b3dbb3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:30:19.828005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:19.829726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:19.830953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:19.830953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:19.830953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:30:19.830953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:30:19.830953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:30:19.830953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:30:19.830953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:30:19.830953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:30:19.830953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 17:30:19.830953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:19.830953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 555/1096] 10.222.0.76 () {56 vars in 1093 bytes} [Thu May 12 17:30:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:30:19.831673 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a342d-db8e-44ce-b3f7-914d94970e80 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:19.835573 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32507570-7367-451e-a801-db89a1b3dbb3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:19.864423 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4b69a-3f77-41b7-8526-0a97e17a86ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:19.865063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4b69a-3f77-41b7-8526-0a97e17a86ab None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:19.865334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4b69a-3f77-41b7-8526-0a97e17a86ab None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:19.865601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4b69a-3f77-41b7-8526-0a97e17a86ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:19.929294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4b69a-3f77-41b7-8526-0a97e17a86ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:19.929986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32507570-7367-451e-a801-db89a1b3dbb3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:19.930829 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4b69a-3f77-41b7-8526-0a97e17a86ab None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:19.962547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53559e51-7588-4fb1-9db2-fb8af6706e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:19.963247 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53559e51-7588-4fb1-9db2-fb8af6706e61 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:19.963526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53559e51-7588-4fb1-9db2-fb8af6706e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:19.963796 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53559e51-7588-4fb1-9db2-fb8af6706e61 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:19.964630 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53559e51-7588-4fb1-9db2-fb8af6706e61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:19.964934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53559e51-7588-4fb1-9db2-fb8af6706e61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:19.966365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53559e51-7588-4fb1-9db2-fb8af6706e61 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:19.983532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 556/1097] 10.222.0.76 () {56 vars in 1133 bytes} [Thu May 12 17:30:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:19.990020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53559e51-7588-4fb1-9db2-fb8af6706e61 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:20.026641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 542/1098] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:30:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 17:30:20.032511 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4b69a-3f77-41b7-8526-0a97e17a86ab None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:20.083468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53559e51-7588-4fb1-9db2-fb8af6706e61 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:20.116737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08270fb0-ca1c-4cd2-9a7d-0c13b0e468e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:20.117376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08270fb0-ca1c-4cd2-9a7d-0c13b0e468e3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:20.117661 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08270fb0-ca1c-4cd2-9a7d-0c13b0e468e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:20.117935 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08270fb0-ca1c-4cd2-9a7d-0c13b0e468e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:20.123756 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4b69a-3f77-41b7-8526-0a97e17a86ab None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:20.156588 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7837d2-dc77-4a5f-85f4-781b124b3d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:20.157519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7837d2-dc77-4a5f-85f4-781b124b3d9b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:20.157819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7837d2-dc77-4a5f-85f4-781b124b3d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:20.158092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7837d2-dc77-4a5f-85f4-781b124b3d9b None admin] PATH_INFO: `/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:20.159277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7837d2-dc77-4a5f-85f4-781b124b3d9b None admin] RBAC: Authorizing `identity:get_project(project_id=d2eb0f585e9c4c61ba8d4091e266a2e3)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:20.160710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7837d2-dc77-4a5f-85f4-781b124b3d9b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:20.162563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 543/1099] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:30:20 2022] GET /identity/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:20.168230 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7837d2-dc77-4a5f-85f4-781b124b3d9b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:20.181861 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08270fb0-ca1c-4cd2-9a7d-0c13b0e468e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:20.183342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08270fb0-ca1c-4cd2-9a7d-0c13b0e468e3 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:20.263152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7837d2-dc77-4a5f-85f4-781b124b3d9b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:20.284012 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 557/1100] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:30:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 17:30:20.289748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08270fb0-ca1c-4cd2-9a7d-0c13b0e468e3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:20.295515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2826f-5cb2-4c2f-8aa5-346de77837d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:20.296168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2826f-5cb2-4c2f-8aa5-346de77837d6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:20.296444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2826f-5cb2-4c2f-8aa5-346de77837d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:20.296713 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2826f-5cb2-4c2f-8aa5-346de77837d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:20.297557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2826f-5cb2-4c2f-8aa5-346de77837d6 None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=d2eb0f585e9c4c61ba8d4091e266a2e3, user.id=cf86764c54ff4d9b99631a2382cf753e) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:20.297853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2826f-5cb2-4c2f-8aa5-346de77837d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:20.299319 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2826f-5cb2-4c2f-8aa5-346de77837d6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:20.305022 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 544/1101] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:30:20 2022] GET /identity/v3/role_assignments?user.id=cf86764c54ff4d9b99631a2382cf753e&scope.project.id=d2eb0f585e9c4c61ba8d4091e266a2e3&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:20.390370 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08270fb0-ca1c-4cd2-9a7d-0c13b0e468e3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:20.425444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355e6b8-f300-470e-8ac3-25593c555472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:20.426239 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355e6b8-f300-470e-8ac3-25593c555472 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:20.426520 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355e6b8-f300-470e-8ac3-25593c555472 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:20.426825 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355e6b8-f300-470e-8ac3-25593c555472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:20.437600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355e6b8-f300-470e-8ac3-25593c555472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:20.440064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355e6b8-f300-470e-8ac3-25593c555472 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-f355e6b8-f300-470e-8ac3-25593c555472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:30:20.459428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:20.460597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:20.461572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:30:20.461572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:30:20.461572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:30:20.461572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:20.462852 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 558/1102] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:30:20.466456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2826f-5cb2-4c2f-8aa5-346de77837d6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:20.564452 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2826f-5cb2-4c2f-8aa5-346de77837d6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:20.598962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f061b9-655e-443d-9ad9-95d95a84bc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:20.599618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f061b9-655e-443d-9ad9-95d95a84bc65 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:20.599895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f061b9-655e-443d-9ad9-95d95a84bc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:20.600167 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f061b9-655e-443d-9ad9-95d95a84bc65 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:20.600876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f061b9-655e-443d-9ad9-95d95a84bc65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:20.601177 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f061b9-655e-443d-9ad9-95d95a84bc65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:20.602532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f061b9-655e-443d-9ad9-95d95a84bc65 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:20.613808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 545/1103] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:20.619431 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355e6b8-f300-470e-8ac3-25593c555472 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:20.715313 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355e6b8-f300-470e-8ac3-25593c555472 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:20.747830 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516baa28-2048-432a-8348-e9928ccebc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:20.748616 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516baa28-2048-432a-8348-e9928ccebc34 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:20.748896 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516baa28-2048-432a-8348-e9928ccebc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:20.749213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516baa28-2048-432a-8348-e9928ccebc34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:20.756626 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516baa28-2048-432a-8348-e9928ccebc34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:20.758062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516baa28-2048-432a-8348-e9928ccebc34 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-516baa28-2048-432a-8348-e9928ccebc34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:30:20.771943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:20.773077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:20.778739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:30:20.778739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:30:20.778739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:30:20.778739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:30:20.778739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:30:20.778739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:30:20.778739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:30:20.778739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:20.778739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 559/1104] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:30:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:20.779266 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f061b9-655e-443d-9ad9-95d95a84bc65 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:20.882793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f061b9-655e-443d-9ad9-95d95a84bc65 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:20.914703 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc3562-b1be-4d90-bbb9-37b47c2298ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:20.915362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3562-b1be-4d90-bbb9-37b47c2298ef None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:20.915641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3562-b1be-4d90-bbb9-37b47c2298ef None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:20.915915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3562-b1be-4d90-bbb9-37b47c2298ef None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:20.916691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc3562-b1be-4d90-bbb9-37b47c2298ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:20.916996 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc3562-b1be-4d90-bbb9-37b47c2298ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:20.918424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc3562-b1be-4d90-bbb9-37b47c2298ef None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:20.930779 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 546/1105] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:30:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:20.936783 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516baa28-2048-432a-8348-e9928ccebc34 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:21.032320 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516baa28-2048-432a-8348-e9928ccebc34 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:21.064503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def4265-8b53-4e54-a98f-95eee72b5629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:21.065141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def4265-8b53-4e54-a98f-95eee72b5629 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:21.065426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def4265-8b53-4e54-a98f-95eee72b5629 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:21.065698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def4265-8b53-4e54-a98f-95eee72b5629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:21.066519 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def4265-8b53-4e54-a98f-95eee72b5629 None admin] RBAC: Adding query filter params (role.id=50b2b4554d83430cabf65ad4a394d646, scope.project.id=745af7d676704a179668d6685724ed78, user.id=04ad234318ad47589b844351cd3bb3e3) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:21.066860 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def4265-8b53-4e54-a98f-95eee72b5629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:21.068281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def4265-8b53-4e54-a98f-95eee72b5629 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:21.073901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 560/1106] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:30:20 2022] GET /identity/v3/role_assignments?user.id=04ad234318ad47589b844351cd3bb3e3&scope.project.id=745af7d676704a179668d6685724ed78&role.id=50b2b4554d83430cabf65ad4a394d646 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:22.774057 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2917-5c31-430e-acdb-14e510df0748 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:22.774624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2917-5c31-430e-acdb-14e510df0748 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:22.774624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2917-5c31-430e-acdb-14e510df0748 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:22.776018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 547/1107] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:22.781275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf42cd-e9dd-4a99-a012-97101d36edb3 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:22.781660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf42cd-e9dd-4a99-a012-97101d36edb3 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:22.782352 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf42cd-e9dd-4a99-a012-97101d36edb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:22.799390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-c2cf42cd-e9dd-4a99-a012-97101d36edb3 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:22.800570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c2cf42cd-e9dd-4a99-a012-97101d36edb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:22.863110 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 561/1108] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:22.896984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a2917-5c31-430e-acdb-14e510df0748 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:22.993565 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a2917-5c31-430e-acdb-14e510df0748 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:23.026224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95742b4-f77a-4c17-a1bf-73ab9076b4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:23.026954 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95742b4-f77a-4c17-a1bf-73ab9076b4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:23.027232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95742b4-f77a-4c17-a1bf-73ab9076b4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:23.027504 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95742b4-f77a-4c17-a1bf-73ab9076b4d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:23.028649 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95742b4-f77a-4c17-a1bf-73ab9076b4d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:23.030101 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95742b4-f77a-4c17-a1bf-73ab9076b4d2 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:23.031773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 548/1109] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:23.038048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf42cd-e9dd-4a99-a012-97101d36edb3 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:23.129498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf42cd-e9dd-4a99-a012-97101d36edb3 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:23.162001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646ae8d-8967-4711-8fca-e706cca338ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:23.162648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646ae8d-8967-4711-8fca-e706cca338ce None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:23.162956 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646ae8d-8967-4711-8fca-e706cca338ce None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:23.163229 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646ae8d-8967-4711-8fca-e706cca338ce None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:23.163932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646ae8d-8967-4711-8fca-e706cca338ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:23.165342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646ae8d-8967-4711-8fca-e706cca338ce None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:23.184068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 562/1110] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:30:23 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:30:25.480075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18009e-d8ff-429a-9e8a-4e86050fa458 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:25.480607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18009e-d8ff-429a-9e8a-4e86050fa458 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:25.480607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18009e-d8ff-429a-9e8a-4e86050fa458 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:25.481963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 549/1111] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:25.487425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdae5f4-7a77-45dc-beb4-6e84a15fa48a None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:25.487838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdae5f4-7a77-45dc-beb4-6e84a15fa48a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:25.487981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdae5f4-7a77-45dc-beb4-6e84a15fa48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:25.504792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-6fdae5f4-7a77-45dc-beb4-6e84a15fa48a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:25.505902 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6fdae5f4-7a77-45dc-beb4-6e84a15fa48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:25.568029 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 563/1112] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:25.592245 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18009e-d8ff-429a-9e8a-4e86050fa458 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:25.690614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18009e-d8ff-429a-9e8a-4e86050fa458 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:25.722435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd619939-c0c9-4b2d-b0d1-3f2d30905869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:25.723300 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd619939-c0c9-4b2d-b0d1-3f2d30905869 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:25.723577 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd619939-c0c9-4b2d-b0d1-3f2d30905869 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:25.723844 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd619939-c0c9-4b2d-b0d1-3f2d30905869 None admin] PATH_INFO: `/v3/roles/b63d5637c42b47588880ae919eb7f448` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:25.725301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd619939-c0c9-4b2d-b0d1-3f2d30905869 None admin] RBAC: Authorizing `identity:get_role(role_id=b63d5637c42b47588880ae919eb7f448)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:25.726682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd619939-c0c9-4b2d-b0d1-3f2d30905869 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:25.728162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 550/1113] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:30:25 2022] GET /identity/v3/roles/b63d5637c42b47588880ae919eb7f448 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:25.733921 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdae5f4-7a77-45dc-beb4-6e84a15fa48a None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:25.826520 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdae5f4-7a77-45dc-beb4-6e84a15fa48a None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:25.858439 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfec8f-24b3-44f8-95e5-05069e01beea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:25.859327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfec8f-24b3-44f8-95e5-05069e01beea None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:25.859606 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfec8f-24b3-44f8-95e5-05069e01beea None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:25.860488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfec8f-24b3-44f8-95e5-05069e01beea None admin] PATH_INFO: `/v3/users/eac4918903a5468ab2f9f497e2eda60b` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:25.872667 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfec8f-24b3-44f8-95e5-05069e01beea None admin] RBAC: Authorizing `identity:get_user(user_id=eac4918903a5468ab2f9f497e2eda60b)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:25.874088 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfec8f-24b3-44f8-95e5-05069e01beea None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:25.876388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 564/1114] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:30:25 2022] GET /identity/v3/users/eac4918903a5468ab2f9f497e2eda60b => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:25.882109 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd619939-c0c9-4b2d-b0d1-3f2d30905869 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:25.975445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd619939-c0c9-4b2d-b0d1-3f2d30905869 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:26.007826 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d44c6b-53c0-4a94-aeac-efe5e3b9b740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:26.008456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d44c6b-53c0-4a94-aeac-efe5e3b9b740 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:26.008734 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d44c6b-53c0-4a94-aeac-efe5e3b9b740 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:26.009006 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d44c6b-53c0-4a94-aeac-efe5e3b9b740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:26.071291 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d44c6b-53c0-4a94-aeac-efe5e3b9b740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:26.072726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d44c6b-53c0-4a94-aeac-efe5e3b9b740 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:26.176373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 551/1115] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:30:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:30:26.182149 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfec8f-24b3-44f8-95e5-05069e01beea None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:26.275972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfec8f-24b3-44f8-95e5-05069e01beea None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:26.307520 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d637d-8598-4c51-88c8-8b5c69f79647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:26.308379 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d637d-8598-4c51-88c8-8b5c69f79647 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:26.308652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d637d-8598-4c51-88c8-8b5c69f79647 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:26.308918 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d637d-8598-4c51-88c8-8b5c69f79647 None admin] PATH_INFO: `/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:26.310071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d637d-8598-4c51-88c8-8b5c69f79647 None admin] RBAC: Authorizing `identity:get_project(project_id=d2eb0f585e9c4c61ba8d4091e266a2e3)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:26.311517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d637d-8598-4c51-88c8-8b5c69f79647 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:26.313829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 565/1116] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:30:26 2022] GET /identity/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:26.319803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d44c6b-53c0-4a94-aeac-efe5e3b9b740 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:26.412828 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d44c6b-53c0-4a94-aeac-efe5e3b9b740 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:26.444838 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e15c50-0228-40c7-9dd7-ee10fd961f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:26.445410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15c50-0228-40c7-9dd7-ee10fd961f19 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:26.445686 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15c50-0228-40c7-9dd7-ee10fd961f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:26.445956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15c50-0228-40c7-9dd7-ee10fd961f19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:26.446791 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e15c50-0228-40c7-9dd7-ee10fd961f19 None admin] RBAC: Adding query filter params (role.id=b63d5637c42b47588880ae919eb7f448, scope.project.id=d2eb0f585e9c4c61ba8d4091e266a2e3, user.id=eac4918903a5468ab2f9f497e2eda60b) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:26.447097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e15c50-0228-40c7-9dd7-ee10fd961f19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:26.448499 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e15c50-0228-40c7-9dd7-ee10fd961f19 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:26.454298 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 552/1117] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:30:26 2022] GET /identity/v3/role_assignments?user.id=eac4918903a5468ab2f9f497e2eda60b&scope.project.id=d2eb0f585e9c4c61ba8d4091e266a2e3&role.id=b63d5637c42b47588880ae919eb7f448 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:28.650396 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d6b02-4b64-4803-b1f5-8de13d61f848 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:28.650986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d6b02-4b64-4803-b1f5-8de13d61f848 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:28.650986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d6b02-4b64-4803-b1f5-8de13d61f848 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:28.652327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 566/1118] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:28.658080 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6715ce-b87a-450e-8ae4-50a5805ed952 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:28.658507 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6715ce-b87a-450e-8ae4-50a5805ed952 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:28.658635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6715ce-b87a-450e-8ae4-50a5805ed952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:28.675447 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-2e6715ce-b87a-450e-8ae4-50a5805ed952 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:28.676634 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2e6715ce-b87a-450e-8ae4-50a5805ed952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:28.740226 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 553/1119] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:28.763180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d6b02-4b64-4803-b1f5-8de13d61f848 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:28.878252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d6b02-4b64-4803-b1f5-8de13d61f848 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:28.912864 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e357f4f-8136-4f51-b46e-442c387a4fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:28.913631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e357f4f-8136-4f51-b46e-442c387a4fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:28.913908 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e357f4f-8136-4f51-b46e-442c387a4fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:28.914180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e357f4f-8136-4f51-b46e-442c387a4fd9 None admin] PATH_INFO: `/v3/roles/b63d5637c42b47588880ae919eb7f448` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:28.915678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e357f4f-8136-4f51-b46e-442c387a4fd9 None admin] RBAC: Authorizing `identity:get_role(role_id=b63d5637c42b47588880ae919eb7f448)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:28.917047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e357f4f-8136-4f51-b46e-442c387a4fd9 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:28.918455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 567/1120] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:30:28 2022] GET /identity/v3/roles/b63d5637c42b47588880ae919eb7f448 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:28.924623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6715ce-b87a-450e-8ae4-50a5805ed952 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:29.022239 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6715ce-b87a-450e-8ae4-50a5805ed952 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:29.054620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178db265-a637-4f1a-a5e7-098ecc613ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:29.055632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db265-a637-4f1a-a5e7-098ecc613ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:29.055904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db265-a637-4f1a-a5e7-098ecc613ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:29.056172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db265-a637-4f1a-a5e7-098ecc613ae1 None admin] PATH_INFO: `/v3/users/eac4918903a5468ab2f9f497e2eda60b` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:29.057356 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178db265-a637-4f1a-a5e7-098ecc613ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=eac4918903a5468ab2f9f497e2eda60b)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:29.058802 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178db265-a637-4f1a-a5e7-098ecc613ae1 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:29.060398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 554/1121] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:30:28 2022] GET /identity/v3/users/eac4918903a5468ab2f9f497e2eda60b => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:29.066566 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e357f4f-8136-4f51-b46e-442c387a4fd9 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:29.173200 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e357f4f-8136-4f51-b46e-442c387a4fd9 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:29.206201 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f699594-a38f-49d4-8f36-17fabd709c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:29.207207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f699594-a38f-49d4-8f36-17fabd709c8f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:29.207481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f699594-a38f-49d4-8f36-17fabd709c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:29.207751 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f699594-a38f-49d4-8f36-17fabd709c8f None admin] PATH_INFO: `/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:29.208911 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f699594-a38f-49d4-8f36-17fabd709c8f None admin] RBAC: Authorizing `identity:get_project(project_id=d2eb0f585e9c4c61ba8d4091e266a2e3)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:29.210331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f699594-a38f-49d4-8f36-17fabd709c8f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:29.212036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 568/1122] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:30:29 2022] GET /identity/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:29.218037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178db265-a637-4f1a-a5e7-098ecc613ae1 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:29.314466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178db265-a637-4f1a-a5e7-098ecc613ae1 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:29.346435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fce33-b478-49f3-9150-de1211e41225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:29.347331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fce33-b478-49f3-9150-de1211e41225 None admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:29.347605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fce33-b478-49f3-9150-de1211e41225 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:29.347874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fce33-b478-49f3-9150-de1211e41225 None admin] PATH_INFO: `/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3/users/eac4918903a5468ab2f9f497e2eda60b/roles/b63d5637c42b47588880ae919eb7f448` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:29.350122 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fce33-b478-49f3-9150-de1211e41225 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2eb0f585e9c4c61ba8d4091e266a2e3, user_id=eac4918903a5468ab2f9f497e2eda60b, role_id=b63d5637c42b47588880ae919eb7f448)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:29.351566 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fce33-b478-49f3-9150-de1211e41225 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:29.364316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 555/1123] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:30:29 2022] PUT /identity/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3/users/eac4918903a5468ab2f9f497e2eda60b/roles/b63d5637c42b47588880ae919eb7f448 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:30:31.588250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1a41-5db3-49ab-b488-f9c0fb2f7177 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:31.588789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1a41-5db3-49ab-b488-f9c0fb2f7177 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:31.588789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1a41-5db3-49ab-b488-f9c0fb2f7177 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:31.590151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 569/1124] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:31.595769 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272111e8-976a-4153-a2a7-8b7547a21b42 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:31.596567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272111e8-976a-4153-a2a7-8b7547a21b42 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:31.596837 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272111e8-976a-4153-a2a7-8b7547a21b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:31.613488 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-272111e8-976a-4153-a2a7-8b7547a21b42 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:31.614655 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-272111e8-976a-4153-a2a7-8b7547a21b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:31.680808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 556/1125] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:30:31.704983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc1a41-5db3-49ab-b488-f9c0fb2f7177 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:31.805177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc1a41-5db3-49ab-b488-f9c0fb2f7177 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:31.838784 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b883a16-fadf-4d53-a1bd-4d7ab123d4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:31.839563 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b883a16-fadf-4d53-a1bd-4d7ab123d4bb None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:31.839837 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b883a16-fadf-4d53-a1bd-4d7ab123d4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:31.840102 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b883a16-fadf-4d53-a1bd-4d7ab123d4bb None admin] PATH_INFO: `/v3/roles/b63d5637c42b47588880ae919eb7f448` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:31.841549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b883a16-fadf-4d53-a1bd-4d7ab123d4bb None admin] RBAC: Authorizing `identity:get_role(role_id=b63d5637c42b47588880ae919eb7f448)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:31.842935 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b883a16-fadf-4d53-a1bd-4d7ab123d4bb None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:31.844331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 570/1126] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:30:31 2022] GET /identity/v3/roles/b63d5637c42b47588880ae919eb7f448 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:31.850212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272111e8-976a-4153-a2a7-8b7547a21b42 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:31.945632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272111e8-976a-4153-a2a7-8b7547a21b42 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:31.977340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839e520-cb0a-4006-a971-f13f0ae9a2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:31.978206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839e520-cb0a-4006-a971-f13f0ae9a2db None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:31.978488 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839e520-cb0a-4006-a971-f13f0ae9a2db None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:31.978795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839e520-cb0a-4006-a971-f13f0ae9a2db None admin] PATH_INFO: `/v3/users/eac4918903a5468ab2f9f497e2eda60b` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:31.979972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839e520-cb0a-4006-a971-f13f0ae9a2db None admin] RBAC: Authorizing `identity:get_user(user_id=eac4918903a5468ab2f9f497e2eda60b)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:31.981404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839e520-cb0a-4006-a971-f13f0ae9a2db None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:31.983077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 557/1127] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:30:31 2022] GET /identity/v3/users/eac4918903a5468ab2f9f497e2eda60b => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:31.989327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b883a16-fadf-4d53-a1bd-4d7ab123d4bb None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:32.082033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b883a16-fadf-4d53-a1bd-4d7ab123d4bb None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:32.114432 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5bba5-6aaf-4ba8-a5d7-e665df808c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:32.115041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5bba5-6aaf-4ba8-a5d7-e665df808c27 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:32.115319 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5bba5-6aaf-4ba8-a5d7-e665df808c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:32.115587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5bba5-6aaf-4ba8-a5d7-e665df808c27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:32.178104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5bba5-6aaf-4ba8-a5d7-e665df808c27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:32.179587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5bba5-6aaf-4ba8-a5d7-e665df808c27 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:32.279678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 571/1128] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:30:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:30:32.286048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839e520-cb0a-4006-a971-f13f0ae9a2db None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:32.380668 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839e520-cb0a-4006-a971-f13f0ae9a2db None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:32.413137 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20283db6-8bd8-4a3c-ac73-3f09e1caf24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:32.413978 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20283db6-8bd8-4a3c-ac73-3f09e1caf24f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:32.414258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20283db6-8bd8-4a3c-ac73-3f09e1caf24f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:32.414532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20283db6-8bd8-4a3c-ac73-3f09e1caf24f None admin] PATH_INFO: `/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:32.415742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20283db6-8bd8-4a3c-ac73-3f09e1caf24f None admin] RBAC: Authorizing `identity:get_project(project_id=d2eb0f585e9c4c61ba8d4091e266a2e3)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:32.417200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20283db6-8bd8-4a3c-ac73-3f09e1caf24f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:32.418937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 558/1129] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:30:32 2022] GET /identity/v3/projects/d2eb0f585e9c4c61ba8d4091e266a2e3 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:32.425803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5bba5-6aaf-4ba8-a5d7-e665df808c27 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:32.519764 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5bba5-6aaf-4ba8-a5d7-e665df808c27 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:32.554346 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945530e-7f18-4079-bb81-19d439f9c936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:32.555018 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945530e-7f18-4079-bb81-19d439f9c936 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:32.555298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945530e-7f18-4079-bb81-19d439f9c936 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:32.555571 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945530e-7f18-4079-bb81-19d439f9c936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:32.556385 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945530e-7f18-4079-bb81-19d439f9c936 None admin] RBAC: Adding query filter params (role.id=b63d5637c42b47588880ae919eb7f448, scope.project.id=d2eb0f585e9c4c61ba8d4091e266a2e3, user.id=eac4918903a5468ab2f9f497e2eda60b) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:32.556692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945530e-7f18-4079-bb81-19d439f9c936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:32.558107 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945530e-7f18-4079-bb81-19d439f9c936 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:32.563682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 572/1130] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:30:32 2022] GET /identity/v3/role_assignments?user.id=eac4918903a5468ab2f9f497e2eda60b&scope.project.id=d2eb0f585e9c4c61ba8d4091e266a2e3&role.id=b63d5637c42b47588880ae919eb7f448 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:34.827303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383667-5b02-47db-840b-8c9b8b5bea41 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:34.827808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383667-5b02-47db-840b-8c9b8b5bea41 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:34.827920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383667-5b02-47db-840b-8c9b8b5bea41 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:34.829810 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 559/1131] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:34.837118 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea255356-2c52-482d-b363-174101079353 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:34.837118 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea255356-2c52-482d-b363-174101079353 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:34.837118 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea255356-2c52-482d-b363-174101079353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:34.852232 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ea255356-2c52-482d-b363-174101079353 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:34.853404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ea255356-2c52-482d-b363-174101079353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:34.918582 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 573/1132] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:34.943413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea383667-5b02-47db-840b-8c9b8b5bea41 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:35.039038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea383667-5b02-47db-840b-8c9b8b5bea41 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:35.073998 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bab31-3b92-4315-add4-4f54e2d8e16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:35.074813 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bab31-3b92-4315-add4-4f54e2d8e16d None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:35.075095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bab31-3b92-4315-add4-4f54e2d8e16d None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:35.075366 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bab31-3b92-4315-add4-4f54e2d8e16d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:35.076534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bab31-3b92-4315-add4-4f54e2d8e16d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:35.078004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bab31-3b92-4315-add4-4f54e2d8e16d None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:35.079645 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 560/1133] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:35.085573 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea255356-2c52-482d-b363-174101079353 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:35.180137 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea255356-2c52-482d-b363-174101079353 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:35.212436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326f5ba-326d-4a0f-b5d1-6e7e481e4a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:35.213090 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326f5ba-326d-4a0f-b5d1-6e7e481e4a9b None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:35.213371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326f5ba-326d-4a0f-b5d1-6e7e481e4a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:35.213640 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326f5ba-326d-4a0f-b5d1-6e7e481e4a9b None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:35.214336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326f5ba-326d-4a0f-b5d1-6e7e481e4a9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:35.215797 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326f5ba-326d-4a0f-b5d1-6e7e481e4a9b None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:35.241223 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 574/1134] 10.222.0.76 () {60 vars in 1141 bytes} [Thu May 12 17:30:35 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:30:37.500040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40ded4-ce20-48b2-9929-d414b0cd4e78 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:37.500660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40ded4-ce20-48b2-9929-d414b0cd4e78 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:37.500660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40ded4-ce20-48b2-9929-d414b0cd4e78 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:37.502370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 561/1135] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:37.507751 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c966f7a-bf01-41d4-8803-c5faff2e45b7 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:37.508129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c966f7a-bf01-41d4-8803-c5faff2e45b7 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:37.508305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c966f7a-bf01-41d4-8803-c5faff2e45b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:37.524833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-8c966f7a-bf01-41d4-8803-c5faff2e45b7 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:37.526008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8c966f7a-bf01-41d4-8803-c5faff2e45b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:37.592396 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 575/1136] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:37.618237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40ded4-ce20-48b2-9929-d414b0cd4e78 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:37.714830 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40ded4-ce20-48b2-9929-d414b0cd4e78 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:37.750630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878e0fe-4218-48c9-8dc3-724b7d3f931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:37.751432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878e0fe-4218-48c9-8dc3-724b7d3f931a None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:37.751711 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878e0fe-4218-48c9-8dc3-724b7d3f931a None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:37.751980 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878e0fe-4218-48c9-8dc3-724b7d3f931a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:37.753142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878e0fe-4218-48c9-8dc3-724b7d3f931a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:37.754566 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878e0fe-4218-48c9-8dc3-724b7d3f931a None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:37.756204 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 562/1137] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:30:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:37.762547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c966f7a-bf01-41d4-8803-c5faff2e45b7 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:37.856533 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c966f7a-bf01-41d4-8803-c5faff2e45b7 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:37.888609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616cd05-186b-4d3f-8b3a-fbc4a8533b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:37.889271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616cd05-186b-4d3f-8b3a-fbc4a8533b52 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:37.889556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616cd05-186b-4d3f-8b3a-fbc4a8533b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:37.889831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616cd05-186b-4d3f-8b3a-fbc4a8533b52 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:37.890544 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616cd05-186b-4d3f-8b3a-fbc4a8533b52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:37.892712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616cd05-186b-4d3f-8b3a-fbc4a8533b52 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:37.912435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 576/1138] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:30:37 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:30:40.169359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9cfe2-d16b-471c-9546-974fc6adcef8 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:40.169928 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9cfe2-d16b-471c-9546-974fc6adcef8 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:40.169928 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9cfe2-d16b-471c-9546-974fc6adcef8 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:40.171305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 563/1139] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:40.177131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864db4-4d2c-4e78-9faa-3a017aeaaec4 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:40.177558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864db4-4d2c-4e78-9faa-3a017aeaaec4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:40.177667 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef864db4-4d2c-4e78-9faa-3a017aeaaec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:40.194179 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ef864db4-4d2c-4e78-9faa-3a017aeaaec4 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:40.195392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ef864db4-4d2c-4e78-9faa-3a017aeaaec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:40.259593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 577/1140] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:40.283828 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9cfe2-d16b-471c-9546-974fc6adcef8 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:40.379977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9cfe2-d16b-471c-9546-974fc6adcef8 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:40.411532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d942b98-5ce0-409a-98ab-5058b3b256f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:40.412303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d942b98-5ce0-409a-98ab-5058b3b256f5 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:40.412581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d942b98-5ce0-409a-98ab-5058b3b256f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:40.412853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d942b98-5ce0-409a-98ab-5058b3b256f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:40.422963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d942b98-5ce0-409a-98ab-5058b3b256f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-0d942b98-5ce0-409a-98ab-5058b3b256f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:30:40.430439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:40.431532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:40.432471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:40.432471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:40.432471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:40.432471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:40.432471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:30:40.432471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:30:40.432471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:30:40.432471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:30:40.432471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:30:40.432471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:30:40.432471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:30:40.432471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:40.432471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 564/1141] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:30:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:40.438417 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef864db4-4d2c-4e78-9faa-3a017aeaaec4 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:40.532532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef864db4-4d2c-4e78-9faa-3a017aeaaec4 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:40.564101 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748566a-21a1-4745-ad9d-108fd3161042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:40.564751 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748566a-21a1-4745-ad9d-108fd3161042 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:40.565029 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748566a-21a1-4745-ad9d-108fd3161042 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:40.565299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748566a-21a1-4745-ad9d-108fd3161042 None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:40.566032 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748566a-21a1-4745-ad9d-108fd3161042 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:40.566335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748566a-21a1-4745-ad9d-108fd3161042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:40.567729 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748566a-21a1-4745-ad9d-108fd3161042 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:40.575546 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 578/1142] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:30:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:40.581566 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d942b98-5ce0-409a-98ab-5058b3b256f5 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:40.677091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d942b98-5ce0-409a-98ab-5058b3b256f5 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:40.711186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb336de-59ba-452f-ae78-e991da7b7666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:40.712047 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb336de-59ba-452f-ae78-e991da7b7666 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:40.712326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb336de-59ba-452f-ae78-e991da7b7666 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:40.712598 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb336de-59ba-452f-ae78-e991da7b7666 None admin] PATH_INFO: `/v3/users/80095fbe0ae242d58a6859e9328d8465` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:40.725566 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb336de-59ba-452f-ae78-e991da7b7666 None admin] RBAC: Authorizing `identity:get_user(user_id=80095fbe0ae242d58a6859e9328d8465)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:40.727036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb336de-59ba-452f-ae78-e991da7b7666 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:40.728678 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 565/1143] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:30:40 2022] GET /identity/v3/users/80095fbe0ae242d58a6859e9328d8465 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:40.734427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748566a-21a1-4745-ad9d-108fd3161042 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:40.830250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748566a-21a1-4745-ad9d-108fd3161042 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:40.862401 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad35e8-34b0-42fc-bce5-2e92c10dfcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:40.863064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad35e8-34b0-42fc-bce5-2e92c10dfcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:40.863341 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad35e8-34b0-42fc-bce5-2e92c10dfcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:40.863608 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad35e8-34b0-42fc-bce5-2e92c10dfcb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:40.926916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad35e8-34b0-42fc-bce5-2e92c10dfcb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:40.928405 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad35e8-34b0-42fc-bce5-2e92c10dfcb5 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:41.020036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 579/1144] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:30:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:30:41.025931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb336de-59ba-452f-ae78-e991da7b7666 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:41.120630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb336de-59ba-452f-ae78-e991da7b7666 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:41.152967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0cc38-f170-4f81-9941-2a4f20d2cad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:41.153802 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0cc38-f170-4f81-9941-2a4f20d2cad2 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:41.154081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0cc38-f170-4f81-9941-2a4f20d2cad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:41.154350 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0cc38-f170-4f81-9941-2a4f20d2cad2 None admin] PATH_INFO: `/v3/projects/5836dc3691314fedbd22297fd96642cb` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:41.155542 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0cc38-f170-4f81-9941-2a4f20d2cad2 None admin] RBAC: Authorizing `identity:get_project(project_id=5836dc3691314fedbd22297fd96642cb)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:41.157553 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0cc38-f170-4f81-9941-2a4f20d2cad2 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:41.159267 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 566/1145] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:30:41 2022] GET /identity/v3/projects/5836dc3691314fedbd22297fd96642cb => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:41.165333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad35e8-34b0-42fc-bce5-2e92c10dfcb5 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:41.258775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad35e8-34b0-42fc-bce5-2e92c10dfcb5 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:41.294571 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f1643-3b60-4b6d-8899-d54b6f480c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:41.295245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f1643-3b60-4b6d-8899-d54b6f480c1a None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:41.295527 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f1643-3b60-4b6d-8899-d54b6f480c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:41.295801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f1643-3b60-4b6d-8899-d54b6f480c1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:41.296625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f1643-3b60-4b6d-8899-d54b6f480c1a None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=5836dc3691314fedbd22297fd96642cb, user.id=80095fbe0ae242d58a6859e9328d8465) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:41.296936 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f1643-3b60-4b6d-8899-d54b6f480c1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:41.298369 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f1643-3b60-4b6d-8899-d54b6f480c1a None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:41.303638 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 580/1146] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:30:41 2022] GET /identity/v3/role_assignments?user.id=80095fbe0ae242d58a6859e9328d8465&scope.project.id=5836dc3691314fedbd22297fd96642cb&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:43.504468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e1242-594b-4b66-9015-fa763fb819eb None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:43.504967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e1242-594b-4b66-9015-fa763fb819eb None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:43.504967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e1242-594b-4b66-9015-fa763fb819eb None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:43.506297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 567/1147] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:43.511738 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a6c2-4e68-4e9b-b616-ca46faa5a17c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:43.512120 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a6c2-4e68-4e9b-b616-ca46faa5a17c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:43.512280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339a6c2-4e68-4e9b-b616-ca46faa5a17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:43.528939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-7339a6c2-4e68-4e9b-b616-ca46faa5a17c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:43.530098 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-7339a6c2-4e68-4e9b-b616-ca46faa5a17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:43.593788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 581/1148] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:30:43.617281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e1242-594b-4b66-9015-fa763fb819eb None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:43.714465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e1242-594b-4b66-9015-fa763fb819eb None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:43.746647 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddbe77-7dc7-4e6c-857a-063e6cae51e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:43.747444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddbe77-7dc7-4e6c-857a-063e6cae51e2 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:43.747719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddbe77-7dc7-4e6c-857a-063e6cae51e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:43.747986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddbe77-7dc7-4e6c-857a-063e6cae51e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:43.757986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddbe77-7dc7-4e6c-857a-063e6cae51e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-07ddbe77-7dc7-4e6c-857a-063e6cae51e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:30:43.765705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:43.766987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:43.767907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:43.767907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:43.767907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:43.767907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:43.767907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:30:43.767907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:30:43.767907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:30:43.767907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:30:43.767907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:30:43.767907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:30:43.767907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:30:43.767907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:43.767907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 568/1149] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:30:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:43.773043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339a6c2-4e68-4e9b-b616-ca46faa5a17c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:43.867475 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339a6c2-4e68-4e9b-b616-ca46faa5a17c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:43.899867 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85aa0ee-7143-456e-9752-f83436ecd18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:43.900521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85aa0ee-7143-456e-9752-f83436ecd18d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:43.900801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85aa0ee-7143-456e-9752-f83436ecd18d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:43.901074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85aa0ee-7143-456e-9752-f83436ecd18d None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:43.901810 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85aa0ee-7143-456e-9752-f83436ecd18d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:43.902116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85aa0ee-7143-456e-9752-f83436ecd18d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:43.903507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85aa0ee-7143-456e-9752-f83436ecd18d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:43.911810 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 582/1150] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:30:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:43.917679 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddbe77-7dc7-4e6c-857a-063e6cae51e2 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:44.017744 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddbe77-7dc7-4e6c-857a-063e6cae51e2 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:44.049219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774f06f-9796-4072-94f6-2b9f3cbe07f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:44.050061 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774f06f-9796-4072-94f6-2b9f3cbe07f6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:44.050342 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774f06f-9796-4072-94f6-2b9f3cbe07f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:44.050616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774f06f-9796-4072-94f6-2b9f3cbe07f6 None admin] PATH_INFO: `/v3/users/80095fbe0ae242d58a6859e9328d8465` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:44.051820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774f06f-9796-4072-94f6-2b9f3cbe07f6 None admin] RBAC: Authorizing `identity:get_user(user_id=80095fbe0ae242d58a6859e9328d8465)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:44.053242 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774f06f-9796-4072-94f6-2b9f3cbe07f6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:44.054908 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 569/1151] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:30:43 2022] GET /identity/v3/users/80095fbe0ae242d58a6859e9328d8465 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:44.060747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85aa0ee-7143-456e-9752-f83436ecd18d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:44.155435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85aa0ee-7143-456e-9752-f83436ecd18d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:44.188964 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15aef1-7fa6-4337-9bdb-fba41b5333f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:44.189817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15aef1-7fa6-4337-9bdb-fba41b5333f2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:44.190098 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15aef1-7fa6-4337-9bdb-fba41b5333f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:44.190370 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15aef1-7fa6-4337-9bdb-fba41b5333f2 None admin] PATH_INFO: `/v3/projects/5836dc3691314fedbd22297fd96642cb` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:44.191578 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15aef1-7fa6-4337-9bdb-fba41b5333f2 None admin] RBAC: Authorizing `identity:get_project(project_id=5836dc3691314fedbd22297fd96642cb)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:44.193000 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15aef1-7fa6-4337-9bdb-fba41b5333f2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:44.194722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 583/1152] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:30:44 2022] GET /identity/v3/projects/5836dc3691314fedbd22297fd96642cb => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:44.200709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774f06f-9796-4072-94f6-2b9f3cbe07f6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:44.297869 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774f06f-9796-4072-94f6-2b9f3cbe07f6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:44.330313 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f1dd8-91b2-4d22-bce5-fbc28c270fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:44.331218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f1dd8-91b2-4d22-bce5-fbc28c270fe0 None admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:44.331502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f1dd8-91b2-4d22-bce5-fbc28c270fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:44.331770 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f1dd8-91b2-4d22-bce5-fbc28c270fe0 None admin] PATH_INFO: `/v3/projects/5836dc3691314fedbd22297fd96642cb/users/80095fbe0ae242d58a6859e9328d8465/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:44.333696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f1dd8-91b2-4d22-bce5-fbc28c270fe0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5836dc3691314fedbd22297fd96642cb, user_id=80095fbe0ae242d58a6859e9328d8465, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:44.335149 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f1dd8-91b2-4d22-bce5-fbc28c270fe0 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:44.348584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 570/1153] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:30:44 2022] PUT /identity/v3/projects/5836dc3691314fedbd22297fd96642cb/users/80095fbe0ae242d58a6859e9328d8465/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:30:46.558110 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ca68e-ff61-42d2-94dc-f47f8e1e4b0c None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:46.558651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ca68e-ff61-42d2-94dc-f47f8e1e4b0c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:46.558651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ca68e-ff61-42d2-94dc-f47f8e1e4b0c None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:46.559979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 584/1154] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:46.565379 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e730085-e47e-44fc-9219-d8d42b414fa7 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:46.565784 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e730085-e47e-44fc-9219-d8d42b414fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:46.565927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e730085-e47e-44fc-9219-d8d42b414fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:46.582127 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-1e730085-e47e-44fc-9219-d8d42b414fa7 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:46.583344 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1e730085-e47e-44fc-9219-d8d42b414fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:46.646262 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 571/1155] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:46.670034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ca68e-ff61-42d2-94dc-f47f8e1e4b0c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:46.768436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ca68e-ff61-42d2-94dc-f47f8e1e4b0c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:46.800508 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b1590-6cdd-4312-819b-05d1ed20db48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:46.801281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b1590-6cdd-4312-819b-05d1ed20db48 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:46.801558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b1590-6cdd-4312-819b-05d1ed20db48 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:46.801827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b1590-6cdd-4312-819b-05d1ed20db48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:46.811792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b1590-6cdd-4312-819b-05d1ed20db48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-fe1b1590-6cdd-4312-819b-05d1ed20db48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:30:46.819210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:46.820392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:46.821524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:46.821524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:46.821524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:46.821524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:46.821524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:30:46.821524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:30:46.821524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:30:46.821524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:30:46.821524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:30:46.821524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:30:46.821524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:30:46.821524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:30:46.821524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 585/1156] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:30:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:46.826539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e730085-e47e-44fc-9219-d8d42b414fa7 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:46.920372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e730085-e47e-44fc-9219-d8d42b414fa7 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:46.952043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc8260-5be7-46cf-b920-a479d9c15b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:46.952699 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc8260-5be7-46cf-b920-a479d9c15b2b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:46.952977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc8260-5be7-46cf-b920-a479d9c15b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:46.953245 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc8260-5be7-46cf-b920-a479d9c15b2b None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:46.954550 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc8260-5be7-46cf-b920-a479d9c15b2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:46.954877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc8260-5be7-46cf-b920-a479d9c15b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:46.956237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc8260-5be7-46cf-b920-a479d9c15b2b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:46.963988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 572/1157] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:30:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:46.970750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b1590-6cdd-4312-819b-05d1ed20db48 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:47.065052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b1590-6cdd-4312-819b-05d1ed20db48 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:47.098019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c3d40-415a-4b6f-8e58-331142359501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:47.098906 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c3d40-415a-4b6f-8e58-331142359501 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:47.099186 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c3d40-415a-4b6f-8e58-331142359501 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:47.099458 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c3d40-415a-4b6f-8e58-331142359501 None admin] PATH_INFO: `/v3/users/80095fbe0ae242d58a6859e9328d8465` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:47.100618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c3d40-415a-4b6f-8e58-331142359501 None admin] RBAC: Authorizing `identity:get_user(user_id=80095fbe0ae242d58a6859e9328d8465)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:47.102039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c3d40-415a-4b6f-8e58-331142359501 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:47.103671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 586/1158] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:30:46 2022] GET /identity/v3/users/80095fbe0ae242d58a6859e9328d8465 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:47.109590 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc8260-5be7-46cf-b920-a479d9c15b2b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:47.204723 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc8260-5be7-46cf-b920-a479d9c15b2b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:47.236577 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e8282-79e7-44c9-b3d0-5a158d532c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:47.237212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e8282-79e7-44c9-b3d0-5a158d532c94 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:47.237484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e8282-79e7-44c9-b3d0-5a158d532c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:47.237749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e8282-79e7-44c9-b3d0-5a158d532c94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:47.303053 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e8282-79e7-44c9-b3d0-5a158d532c94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:47.304486 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e8282-79e7-44c9-b3d0-5a158d532c94 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:47.398012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 573/1159] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:30:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:30:47.403945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c3d40-415a-4b6f-8e58-331142359501 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:47.496906 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c3d40-415a-4b6f-8e58-331142359501 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:47.529305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e84176-f787-4086-8464-cd3ddd2b9b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:47.530134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e84176-f787-4086-8464-cd3ddd2b9b9d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:47.530406 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e84176-f787-4086-8464-cd3ddd2b9b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:47.530692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e84176-f787-4086-8464-cd3ddd2b9b9d None admin] PATH_INFO: `/v3/projects/5836dc3691314fedbd22297fd96642cb` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:47.532109 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e84176-f787-4086-8464-cd3ddd2b9b9d None admin] RBAC: Authorizing `identity:get_project(project_id=5836dc3691314fedbd22297fd96642cb)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:47.533525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e84176-f787-4086-8464-cd3ddd2b9b9d None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:47.535217 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 587/1160] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:30:47 2022] GET /identity/v3/projects/5836dc3691314fedbd22297fd96642cb => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:47.541265 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e8282-79e7-44c9-b3d0-5a158d532c94 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:47.634977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e8282-79e7-44c9-b3d0-5a158d532c94 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:47.667576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e943233-2db9-4f31-a8d5-11816ec356b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:47.668159 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e943233-2db9-4f31-a8d5-11816ec356b3 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:47.668438 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e943233-2db9-4f31-a8d5-11816ec356b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:47.668708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e943233-2db9-4f31-a8d5-11816ec356b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:47.669524 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e943233-2db9-4f31-a8d5-11816ec356b3 None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=5836dc3691314fedbd22297fd96642cb, user.id=80095fbe0ae242d58a6859e9328d8465) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:47.669828 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e943233-2db9-4f31-a8d5-11816ec356b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:47.671295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e943233-2db9-4f31-a8d5-11816ec356b3 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:47.677481 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 574/1161] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:30:47 2022] GET /identity/v3/role_assignments?user.id=80095fbe0ae242d58a6859e9328d8465&scope.project.id=5836dc3691314fedbd22297fd96642cb&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:30:49.932130 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d410b5-8c4a-4c5e-8fdf-f8c64ccaacae None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:49.932675 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d410b5-8c4a-4c5e-8fdf-f8c64ccaacae None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:49.932675 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d410b5-8c4a-4c5e-8fdf-f8c64ccaacae None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:49.934034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 588/1162] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:49.939918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4932c42-fab5-44b8-8b12-2816a3c40aa0 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:49.940353 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4932c42-fab5-44b8-8b12-2816a3c40aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:49.940688 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4932c42-fab5-44b8-8b12-2816a3c40aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:49.957248 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-d4932c42-fab5-44b8-8b12-2816a3c40aa0 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:49.958723 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d4932c42-fab5-44b8-8b12-2816a3c40aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:50.029017 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 575/1163] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:50.052180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d410b5-8c4a-4c5e-8fdf-f8c64ccaacae None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:50.162431 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d410b5-8c4a-4c5e-8fdf-f8c64ccaacae None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:50.197438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e19274-ecba-43dd-91a7-286f4e7b5f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:50.198019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e19274-ecba-43dd-91a7-286f4e7b5f91 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:50.198299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e19274-ecba-43dd-91a7-286f4e7b5f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:50.198572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e19274-ecba-43dd-91a7-286f4e7b5f91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:50.264869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e19274-ecba-43dd-91a7-286f4e7b5f91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:50.266416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e19274-ecba-43dd-91a7-286f4e7b5f91 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:50.362217 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 589/1164] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:30:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:30:50.368384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4932c42-fab5-44b8-8b12-2816a3c40aa0 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:50.465578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4932c42-fab5-44b8-8b12-2816a3c40aa0 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:50.499374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e0188-8a7d-4278-9730-eb95c907f2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:50.500193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e0188-8a7d-4278-9730-eb95c907f2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:50.500530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e0188-8a7d-4278-9730-eb95c907f2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:50.500800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e0188-8a7d-4278-9730-eb95c907f2b1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:50.507498 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e0188-8a7d-4278-9730-eb95c907f2b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:50.508930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e0188-8a7d-4278-9730-eb95c907f2b1 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-a27e0188-8a7d-4278-9730-eb95c907f2b1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:30:50.523795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:30:50.524890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:30:50.525920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 576/1165] 10.222.0.76 () {56 vars in 1117 bytes} [Thu May 12 17:30:50 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:30:50.531093 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e19274-ecba-43dd-91a7-286f4e7b5f91 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:50.628675 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e19274-ecba-43dd-91a7-286f4e7b5f91 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:50.662723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98da821-3b34-4b51-ba71-298a51458ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:50.663385 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da821-3b34-4b51-ba71-298a51458ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:50.663664 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da821-3b34-4b51-ba71-298a51458ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:50.663934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da821-3b34-4b51-ba71-298a51458ea2 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:50.664658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98da821-3b34-4b51-ba71-298a51458ea2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:30:50.664960 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98da821-3b34-4b51-ba71-298a51458ea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:50.666315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98da821-3b34-4b51-ba71-298a51458ea2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:50.673951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 590/1166] 10.222.0.76 () {56 vars in 1115 bytes} [Thu May 12 17:30:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:52.921903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b8d94-805c-4c9d-afc9-2965917fb12e None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:52.922617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b8d94-805c-4c9d-afc9-2965917fb12e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:52.922617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b8d94-805c-4c9d-afc9-2965917fb12e None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:52.923894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 577/1167] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:52.929430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a01d8e-ec6e-453a-a7de-3ccdd3ba9917 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:52.929875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a01d8e-ec6e-453a-a7de-3ccdd3ba9917 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:52.929977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a01d8e-ec6e-453a-a7de-3ccdd3ba9917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:52.946745 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-46a01d8e-ec6e-453a-a7de-3ccdd3ba9917 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:52.947948 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-46a01d8e-ec6e-453a-a7de-3ccdd3ba9917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:53.014273 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 591/1168] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:53.039017 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b8d94-805c-4c9d-afc9-2965917fb12e None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:53.139797 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b8d94-805c-4c9d-afc9-2965917fb12e None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:53.173776 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b43cf0-4fea-4735-b374-722a9d0ba77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:53.174700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b43cf0-4fea-4735-b374-722a9d0ba77b None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:53.174996 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b43cf0-4fea-4735-b374-722a9d0ba77b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:53.175268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b43cf0-4fea-4735-b374-722a9d0ba77b None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:53.176004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b43cf0-4fea-4735-b374-722a9d0ba77b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:53.177376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b43cf0-4fea-4735-b374-722a9d0ba77b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:53.192545 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 578/1169] 10.222.0.76 () {60 vars in 1138 bytes} [Thu May 12 17:30:53 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:30:55.491781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a8416-ffe7-40a2-87a7-fd5e6fb2980b None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:55.492288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a8416-ffe7-40a2-87a7-fd5e6fb2980b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:55.492288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a8416-ffe7-40a2-87a7-fd5e6fb2980b None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:55.493615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 592/1170] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:55.498941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525f64a-5d5c-40bb-95d1-7b5958b90cba None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:55.499373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525f64a-5d5c-40bb-95d1-7b5958b90cba None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:55.499504 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525f64a-5d5c-40bb-95d1-7b5958b90cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:55.516624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-0525f64a-5d5c-40bb-95d1-7b5958b90cba None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:55.518189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0525f64a-5d5c-40bb-95d1-7b5958b90cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:55.585556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 579/1171] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:55.609233 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a8416-ffe7-40a2-87a7-fd5e6fb2980b None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:55.711268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a8416-ffe7-40a2-87a7-fd5e6fb2980b None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:55.744054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab32879-9d4a-459f-8008-c09d541c1134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:55.744779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab32879-9d4a-459f-8008-c09d541c1134 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:55.745060 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab32879-9d4a-459f-8008-c09d541c1134 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:55.745331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab32879-9d4a-459f-8008-c09d541c1134 None admin] PATH_INFO: `/v3/domains/616e86ac1b65480a9f64dc93d85c4ce6` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:55.756367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab32879-9d4a-459f-8008-c09d541c1134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=616e86ac1b65480a9f64dc93d85c4ce6)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:55.757812 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab32879-9d4a-459f-8008-c09d541c1134 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:55.759520 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 593/1172] 10.222.0.76 () {56 vars in 1183 bytes} [Thu May 12 17:30:55 2022] GET /identity/v3/domains/616e86ac1b65480a9f64dc93d85c4ce6 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:55.765686 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525f64a-5d5c-40bb-95d1-7b5958b90cba None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:55.863179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525f64a-5d5c-40bb-95d1-7b5958b90cba None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:55.895174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de972c-09ab-4630-8985-e72359a49ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:55.895820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de972c-09ab-4630-8985-e72359a49ff6 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:55.896102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de972c-09ab-4630-8985-e72359a49ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:55.896427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de972c-09ab-4630-8985-e72359a49ff6 None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:55.897170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de972c-09ab-4630-8985-e72359a49ff6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:55.898589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de972c-09ab-4630-8985-e72359a49ff6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:55.925748 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 580/1173] 10.222.0.76 () {60 vars in 1141 bytes} [Thu May 12 17:30:55 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:30:58.199903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27a0ff-9f6a-4a41-b2da-83441caf9eda None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:58.200446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27a0ff-9f6a-4a41-b2da-83441caf9eda None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:58.200446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27a0ff-9f6a-4a41-b2da-83441caf9eda None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:58.201808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 594/1174] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:30:58.208034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e263598-f71b-4777-9dbc-5fbe30230eee None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:58.208497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e263598-f71b-4777-9dbc-5fbe30230eee None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:58.208601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e263598-f71b-4777-9dbc-5fbe30230eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:58.227092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-2e263598-f71b-4777-9dbc-5fbe30230eee None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:30:58.228280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2e263598-f71b-4777-9dbc-5fbe30230eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:30:58.294772 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 581/1175] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:30:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:30:58.319598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27a0ff-9f6a-4a41-b2da-83441caf9eda None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:58.420435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27a0ff-9f6a-4a41-b2da-83441caf9eda None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:58.452824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ce484-34dc-4ced-b72a-7661568a2a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:58.454167 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ce484-34dc-4ced-b72a-7661568a2a99 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:58.454440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ce484-34dc-4ced-b72a-7661568a2a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:58.454829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ce484-34dc-4ced-b72a-7661568a2a99 None admin] PATH_INFO: `/v3/domains/616e86ac1b65480a9f64dc93d85c4ce6` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:58.456005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ce484-34dc-4ced-b72a-7661568a2a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=616e86ac1b65480a9f64dc93d85c4ce6)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:58.457433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ce484-34dc-4ced-b72a-7661568a2a99 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:58.459074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 595/1176] 10.222.0.76 () {56 vars in 1183 bytes} [Thu May 12 17:30:58 2022] GET /identity/v3/domains/616e86ac1b65480a9f64dc93d85c4ce6 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:30:58.464855 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e263598-f71b-4777-9dbc-5fbe30230eee None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:30:58.557186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e263598-f71b-4777-9dbc-5fbe30230eee None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:30:58.589256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7134e5d-e9e0-4a1f-a8e5-28e7ca27d41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:30:58.589904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7134e5d-e9e0-4a1f-a8e5-28e7ca27d41d None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:30:58.590182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7134e5d-e9e0-4a1f-a8e5-28e7ca27d41d None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:30:58.590451 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7134e5d-e9e0-4a1f-a8e5-28e7ca27d41d None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:30:58.591182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7134e5d-e9e0-4a1f-a8e5-28e7ca27d41d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:30:58.592631 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7134e5d-e9e0-4a1f-a8e5-28e7ca27d41d None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:30:58.611960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 582/1177] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:30:58 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:31:00.875815 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3ed78-5f69-4846-918a-20a81327984d None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:00.876393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3ed78-5f69-4846-918a-20a81327984d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:00.876393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3ed78-5f69-4846-918a-20a81327984d None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:00.877701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 596/1178] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:31:00.882918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8938f8-9800-4d09-b555-2bd1727da1d7 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:00.883299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8938f8-9800-4d09-b555-2bd1727da1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:00.883469 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8938f8-9800-4d09-b555-2bd1727da1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:00.900736 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-fa8938f8-9800-4d09-b555-2bd1727da1d7 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:31:00.901913 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-fa8938f8-9800-4d09-b555-2bd1727da1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:31:00.964702 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 583/1179] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:31:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:31:00.988110 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3ed78-5f69-4846-918a-20a81327984d None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:01.084214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3ed78-5f69-4846-918a-20a81327984d None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:01.115600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bd630-e72f-44be-b01e-d851f68b6d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:01.116358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bd630-e72f-44be-b01e-d851f68b6d9d None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:01.116634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bd630-e72f-44be-b01e-d851f68b6d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:01.116903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bd630-e72f-44be-b01e-d851f68b6d9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:01.127762 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bd630-e72f-44be-b01e-d851f68b6d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-634bd630-e72f-44be-b01e-d851f68b6d9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:31:01.135168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:31:01.136510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:31:01.137577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:31:01.137577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:31:01.137577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:31:01.137577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:31:01.137577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:31:01.137577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:31:01.137577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:31:01.137577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:31:01.137577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:31:01.137577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:31:01.137577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:31:01.137577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:31:01.137577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 597/1180] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:31:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:31:01.142435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8938f8-9800-4d09-b555-2bd1727da1d7 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:01.233914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8938f8-9800-4d09-b555-2bd1727da1d7 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:01.267102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02030373-42a1-4db8-8381-52eaf381d3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:01.267757 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02030373-42a1-4db8-8381-52eaf381d3ee None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:01.268038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02030373-42a1-4db8-8381-52eaf381d3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:01.268313 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02030373-42a1-4db8-8381-52eaf381d3ee None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:01.269051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02030373-42a1-4db8-8381-52eaf381d3ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:31:01.269353 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02030373-42a1-4db8-8381-52eaf381d3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:31:01.270738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02030373-42a1-4db8-8381-52eaf381d3ee None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:31:01.278402 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 584/1181] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:31:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:31:01.284485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bd630-e72f-44be-b01e-d851f68b6d9d None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:01.377717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bd630-e72f-44be-b01e-d851f68b6d9d None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:01.417955 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe583956-4eb4-4ada-a477-93c7b677b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:01.418755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe583956-4eb4-4ada-a477-93c7b677b010 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:01.419035 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe583956-4eb4-4ada-a477-93c7b677b010 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:01.419307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe583956-4eb4-4ada-a477-93c7b677b010 None admin] PATH_INFO: `/v3/users/60f424be7aa6474a8a39fdf55d2faec8` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:01.432244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe583956-4eb4-4ada-a477-93c7b677b010 None admin] RBAC: Authorizing `identity:get_user(user_id=60f424be7aa6474a8a39fdf55d2faec8)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:31:01.433670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe583956-4eb4-4ada-a477-93c7b677b010 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:31:01.435337 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 598/1182] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:31:01 2022] GET /identity/v3/users/60f424be7aa6474a8a39fdf55d2faec8 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:31:01.441674 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02030373-42a1-4db8-8381-52eaf381d3ee None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:01.534692 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02030373-42a1-4db8-8381-52eaf381d3ee None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:01.566003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913cfd7-f125-452d-87f8-1d2060b15649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:01.566630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913cfd7-f125-452d-87f8-1d2060b15649 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:01.566940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913cfd7-f125-452d-87f8-1d2060b15649 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:01.567216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913cfd7-f125-452d-87f8-1d2060b15649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:01.629730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913cfd7-f125-452d-87f8-1d2060b15649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:31:01.631218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913cfd7-f125-452d-87f8-1d2060b15649 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:31:01.722227 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 585/1183] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:31:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:31:01.727984 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe583956-4eb4-4ada-a477-93c7b677b010 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:01.821569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe583956-4eb4-4ada-a477-93c7b677b010 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:01.854020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e3b30-3497-4459-b604-39fb9d49885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:01.854879 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3b30-3497-4459-b604-39fb9d49885a None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:01.855158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3b30-3497-4459-b604-39fb9d49885a None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:01.855430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3b30-3497-4459-b604-39fb9d49885a None admin] PATH_INFO: `/v3/projects/64339e8b54504bc6b97c1338de957de6` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:01.856589 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e3b30-3497-4459-b604-39fb9d49885a None admin] RBAC: Authorizing `identity:get_project(project_id=64339e8b54504bc6b97c1338de957de6)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:31:01.857998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e3b30-3497-4459-b604-39fb9d49885a None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:31:01.859887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 599/1184] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:31:01 2022] GET /identity/v3/projects/64339e8b54504bc6b97c1338de957de6 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:31:01.865853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913cfd7-f125-452d-87f8-1d2060b15649 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:01.960051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913cfd7-f125-452d-87f8-1d2060b15649 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:01.992191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264be7a-456e-42ee-97eb-1249932f61dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:01.992760 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264be7a-456e-42ee-97eb-1249932f61dc None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:01.993041 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264be7a-456e-42ee-97eb-1249932f61dc None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:01.993317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264be7a-456e-42ee-97eb-1249932f61dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:01.994130 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264be7a-456e-42ee-97eb-1249932f61dc None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=64339e8b54504bc6b97c1338de957de6, user.id=60f424be7aa6474a8a39fdf55d2faec8) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:31:01.994436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264be7a-456e-42ee-97eb-1249932f61dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:31:01.995899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264be7a-456e-42ee-97eb-1249932f61dc None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:31:02.001159 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 586/1185] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:31:01 2022] GET /identity/v3/role_assignments?user.id=60f424be7aa6474a8a39fdf55d2faec8&scope.project.id=64339e8b54504bc6b97c1338de957de6&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:31:04.212539 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce3536-119a-4abe-afb2-d53ab638121c None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:04.213102 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce3536-119a-4abe-afb2-d53ab638121c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:04.213102 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce3536-119a-4abe-afb2-d53ab638121c None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:04.214448 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 600/1186] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:31:04.219950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba847b-7e9c-4fd6-9d1b-ec728dc3ce1a None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:04.220354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba847b-7e9c-4fd6-9d1b-ec728dc3ce1a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:04.220500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba847b-7e9c-4fd6-9d1b-ec728dc3ce1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:04.237092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-72ba847b-7e9c-4fd6-9d1b-ec728dc3ce1a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:31:04.238251 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-72ba847b-7e9c-4fd6-9d1b-ec728dc3ce1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:31:04.301894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 587/1187] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:31:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:31:04.324945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce3536-119a-4abe-afb2-d53ab638121c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:04.419211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce3536-119a-4abe-afb2-d53ab638121c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:04.452360 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900f8d6-757c-4b0d-875d-60338c0878cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:04.453134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900f8d6-757c-4b0d-875d-60338c0878cb None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:04.453582 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900f8d6-757c-4b0d-875d-60338c0878cb None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:04.454004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900f8d6-757c-4b0d-875d-60338c0878cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:04.463528 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900f8d6-757c-4b0d-875d-60338c0878cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-1900f8d6-757c-4b0d-875d-60338c0878cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:31:04.471665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:31:04.472801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:31:04.473859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:31:04.473859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:31:04.473859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:31:04.473859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:31:04.473859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:31:04.473859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:31:04.473859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:31:04.473859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:31:04.473859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:31:04.473859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:31:04.473859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:31:04.473859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:31:04.473859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 601/1188] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:31:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:31:04.478817 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba847b-7e9c-4fd6-9d1b-ec728dc3ce1a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:04.572175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba847b-7e9c-4fd6-9d1b-ec728dc3ce1a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:04.604249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238147ad-bfb0-4b08-8217-cc8ea4586768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:04.604895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238147ad-bfb0-4b08-8217-cc8ea4586768 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:04.605171 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238147ad-bfb0-4b08-8217-cc8ea4586768 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:04.605439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238147ad-bfb0-4b08-8217-cc8ea4586768 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:04.606175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238147ad-bfb0-4b08-8217-cc8ea4586768 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:31:04.606469 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238147ad-bfb0-4b08-8217-cc8ea4586768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:31:04.607849 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238147ad-bfb0-4b08-8217-cc8ea4586768 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:31:04.616211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 588/1189] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:31:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:31:04.622058 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900f8d6-757c-4b0d-875d-60338c0878cb None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:04.716252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900f8d6-757c-4b0d-875d-60338c0878cb None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:04.748744 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349ebd-9f2d-41e5-8924-319783f7bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:04.749596 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349ebd-9f2d-41e5-8924-319783f7bba2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:04.749876 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349ebd-9f2d-41e5-8924-319783f7bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:04.750192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349ebd-9f2d-41e5-8924-319783f7bba2 None admin] PATH_INFO: `/v3/users/60f424be7aa6474a8a39fdf55d2faec8` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:04.751386 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67349ebd-9f2d-41e5-8924-319783f7bba2 None admin] RBAC: Authorizing `identity:get_user(user_id=60f424be7aa6474a8a39fdf55d2faec8)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:31:04.752804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67349ebd-9f2d-41e5-8924-319783f7bba2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:31:04.754415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 602/1190] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:31:04 2022] GET /identity/v3/users/60f424be7aa6474a8a39fdf55d2faec8 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:31:04.760068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238147ad-bfb0-4b08-8217-cc8ea4586768 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:04.854739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238147ad-bfb0-4b08-8217-cc8ea4586768 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:04.885879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341e4eb-d48a-471a-a941-dfe77a7b0441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:04.886764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341e4eb-d48a-471a-a941-dfe77a7b0441 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:04.887047 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341e4eb-d48a-471a-a941-dfe77a7b0441 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:04.887321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341e4eb-d48a-471a-a941-dfe77a7b0441 None admin] PATH_INFO: `/v3/projects/64339e8b54504bc6b97c1338de957de6` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:04.888482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341e4eb-d48a-471a-a941-dfe77a7b0441 None admin] RBAC: Authorizing `identity:get_project(project_id=64339e8b54504bc6b97c1338de957de6)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:31:04.889899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341e4eb-d48a-471a-a941-dfe77a7b0441 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:31:04.892151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 589/1191] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:31:04 2022] GET /identity/v3/projects/64339e8b54504bc6b97c1338de957de6 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:31:04.897916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349ebd-9f2d-41e5-8924-319783f7bba2 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:04.992337 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349ebd-9f2d-41e5-8924-319783f7bba2 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:05.023626 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95f551-bcbb-4ba6-9860-bf88420fa5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:05.024491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95f551-bcbb-4ba6-9860-bf88420fa5b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:05.024767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95f551-bcbb-4ba6-9860-bf88420fa5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:05.025038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95f551-bcbb-4ba6-9860-bf88420fa5b9 None admin] PATH_INFO: `/v3/projects/64339e8b54504bc6b97c1338de957de6/users/60f424be7aa6474a8a39fdf55d2faec8/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:05.026986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95f551-bcbb-4ba6-9860-bf88420fa5b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=64339e8b54504bc6b97c1338de957de6, user_id=60f424be7aa6474a8a39fdf55d2faec8, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:31:05.028409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95f551-bcbb-4ba6-9860-bf88420fa5b9 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:31:05.041036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 603/1192] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:31:04 2022] PUT /identity/v3/projects/64339e8b54504bc6b97c1338de957de6/users/60f424be7aa6474a8a39fdf55d2faec8/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:31:07.269669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca2760-fcc2-47e0-ae65-e7029e160f01 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:07.270172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca2760-fcc2-47e0-ae65-e7029e160f01 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:07.270268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca2760-fcc2-47e0-ae65-e7029e160f01 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:07.271616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 590/1193] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:31:07.278938 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145af660-d3ae-4a3b-86f4-d0cc94244380 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:07.279336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145af660-d3ae-4a3b-86f4-d0cc94244380 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:07.279488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145af660-d3ae-4a3b-86f4-d0cc94244380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:07.296269 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-145af660-d3ae-4a3b-86f4-d0cc94244380 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:31:07.298530 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-145af660-d3ae-4a3b-86f4-d0cc94244380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:31:07.361513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 604/1194] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:31:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:31:07.385317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca2760-fcc2-47e0-ae65-e7029e160f01 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:07.489141 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca2760-fcc2-47e0-ae65-e7029e160f01 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:07.520036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987a88b-6917-406a-bd05-b2474be144cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:07.520807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987a88b-6917-406a-bd05-b2474be144cf None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:07.521087 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987a88b-6917-406a-bd05-b2474be144cf None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:07.521360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987a88b-6917-406a-bd05-b2474be144cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:07.531883 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987a88b-6917-406a-bd05-b2474be144cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-6987a88b-6917-406a-bd05-b2474be144cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:31:07.539349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:31:07.540459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:31:07.541522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:31:07.541522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:31:07.541522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:31:07.541522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:31:07.541522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:31:07.541522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:31:07.541522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:31:07.541522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:31:07.541522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:31:07.541522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:31:07.541522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:31:07.541522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:31:07.541522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 591/1195] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:31:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:31:07.546564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145af660-d3ae-4a3b-86f4-d0cc94244380 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:07.642764 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145af660-d3ae-4a3b-86f4-d0cc94244380 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:07.675228 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bb7fe-d2df-464e-bb7c-35d73ec5623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:07.675875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bb7fe-d2df-464e-bb7c-35d73ec5623c None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:07.676154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bb7fe-d2df-464e-bb7c-35d73ec5623c None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:07.676427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bb7fe-d2df-464e-bb7c-35d73ec5623c None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:07.677157 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bb7fe-d2df-464e-bb7c-35d73ec5623c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:31:07.677456 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bb7fe-d2df-464e-bb7c-35d73ec5623c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:31:07.678839 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bb7fe-d2df-464e-bb7c-35d73ec5623c None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:31:07.687626 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 605/1196] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:31:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:31:07.693627 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987a88b-6917-406a-bd05-b2474be144cf None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:07.787750 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987a88b-6917-406a-bd05-b2474be144cf None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:07.821429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52166f44-c338-4378-8c63-3ede45e421b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:07.822265 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52166f44-c338-4378-8c63-3ede45e421b4 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:07.822542 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52166f44-c338-4378-8c63-3ede45e421b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:07.822843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52166f44-c338-4378-8c63-3ede45e421b4 None admin] PATH_INFO: `/v3/users/60f424be7aa6474a8a39fdf55d2faec8` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:07.824010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52166f44-c338-4378-8c63-3ede45e421b4 None admin] RBAC: Authorizing `identity:get_user(user_id=60f424be7aa6474a8a39fdf55d2faec8)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:31:07.825446 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52166f44-c338-4378-8c63-3ede45e421b4 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:31:07.827086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 592/1197] 10.222.0.76 () {56 vars in 1177 bytes} [Thu May 12 17:31:07 2022] GET /identity/v3/users/60f424be7aa6474a8a39fdf55d2faec8 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:31:07.833247 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bb7fe-d2df-464e-bb7c-35d73ec5623c None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:07.928831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bb7fe-d2df-464e-bb7c-35d73ec5623c None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:07.960628 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b513d5-da24-463e-b77d-a64359ac63cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:07.961250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b513d5-da24-463e-b77d-a64359ac63cd None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:07.961524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b513d5-da24-463e-b77d-a64359ac63cd None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:07.961794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b513d5-da24-463e-b77d-a64359ac63cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:08.026784 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b513d5-da24-463e-b77d-a64359ac63cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:31:08.028210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b513d5-da24-463e-b77d-a64359ac63cd None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:31:08.121007 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 606/1198] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:31:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:31:08.127244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52166f44-c338-4378-8c63-3ede45e421b4 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:08.220564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52166f44-c338-4378-8c63-3ede45e421b4 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:08.252660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1accc-3940-4ca3-88bd-5729d8856386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:08.253500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1accc-3940-4ca3-88bd-5729d8856386 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:08.253775 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1accc-3940-4ca3-88bd-5729d8856386 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:08.254044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1accc-3940-4ca3-88bd-5729d8856386 None admin] PATH_INFO: `/v3/projects/64339e8b54504bc6b97c1338de957de6` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:08.255373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1accc-3940-4ca3-88bd-5729d8856386 None admin] RBAC: Authorizing `identity:get_project(project_id=64339e8b54504bc6b97c1338de957de6)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:31:08.256798 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1accc-3940-4ca3-88bd-5729d8856386 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:31:08.258486 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 593/1199] 10.222.0.76 () {56 vars in 1186 bytes} [Thu May 12 17:31:08 2022] GET /identity/v3/projects/64339e8b54504bc6b97c1338de957de6 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:31:08.264895 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b513d5-da24-463e-b77d-a64359ac63cd None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:31:08.358515 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b513d5-da24-463e-b77d-a64359ac63cd None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:31:08.392131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c48c30-9dd1-43f1-87a6-ba427378cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:31:08.392705 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c48c30-9dd1-43f1-87a6-ba427378cd5b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:31:08.392980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c48c30-9dd1-43f1-87a6-ba427378cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:31:08.393249 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c48c30-9dd1-43f1-87a6-ba427378cd5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:31:08.394059 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c48c30-9dd1-43f1-87a6-ba427378cd5b None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=64339e8b54504bc6b97c1338de957de6, user.id=60f424be7aa6474a8a39fdf55d2faec8) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:31:08.394362 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c48c30-9dd1-43f1-87a6-ba427378cd5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:31:08.395808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c48c30-9dd1-43f1-87a6-ba427378cd5b None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:31:08.401303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 607/1200] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:31:08 2022] GET /identity/v3/role_assignments?user.id=60f424be7aa6474a8a39fdf55d2faec8&scope.project.id=64339e8b54504bc6b97c1338de957de6&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:09.606534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8bd60-8dcb-4e54-9397-da9128f9c687 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:09.606534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8bd60-8dcb-4e54-9397-da9128f9c687 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:09.606534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8bd60-8dcb-4e54-9397-da9128f9c687 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:09.607924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 594/1201] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:32:09.614254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091837b8-3cfb-4655-9939-9cd608575721 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:09.614784 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091837b8-3cfb-4655-9939-9cd608575721 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:09.614879 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091837b8-3cfb-4655-9939-9cd608575721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:09.633313 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-091837b8-3cfb-4655-9939-9cd608575721 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:32:09.634890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-091837b8-3cfb-4655-9939-9cd608575721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:32:09.722708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 608/1202] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:32:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:32:09.748178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8bd60-8dcb-4e54-9397-da9128f9c687 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:09.886159 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8bd60-8dcb-4e54-9397-da9128f9c687 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:09.928859 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c14901-f014-4955-a982-d74f8d25d725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:09.929762 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14901-f014-4955-a982-d74f8d25d725 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:09.930047 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14901-f014-4955-a982-d74f8d25d725 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:09.930321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14901-f014-4955-a982-d74f8d25d725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:09.942561 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c14901-f014-4955-a982-d74f8d25d725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:09.944128 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c14901-f014-4955-a982-d74f8d25d725 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-a0c14901-f014-4955-a982-d74f8d25d725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:32:09.964208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:09.965603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:09.966689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:32:09.966689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:32:09.966689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:09.966689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:09.966689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 595/1203] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:09.972271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091837b8-3cfb-4655-9939-9cd608575721 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:10.095620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091837b8-3cfb-4655-9939-9cd608575721 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:10.148921 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8f0d5-7b41-4c84-af2e-ef9dc535a158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:10.149523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8f0d5-7b41-4c84-af2e-ef9dc535a158 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:10.149804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8f0d5-7b41-4c84-af2e-ef9dc535a158 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:10.150073 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8f0d5-7b41-4c84-af2e-ef9dc535a158 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:10.150829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8f0d5-7b41-4c84-af2e-ef9dc535a158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:10.151134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8f0d5-7b41-4c84-af2e-ef9dc535a158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:10.152691 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8f0d5-7b41-4c84-af2e-ef9dc535a158 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:10.170780 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 609/1204] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:10.173884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c14901-f014-4955-a982-d74f8d25d725 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:10.310021 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c14901-f014-4955-a982-d74f8d25d725 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:10.349241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac23c11-eba4-447c-aadf-1254b11d8508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:10.350023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac23c11-eba4-447c-aadf-1254b11d8508 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:10.350233 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac23c11-eba4-447c-aadf-1254b11d8508 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:10.350576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac23c11-eba4-447c-aadf-1254b11d8508 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:10.351386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac23c11-eba4-447c-aadf-1254b11d8508 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:10.352988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac23c11-eba4-447c-aadf-1254b11d8508 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:10.376116 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 596/1205] 10.222.0.76 () {60 vars in 1132 bytes} [Thu May 12 17:32:10 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:32:12.875871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f93b5-f2e0-48a4-82f4-27de613218a7 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:12.876419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f93b5-f2e0-48a4-82f4-27de613218a7 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:12.876419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f93b5-f2e0-48a4-82f4-27de613218a7 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:12.877790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 610/1206] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:32:12.885318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b862874-3aef-4330-a37c-394537107396 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:12.885318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b862874-3aef-4330-a37c-394537107396 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:12.885318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b862874-3aef-4330-a37c-394537107396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:12.904143 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-1b862874-3aef-4330-a37c-394537107396 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:32:12.905782 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1b862874-3aef-4330-a37c-394537107396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:32:12.978800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 597/1207] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:32:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:32:13.003517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f93b5-f2e0-48a4-82f4-27de613218a7 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:13.118341 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f93b5-f2e0-48a4-82f4-27de613218a7 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:13.157767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087cc4d-eff2-43a3-a9fd-6788df2d95fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:13.158488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087cc4d-eff2-43a3-a9fd-6788df2d95fe None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:13.158859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087cc4d-eff2-43a3-a9fd-6788df2d95fe None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:13.159106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087cc4d-eff2-43a3-a9fd-6788df2d95fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:13.172565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087cc4d-eff2-43a3-a9fd-6788df2d95fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-e087cc4d-eff2-43a3-a9fd-6788df2d95fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:32:13.181925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:13.182998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:13.183892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:13.183892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:13.183892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:13.183892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:13.183892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:32:13.183892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:32:13.183892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:32:13.183892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:32:13.183892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:32:13.183892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:32:13.183892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:32:13.183892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:13.190710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 611/1208] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:32:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:13.195253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b862874-3aef-4330-a37c-394537107396 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:13.307221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b862874-3aef-4330-a37c-394537107396 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:13.346639 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c858c7-e988-4795-9c39-d5f975bc3b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:13.347339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c858c7-e988-4795-9c39-d5f975bc3b68 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:13.347620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c858c7-e988-4795-9c39-d5f975bc3b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:13.347898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c858c7-e988-4795-9c39-d5f975bc3b68 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:13.348650 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c858c7-e988-4795-9c39-d5f975bc3b68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:13.348953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c858c7-e988-4795-9c39-d5f975bc3b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:13.350389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c858c7-e988-4795-9c39-d5f975bc3b68 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:13.361621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 598/1209] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:32:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:13.367673 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087cc4d-eff2-43a3-a9fd-6788df2d95fe None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:13.488822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087cc4d-eff2-43a3-a9fd-6788df2d95fe None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:13.528659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c607c-99f3-479e-afa3-e084ac37d72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:13.529724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c607c-99f3-479e-afa3-e084ac37d72e None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:13.530202 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c607c-99f3-479e-afa3-e084ac37d72e None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:13.531470 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c607c-99f3-479e-afa3-e084ac37d72e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:13.543077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c607c-99f3-479e-afa3-e084ac37d72e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:13.544656 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c607c-99f3-479e-afa3-e084ac37d72e None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-c45c607c-99f3-479e-afa3-e084ac37d72e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:32:13.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:13.565256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:13.566163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:32:13.566163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:32:13.566163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:13.566163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:13.566163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 612/1210] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:32:13.572284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c858c7-e988-4795-9c39-d5f975bc3b68 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:13.688699 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c858c7-e988-4795-9c39-d5f975bc3b68 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:13.726556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9474f4-7902-49d2-9e27-ba4fa29ac2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:13.727429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9474f4-7902-49d2-9e27-ba4fa29ac2fc None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:13.727828 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9474f4-7902-49d2-9e27-ba4fa29ac2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:13.728237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9474f4-7902-49d2-9e27-ba4fa29ac2fc None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:13.728974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9474f4-7902-49d2-9e27-ba4fa29ac2fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:13.729354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9474f4-7902-49d2-9e27-ba4fa29ac2fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:13.731020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9474f4-7902-49d2-9e27-ba4fa29ac2fc None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:13.745580 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 599/1211] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:32:13.751949 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c607c-99f3-479e-afa3-e084ac37d72e None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:13.878177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c607c-99f3-479e-afa3-e084ac37d72e None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:13.915932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ca41c-ab88-461a-acc1-79da55c120f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:13.916823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ca41c-ab88-461a-acc1-79da55c120f6 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:13.917106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ca41c-ab88-461a-acc1-79da55c120f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:13.917385 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ca41c-ab88-461a-acc1-79da55c120f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:13.925942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ca41c-ab88-461a-acc1-79da55c120f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:13.927423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ca41c-ab88-461a-acc1-79da55c120f6 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-9f4ca41c-ab88-461a-acc1-79da55c120f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:32:13.942565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:13.944022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:13.945361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:13.945361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:13.945361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:32:13.945361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:32:13.945361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:32:13.945361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:32:13.945361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:32:13.945361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:32:13.945361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 17:32:13.945361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:13.950697 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 613/1212] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:13.951442 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9474f4-7902-49d2-9e27-ba4fa29ac2fc None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:14.065795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9474f4-7902-49d2-9e27-ba4fa29ac2fc None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:14.108242 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bd649-2100-49dc-9859-907949963e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:14.111009 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd649-2100-49dc-9859-907949963e53 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:14.111009 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd649-2100-49dc-9859-907949963e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:14.111009 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd649-2100-49dc-9859-907949963e53 None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:14.111317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bd649-2100-49dc-9859-907949963e53 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:14.111805 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bd649-2100-49dc-9859-907949963e53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:14.113648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bd649-2100-49dc-9859-907949963e53 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:14.136134 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 600/1213] 10.222.0.76 () {56 vars in 1143 bytes} [Thu May 12 17:32:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:32:14.143203 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ca41c-ab88-461a-acc1-79da55c120f6 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:14.256491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ca41c-ab88-461a-acc1-79da55c120f6 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:14.305044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2795cba-ef69-4d95-a66d-d3c2cdfc50e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:14.307366 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795cba-ef69-4d95-a66d-d3c2cdfc50e8 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:14.307653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795cba-ef69-4d95-a66d-d3c2cdfc50e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:14.307925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795cba-ef69-4d95-a66d-d3c2cdfc50e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:14.383802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2795cba-ef69-4d95-a66d-d3c2cdfc50e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:14.385458 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2795cba-ef69-4d95-a66d-d3c2cdfc50e8 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:14.488705 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 614/1214] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:32:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:32:14.494495 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bd649-2100-49dc-9859-907949963e53 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:14.602682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bd649-2100-49dc-9859-907949963e53 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:14.638658 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd742b-898a-44f9-8b59-08f2b623e6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:14.639399 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd742b-898a-44f9-8b59-08f2b623e6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:14.639678 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd742b-898a-44f9-8b59-08f2b623e6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:14.640491 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd742b-898a-44f9-8b59-08f2b623e6d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:14.651190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd742b-898a-44f9-8b59-08f2b623e6d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:14.652786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd742b-898a-44f9-8b59-08f2b623e6d0 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-b2dd742b-898a-44f9-8b59-08f2b623e6d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:32:14.673444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:14.674618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:14.675578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:32:14.675578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:32:14.675578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:14.675578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:14.675578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 601/1215] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:14.680873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2795cba-ef69-4d95-a66d-d3c2cdfc50e8 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:14.798541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2795cba-ef69-4d95-a66d-d3c2cdfc50e8 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:14.834975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730e385-6985-4b82-acbd-ca10a55adee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:14.835639 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730e385-6985-4b82-acbd-ca10a55adee7 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:14.835914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730e385-6985-4b82-acbd-ca10a55adee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:14.836184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730e385-6985-4b82-acbd-ca10a55adee7 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:14.836901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730e385-6985-4b82-acbd-ca10a55adee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:14.837203 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730e385-6985-4b82-acbd-ca10a55adee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:14.838559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730e385-6985-4b82-acbd-ca10a55adee7 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:14.851624 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 615/1216] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:32:14.856620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd742b-898a-44f9-8b59-08f2b623e6d0 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:14.964742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd742b-898a-44f9-8b59-08f2b623e6d0 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:15.001956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9509aa-d6cd-4b55-9786-beef49838faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:15.002794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9509aa-d6cd-4b55-9786-beef49838faa None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:15.003077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9509aa-d6cd-4b55-9786-beef49838faa None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:15.003349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9509aa-d6cd-4b55-9786-beef49838faa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:15.010724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9509aa-d6cd-4b55-9786-beef49838faa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:15.012649 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9509aa-d6cd-4b55-9786-beef49838faa None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-ba9509aa-d6cd-4b55-9786-beef49838faa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:32:15.028031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:15.029217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:15.035394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:32:15.035394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:32:15.035394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:32:15.035394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:32:15.035394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:32:15.035394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:32:15.035394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:32:15.035394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:15.035394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 602/1217] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:32:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:15.036016 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730e385-6985-4b82-acbd-ca10a55adee7 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:15.151371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730e385-6985-4b82-acbd-ca10a55adee7 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:15.191190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2565be-896b-435b-bd30-eae9c0e77df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:15.191961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2565be-896b-435b-bd30-eae9c0e77df8 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:15.192335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2565be-896b-435b-bd30-eae9c0e77df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:15.192688 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2565be-896b-435b-bd30-eae9c0e77df8 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:15.193831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2565be-896b-435b-bd30-eae9c0e77df8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:15.194191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2565be-896b-435b-bd30-eae9c0e77df8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:15.196063 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2565be-896b-435b-bd30-eae9c0e77df8 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:15.212803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 616/1218] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:32:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:32:15.219716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9509aa-d6cd-4b55-9786-beef49838faa None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:15.334108 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9509aa-d6cd-4b55-9786-beef49838faa None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:15.372299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ee9c9-7c48-4898-83e5-13c9f6ddf205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:15.372958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee9c9-7c48-4898-83e5-13c9f6ddf205 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:15.373235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee9c9-7c48-4898-83e5-13c9f6ddf205 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:15.373506 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee9c9-7c48-4898-83e5-13c9f6ddf205 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:15.374376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ee9c9-7c48-4898-83e5-13c9f6ddf205 None admin] RBAC: Adding query filter params (role.id=511b62180d4c4881999e65dfab877783, scope.project.id=745af7d676704a179668d6685724ed78, user.id=a01fa037b14c456eb533b5a86da0a370) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:15.374771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ee9c9-7c48-4898-83e5-13c9f6ddf205 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:15.376219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ee9c9-7c48-4898-83e5-13c9f6ddf205 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:15.381933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 603/1219] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:32:15 2022] GET /identity/v3/role_assignments?user.id=a01fa037b14c456eb533b5a86da0a370&scope.project.id=745af7d676704a179668d6685724ed78&role.id=511b62180d4c4881999e65dfab877783 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:32:17.751330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11f7bb-c7d1-4913-8535-1d313e862cdb None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:17.751898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11f7bb-c7d1-4913-8535-1d313e862cdb None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:17.751898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11f7bb-c7d1-4913-8535-1d313e862cdb None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:17.753403 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 617/1220] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:32:17.759131 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa68a1-efec-44fe-b913-15a5484885ad None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:17.759131 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa68a1-efec-44fe-b913-15a5484885ad None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:17.760018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa68a1-efec-44fe-b913-15a5484885ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:17.778922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-4ffa68a1-efec-44fe-b913-15a5484885ad None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:32:17.780126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4ffa68a1-efec-44fe-b913-15a5484885ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:32:17.850097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 604/1221] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:32:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:32:17.876511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11f7bb-c7d1-4913-8535-1d313e862cdb None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:17.986199 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11f7bb-c7d1-4913-8535-1d313e862cdb None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:18.027729 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bff498-d2b5-4d95-861e-7127b914aae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:18.028764 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bff498-d2b5-4d95-861e-7127b914aae6 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:18.029051 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bff498-d2b5-4d95-861e-7127b914aae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:18.029460 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bff498-d2b5-4d95-861e-7127b914aae6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:18.043950 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bff498-d2b5-4d95-861e-7127b914aae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-f9bff498-d2b5-4d95-861e-7127b914aae6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:32:18.054782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:18.055941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:18.057225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:18.057225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:18.057225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:18.057225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:18.057225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:32:18.057225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:32:18.057225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:32:18.057225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:32:18.057225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:32:18.057225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:32:18.057225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:32:18.057225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:18.057225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 618/1222] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:32:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:18.064012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa68a1-efec-44fe-b913-15a5484885ad None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:18.180080 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa68a1-efec-44fe-b913-15a5484885ad None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:18.217023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018b437-980b-4c9f-8ed9-b44e4ad6bef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:18.217719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018b437-980b-4c9f-8ed9-b44e4ad6bef2 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:18.218061 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018b437-980b-4c9f-8ed9-b44e4ad6bef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:18.218407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018b437-980b-4c9f-8ed9-b44e4ad6bef2 None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:18.219187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018b437-980b-4c9f-8ed9-b44e4ad6bef2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:18.219486 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018b437-980b-4c9f-8ed9-b44e4ad6bef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:18.220836 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018b437-980b-4c9f-8ed9-b44e4ad6bef2 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:18.228666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 605/1223] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:32:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:18.234643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bff498-d2b5-4d95-861e-7127b914aae6 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:18.352136 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bff498-d2b5-4d95-861e-7127b914aae6 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:18.386562 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681f657-d781-44b5-b4e2-073852bb6ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:18.387652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681f657-d781-44b5-b4e2-073852bb6ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:18.387936 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681f657-d781-44b5-b4e2-073852bb6ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:18.388213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681f657-d781-44b5-b4e2-073852bb6ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:18.399810 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681f657-d781-44b5-b4e2-073852bb6ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:18.401233 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681f657-d781-44b5-b4e2-073852bb6ad8 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-e681f657-d781-44b5-b4e2-073852bb6ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:32:18.418271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:18.419301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:18.420279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:32:18.420279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:32:18.420279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:18.420279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:18.420279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 619/1224] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:18.425976 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018b437-980b-4c9f-8ed9-b44e4ad6bef2 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:18.533923 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018b437-980b-4c9f-8ed9-b44e4ad6bef2 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:18.569408 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c3626-803f-430c-836a-7369fb21b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:18.570066 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c3626-803f-430c-836a-7369fb21b14b None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:18.570345 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c3626-803f-430c-836a-7369fb21b14b None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:18.570617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c3626-803f-430c-836a-7369fb21b14b None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:18.571364 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c3626-803f-430c-836a-7369fb21b14b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:18.571664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c3626-803f-430c-836a-7369fb21b14b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:18.573035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c3626-803f-430c-836a-7369fb21b14b None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:18.586058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 606/1225] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:18.592548 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681f657-d781-44b5-b4e2-073852bb6ad8 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:18.705738 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681f657-d781-44b5-b4e2-073852bb6ad8 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:18.748565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e056e31-7f6c-4980-88ad-7c2ca44a1206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:18.750119 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e056e31-7f6c-4980-88ad-7c2ca44a1206 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:18.750516 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e056e31-7f6c-4980-88ad-7c2ca44a1206 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:18.750837 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e056e31-7f6c-4980-88ad-7c2ca44a1206 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:18.759451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e056e31-7f6c-4980-88ad-7c2ca44a1206 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:18.761096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e056e31-7f6c-4980-88ad-7c2ca44a1206 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-9e056e31-7f6c-4980-88ad-7c2ca44a1206 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:32:18.776354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:18.777440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:18.778425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:18.778425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:18.778425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:32:18.778425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:32:18.778425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:32:18.778425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:32:18.778425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:32:18.778425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:32:18.778425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 17:32:18.778425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:18.778425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 620/1226] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:18.785809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c3626-803f-430c-836a-7369fb21b14b None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:18.893487 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c3626-803f-430c-836a-7369fb21b14b None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:18.929441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f14f5-8672-42fa-8558-0b816ba0458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:18.930180 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f14f5-8672-42fa-8558-0b816ba0458c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:18.930460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f14f5-8672-42fa-8558-0b816ba0458c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:18.930852 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f14f5-8672-42fa-8558-0b816ba0458c None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:18.931812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f14f5-8672-42fa-8558-0b816ba0458c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:18.932156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f14f5-8672-42fa-8558-0b816ba0458c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:18.933762 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f14f5-8672-42fa-8558-0b816ba0458c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:18.952182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 607/1227] 10.222.0.76 () {56 vars in 1143 bytes} [Thu May 12 17:32:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:18.958084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e056e31-7f6c-4980-88ad-7c2ca44a1206 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:19.065756 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e056e31-7f6c-4980-88ad-7c2ca44a1206 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:19.103906 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea52837-5c8b-4a83-9bd4-d7f960359947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:19.104861 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea52837-5c8b-4a83-9bd4-d7f960359947 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:19.105178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea52837-5c8b-4a83-9bd4-d7f960359947 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:19.105514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea52837-5c8b-4a83-9bd4-d7f960359947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:19.118198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea52837-5c8b-4a83-9bd4-d7f960359947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:19.120021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea52837-5c8b-4a83-9bd4-d7f960359947 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-0ea52837-5c8b-4a83-9bd4-d7f960359947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:32:19.140561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:19.141614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:19.142531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:32:19.142531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:32:19.142531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:19.142531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:19.142531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 621/1228] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:19.147795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f14f5-8672-42fa-8558-0b816ba0458c None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:19.256103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f14f5-8672-42fa-8558-0b816ba0458c None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:19.292390 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd106ed2-0b96-4ce7-939e-844c21419221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:19.293059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106ed2-0b96-4ce7-939e-844c21419221 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:19.293386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106ed2-0b96-4ce7-939e-844c21419221 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:19.293648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd106ed2-0b96-4ce7-939e-844c21419221 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:19.294375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd106ed2-0b96-4ce7-939e-844c21419221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:19.294646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd106ed2-0b96-4ce7-939e-844c21419221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:19.296577 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd106ed2-0b96-4ce7-939e-844c21419221 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:19.309842 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 608/1229] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:32:19.314579 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea52837-5c8b-4a83-9bd4-d7f960359947 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:19.422999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea52837-5c8b-4a83-9bd4-d7f960359947 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:19.456918 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f017c7-da55-49ba-ab60-d09d5c895de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:19.457714 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f017c7-da55-49ba-ab60-d09d5c895de8 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:19.457995 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f017c7-da55-49ba-ab60-d09d5c895de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:19.458272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f017c7-da55-49ba-ab60-d09d5c895de8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:19.465792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f017c7-da55-49ba-ab60-d09d5c895de8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:19.467595 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f017c7-da55-49ba-ab60-d09d5c895de8 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-f9f017c7-da55-49ba-ab60-d09d5c895de8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:32:19.484338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:19.485631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:19.486972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:32:19.486972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:32:19.486972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:32:19.486972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:32:19.486972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:32:19.486972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:32:19.486972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:32:19.486972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:19.486972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 622/1230] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:32:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:19.492408 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd106ed2-0b96-4ce7-939e-844c21419221 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:19.603323 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd106ed2-0b96-4ce7-939e-844c21419221 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:19.639243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808de6d-bb5d-44e9-beca-7cd59e574f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:19.640535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808de6d-bb5d-44e9-beca-7cd59e574f4c None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:19.640817 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808de6d-bb5d-44e9-beca-7cd59e574f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:19.641089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808de6d-bb5d-44e9-beca-7cd59e574f4c None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:19.641871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808de6d-bb5d-44e9-beca-7cd59e574f4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:19.642176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808de6d-bb5d-44e9-beca-7cd59e574f4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:19.643635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808de6d-bb5d-44e9-beca-7cd59e574f4c None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:19.657542 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 609/1231] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:32:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:32:19.664082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f017c7-da55-49ba-ab60-d09d5c895de8 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:19.775968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f017c7-da55-49ba-ab60-d09d5c895de8 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:19.813773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e0090-5b55-45ac-87eb-c1726ea644ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:19.814767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e0090-5b55-45ac-87eb-c1726ea644ad None admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:19.815046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e0090-5b55-45ac-87eb-c1726ea644ad None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:19.815339 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e0090-5b55-45ac-87eb-c1726ea644ad None admin] PATH_INFO: `/v3/projects/745af7d676704a179668d6685724ed78/users/a01fa037b14c456eb533b5a86da0a370/roles/511b62180d4c4881999e65dfab877783` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:19.832264 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e0090-5b55-45ac-87eb-c1726ea644ad None admin] RBAC: Authorizing `identity:create_grant(project_id=745af7d676704a179668d6685724ed78, user_id=a01fa037b14c456eb533b5a86da0a370, role_id=511b62180d4c4881999e65dfab877783)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:19.833807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e0090-5b55-45ac-87eb-c1726ea644ad None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:19.847397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 623/1232] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:32:19 2022] PUT /identity/v3/projects/745af7d676704a179668d6685724ed78/users/a01fa037b14c456eb533b5a86da0a370/roles/511b62180d4c4881999e65dfab877783 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:32:22.173186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc349e-b953-4b22-8227-ffaa485db213 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:22.173803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc349e-b953-4b22-8227-ffaa485db213 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:22.173803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc349e-b953-4b22-8227-ffaa485db213 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:22.175154 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 610/1233] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:32:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:32:22.182535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd32c7-f00c-418f-a3f9-c22d13f347f5 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:22.182535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd32c7-f00c-418f-a3f9-c22d13f347f5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:22.182535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd32c7-f00c-418f-a3f9-c22d13f347f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:22.199397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-80fd32c7-f00c-418f-a3f9-c22d13f347f5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:32:22.200603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-80fd32c7-f00c-418f-a3f9-c22d13f347f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:32:22.271389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 624/1234] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:32:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:32:22.297450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc349e-b953-4b22-8227-ffaa485db213 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:22.405068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc349e-b953-4b22-8227-ffaa485db213 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:22.441685 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64821462-db7d-4ebb-877d-9088a0c46e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:22.442408 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64821462-db7d-4ebb-877d-9088a0c46e5f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:22.442712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64821462-db7d-4ebb-877d-9088a0c46e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:22.442992 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64821462-db7d-4ebb-877d-9088a0c46e5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:22.453754 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64821462-db7d-4ebb-877d-9088a0c46e5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-64821462-db7d-4ebb-877d-9088a0c46e5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:32:22.462234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:22.463228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:22.464115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:22.464115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:22.464115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:22.464115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:22.464115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:32:22.464115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:32:22.464115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:32:22.464115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:32:22.464115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:32:22.464115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:32:22.464115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 17:32:22.464115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:22.464115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 611/1235] 10.222.0.76 () {56 vars in 1102 bytes} [Thu May 12 17:32:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:22.470534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd32c7-f00c-418f-a3f9-c22d13f347f5 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:22.601942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd32c7-f00c-418f-a3f9-c22d13f347f5 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:22.646364 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf999c-12eb-4139-bbe2-0025e9958c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:22.647255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf999c-12eb-4139-bbe2-0025e9958c8b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:22.647536 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf999c-12eb-4139-bbe2-0025e9958c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:22.647811 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf999c-12eb-4139-bbe2-0025e9958c8b None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:22.648905 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf999c-12eb-4139-bbe2-0025e9958c8b None admin] RBAC: Adding query filter params (name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:22.649290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf999c-12eb-4139-bbe2-0025e9958c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:22.650888 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf999c-12eb-4139-bbe2-0025e9958c8b None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:22.666918 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 625/1236] 10.222.0.76 () {56 vars in 1103 bytes} [Thu May 12 17:32:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:22.672574 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64821462-db7d-4ebb-877d-9088a0c46e5f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:22.820055 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64821462-db7d-4ebb-877d-9088a0c46e5f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:22.863785 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566e6b7-91ca-4b64-8631-aa94412c03d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:22.864577 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566e6b7-91ca-4b64-8631-aa94412c03d1 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:22.864859 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566e6b7-91ca-4b64-8631-aa94412c03d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:22.865133 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566e6b7-91ca-4b64-8631-aa94412c03d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:22.878243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566e6b7-91ca-4b64-8631-aa94412c03d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:22.879720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566e6b7-91ca-4b64-8631-aa94412c03d1 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-d566e6b7-91ca-4b64-8631-aa94412c03d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:32:22.905505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:22.907749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:22.908802 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:32:22.908802 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:32:22.908802 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:22.908802 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:22.908802 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 612/1237] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 17:32:22.914569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf999c-12eb-4139-bbe2-0025e9958c8b None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:23.029440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf999c-12eb-4139-bbe2-0025e9958c8b None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:23.073396 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d2c32-3c36-4e9d-9df0-981d0c4f6032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:23.073976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d2c32-3c36-4e9d-9df0-981d0c4f6032 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:23.074252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d2c32-3c36-4e9d-9df0-981d0c4f6032 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:23.074524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d2c32-3c36-4e9d-9df0-981d0c4f6032 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:23.075278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d2c32-3c36-4e9d-9df0-981d0c4f6032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:23.075568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d2c32-3c36-4e9d-9df0-981d0c4f6032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:23.076938 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d2c32-3c36-4e9d-9df0-981d0c4f6032 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:23.096946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 626/1238] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:23.103104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566e6b7-91ca-4b64-8631-aa94412c03d1 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:23.231103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566e6b7-91ca-4b64-8631-aa94412c03d1 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:23.281321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7733fe-6157-44eb-afdf-a5c4d0075ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:23.282606 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7733fe-6157-44eb-afdf-a5c4d0075ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:23.282976 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7733fe-6157-44eb-afdf-a5c4d0075ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:23.283404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7733fe-6157-44eb-afdf-a5c4d0075ec6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:23.292753 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7733fe-6157-44eb-afdf-a5c4d0075ec6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:23.294536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7733fe-6157-44eb-afdf-a5c4d0075ec6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-de7733fe-6157-44eb-afdf-a5c4d0075ec6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:32:23.312448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:23.313620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:23.314656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:23.314656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:23.314656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:32:23.314656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:32:23.314656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:32:23.314656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:32:23.314656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:32:23.314656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:32:23.314656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 17:32:23.314656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:23.314656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 613/1239] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:23.321141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d2c32-3c36-4e9d-9df0-981d0c4f6032 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:23.429131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d2c32-3c36-4e9d-9df0-981d0c4f6032 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:23.465625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4dff2-4f78-4369-b39a-1ebac9ee1e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:23.466278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4dff2-4f78-4369-b39a-1ebac9ee1e13 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:23.466561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4dff2-4f78-4369-b39a-1ebac9ee1e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:23.466857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4dff2-4f78-4369-b39a-1ebac9ee1e13 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:23.467699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4dff2-4f78-4369-b39a-1ebac9ee1e13 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:23.468607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4dff2-4f78-4369-b39a-1ebac9ee1e13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:23.470167 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4dff2-4f78-4369-b39a-1ebac9ee1e13 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:23.489737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 627/1240] 10.222.0.76 () {56 vars in 1143 bytes} [Thu May 12 17:32:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:23.495860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7733fe-6157-44eb-afdf-a5c4d0075ec6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:23.612578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7733fe-6157-44eb-afdf-a5c4d0075ec6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:23.651741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cb628-6f56-4516-bb8f-da64e0cc638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:23.652381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cb628-6f56-4516-bb8f-da64e0cc638e None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:23.652662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cb628-6f56-4516-bb8f-da64e0cc638e None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:23.652939 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cb628-6f56-4516-bb8f-da64e0cc638e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:23.747903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cb628-6f56-4516-bb8f-da64e0cc638e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:23.750903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cb628-6f56-4516-bb8f-da64e0cc638e None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:23.865785 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 614/1241] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:32:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:32:23.867495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4dff2-4f78-4369-b39a-1ebac9ee1e13 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:23.995968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4dff2-4f78-4369-b39a-1ebac9ee1e13 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:24.028840 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03ce32-0ea8-44a0-bae5-2939797bc6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:24.029556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03ce32-0ea8-44a0-bae5-2939797bc6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:24.029834 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03ce32-0ea8-44a0-bae5-2939797bc6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:24.030102 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03ce32-0ea8-44a0-bae5-2939797bc6f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:24.041946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03ce32-0ea8-44a0-bae5-2939797bc6f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:24.043557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03ce32-0ea8-44a0-bae5-2939797bc6f3 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-7e03ce32-0ea8-44a0-bae5-2939797bc6f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:32:24.062344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:24.063376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:24.064288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:32:24.064288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:32:24.064288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:24.064288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:24.064288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 628/1242] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:24.069819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cb628-6f56-4516-bb8f-da64e0cc638e None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:24.177730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cb628-6f56-4516-bb8f-da64e0cc638e None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:24.212763 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a0861-4011-446b-abcc-298ef2cc7414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:24.213420 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0861-4011-446b-abcc-298ef2cc7414 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:24.213700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0861-4011-446b-abcc-298ef2cc7414 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:24.213969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0861-4011-446b-abcc-298ef2cc7414 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:24.214701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a0861-4011-446b-abcc-298ef2cc7414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:24.215001 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a0861-4011-446b-abcc-298ef2cc7414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:24.216379 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a0861-4011-446b-abcc-298ef2cc7414 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:24.228035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 615/1243] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:32:24.234245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03ce32-0ea8-44a0-bae5-2939797bc6f3 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:24.342841 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03ce32-0ea8-44a0-bae5-2939797bc6f3 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:24.380434 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e49933-b974-48d4-a4c8-ace2b17928ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:24.381221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e49933-b974-48d4-a4c8-ace2b17928ae None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:24.381496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e49933-b974-48d4-a4c8-ace2b17928ae None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:24.381773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e49933-b974-48d4-a4c8-ace2b17928ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:24.388748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e49933-b974-48d4-a4c8-ace2b17928ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:24.390699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e49933-b974-48d4-a4c8-ace2b17928ae None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-83e49933-b974-48d4-a4c8-ace2b17928ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:32:24.407010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:24.408151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:24.409086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:32:24.409086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:32:24.409086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:32:24.409086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:32:24.409086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:32:24.409086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:32:24.409086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:32:24.409086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:24.409086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 629/1244] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:32:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:24.415023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a0861-4011-446b-abcc-298ef2cc7414 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:24.525428 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a0861-4011-446b-abcc-298ef2cc7414 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:24.561100 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731fe1d-a144-4e4a-880e-47e2d01582f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:24.562512 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731fe1d-a144-4e4a-880e-47e2d01582f2 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:24.562866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731fe1d-a144-4e4a-880e-47e2d01582f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:24.563150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731fe1d-a144-4e4a-880e-47e2d01582f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:24.564015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731fe1d-a144-4e4a-880e-47e2d01582f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:24.564327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731fe1d-a144-4e4a-880e-47e2d01582f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:24.565902 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731fe1d-a144-4e4a-880e-47e2d01582f2 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:24.580064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 616/1245] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:32:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:24.586546 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e49933-b974-48d4-a4c8-ace2b17928ae None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:24.698072 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e49933-b974-48d4-a4c8-ace2b17928ae None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:24.739555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f95fd-08e2-422e-9428-701f414d5fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:24.740276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f95fd-08e2-422e-9428-701f414d5fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:24.740554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f95fd-08e2-422e-9428-701f414d5fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:24.740832 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f95fd-08e2-422e-9428-701f414d5fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:24.741660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f95fd-08e2-422e-9428-701f414d5fe1 None admin] RBAC: Adding query filter params (role.id=511b62180d4c4881999e65dfab877783, scope.project.id=745af7d676704a179668d6685724ed78, user.id=a01fa037b14c456eb533b5a86da0a370) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:24.741972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f95fd-08e2-422e-9428-701f414d5fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:24.743444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f95fd-08e2-422e-9428-701f414d5fe1 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:24.750288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 630/1246] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:32:24 2022] GET /identity/v3/role_assignments?user.id=a01fa037b14c456eb533b5a86da0a370&scope.project.id=745af7d676704a179668d6685724ed78&role.id=511b62180d4c4881999e65dfab877783 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:27.159335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90dcbf-b9b3-457c-bef0-5f5f31dbe1eb None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:27.160034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90dcbf-b9b3-457c-bef0-5f5f31dbe1eb None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:27.160034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90dcbf-b9b3-457c-bef0-5f5f31dbe1eb None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:27.161435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 617/1247] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:32:27.167340 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386038b-d9fe-4873-879b-4d72d1b63c98 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:27.167804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386038b-d9fe-4873-879b-4d72d1b63c98 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:27.168009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386038b-d9fe-4873-879b-4d72d1b63c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:27.185974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-b386038b-d9fe-4873-879b-4d72d1b63c98 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:32:27.187900 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b386038b-d9fe-4873-879b-4d72d1b63c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:32:27.264127 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 631/1248] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:32:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:32:27.290142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90dcbf-b9b3-457c-bef0-5f5f31dbe1eb None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:27.401155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90dcbf-b9b3-457c-bef0-5f5f31dbe1eb None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:27.438313 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31ea16-5b20-4ba3-b454-e9ee569fd0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:27.439155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31ea16-5b20-4ba3-b454-e9ee569fd0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:27.439383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31ea16-5b20-4ba3-b454-e9ee569fd0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:27.439664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31ea16-5b20-4ba3-b454-e9ee569fd0e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:27.450289 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31ea16-5b20-4ba3-b454-e9ee569fd0e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-eb31ea16-5b20-4ba3-b454-e9ee569fd0e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:32:27.459198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:27.460394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:27.461666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:27.461666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:27.461666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:27.461666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:27.461666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:32:27.461666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:32:27.461666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:32:27.461666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:32:27.461666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:32:27.461666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:32:27.461666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:32:27.461666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:27.461666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 618/1249] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:32:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:27.466973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386038b-d9fe-4873-879b-4d72d1b63c98 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:27.576683 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386038b-d9fe-4873-879b-4d72d1b63c98 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:27.612707 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6420eed-d39a-4cff-8515-ea35a3e5f9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:27.613449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6420eed-d39a-4cff-8515-ea35a3e5f9ef None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:27.613868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6420eed-d39a-4cff-8515-ea35a3e5f9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:27.614167 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6420eed-d39a-4cff-8515-ea35a3e5f9ef None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:27.615006 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6420eed-d39a-4cff-8515-ea35a3e5f9ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:27.615316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6420eed-d39a-4cff-8515-ea35a3e5f9ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:27.616692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6420eed-d39a-4cff-8515-ea35a3e5f9ef None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:27.630740 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 632/1250] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:32:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:27.632432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31ea16-5b20-4ba3-b454-e9ee569fd0e3 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:27.745461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31ea16-5b20-4ba3-b454-e9ee569fd0e3 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:27.785809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da68495-1898-4118-9d05-2a2a0399c3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:27.786781 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da68495-1898-4118-9d05-2a2a0399c3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:27.787064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da68495-1898-4118-9d05-2a2a0399c3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:27.787343 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da68495-1898-4118-9d05-2a2a0399c3e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:27.800406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da68495-1898-4118-9d05-2a2a0399c3e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:27.801854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da68495-1898-4118-9d05-2a2a0399c3e3 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-8da68495-1898-4118-9d05-2a2a0399c3e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:32:27.821656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:27.822691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:27.824274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:32:27.824274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:32:27.824274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:27.824274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:27.824274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 619/1251] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:27.828814 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6420eed-d39a-4cff-8515-ea35a3e5f9ef None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:27.929410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6420eed-d39a-4cff-8515-ea35a3e5f9ef None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:27.964251 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d891d9e-2e3f-476f-9cd1-a6af75caa900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:27.964924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d891d9e-2e3f-476f-9cd1-a6af75caa900 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:27.965199 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d891d9e-2e3f-476f-9cd1-a6af75caa900 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:27.965505 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d891d9e-2e3f-476f-9cd1-a6af75caa900 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:27.966198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d891d9e-2e3f-476f-9cd1-a6af75caa900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:27.966498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d891d9e-2e3f-476f-9cd1-a6af75caa900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:27.967946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d891d9e-2e3f-476f-9cd1-a6af75caa900 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:27.979985 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 633/1252] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:27.986557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da68495-1898-4118-9d05-2a2a0399c3e3 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:28.095279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da68495-1898-4118-9d05-2a2a0399c3e3 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:28.130720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b450f-3927-4a12-b959-c24bbe2f4d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:28.131523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b450f-3927-4a12-b959-c24bbe2f4d37 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:28.131829 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b450f-3927-4a12-b959-c24bbe2f4d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:28.132085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b450f-3927-4a12-b959-c24bbe2f4d37 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:28.140350 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b450f-3927-4a12-b959-c24bbe2f4d37 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:28.141914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b450f-3927-4a12-b959-c24bbe2f4d37 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-930b450f-3927-4a12-b959-c24bbe2f4d37 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:32:28.156786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:28.157804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:28.158793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:28.158793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:28.158793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:32:28.158793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:32:28.158793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:32:28.158793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:32:28.158793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:32:28.158793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:32:28.158793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 17:32:28.158793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:28.158793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 620/1253] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:28.164035 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d891d9e-2e3f-476f-9cd1-a6af75caa900 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:28.277405 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d891d9e-2e3f-476f-9cd1-a6af75caa900 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:28.318118 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99d8a1-a26a-498d-bef6-de0d6ba4a7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:28.318747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99d8a1-a26a-498d-bef6-de0d6ba4a7ea None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:28.319037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99d8a1-a26a-498d-bef6-de0d6ba4a7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:28.319310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99d8a1-a26a-498d-bef6-de0d6ba4a7ea None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:28.320229 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99d8a1-a26a-498d-bef6-de0d6ba4a7ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:28.320502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99d8a1-a26a-498d-bef6-de0d6ba4a7ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:28.322126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99d8a1-a26a-498d-bef6-de0d6ba4a7ea None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:28.347342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 634/1254] 10.222.0.76 () {56 vars in 1143 bytes} [Thu May 12 17:32:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:28.353191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b450f-3927-4a12-b959-c24bbe2f4d37 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:28.464219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b450f-3927-4a12-b959-c24bbe2f4d37 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:28.499405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839548cf-8d61-4cd7-9812-758b456eb36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:28.500084 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839548cf-8d61-4cd7-9812-758b456eb36a None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:28.500558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839548cf-8d61-4cd7-9812-758b456eb36a None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:28.500793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839548cf-8d61-4cd7-9812-758b456eb36a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:28.571489 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839548cf-8d61-4cd7-9812-758b456eb36a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:28.572950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839548cf-8d61-4cd7-9812-758b456eb36a None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:28.678335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 621/1255] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:32:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:32:28.684539 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99d8a1-a26a-498d-bef6-de0d6ba4a7ea None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:28.801623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99d8a1-a26a-498d-bef6-de0d6ba4a7ea None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:28.837773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362530df-bd13-4e9f-bf25-02e3aad6a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:28.838710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362530df-bd13-4e9f-bf25-02e3aad6a8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:28.839025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362530df-bd13-4e9f-bf25-02e3aad6a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:28.839320 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362530df-bd13-4e9f-bf25-02e3aad6a8e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:28.850759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362530df-bd13-4e9f-bf25-02e3aad6a8e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:28.852418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362530df-bd13-4e9f-bf25-02e3aad6a8e9 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-362530df-bd13-4e9f-bf25-02e3aad6a8e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:32:28.871367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:28.872779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:28.873696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:32:28.873696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:32:28.873696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:28.873696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:28.873696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 635/1256] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:28.879091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839548cf-8d61-4cd7-9812-758b456eb36a None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:28.987857 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839548cf-8d61-4cd7-9812-758b456eb36a None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:29.029047 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd301a23-8f8f-4478-8775-9c5c5bd4d497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:29.029877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301a23-8f8f-4478-8775-9c5c5bd4d497 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:29.030152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301a23-8f8f-4478-8775-9c5c5bd4d497 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:29.030492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301a23-8f8f-4478-8775-9c5c5bd4d497 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:29.031953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd301a23-8f8f-4478-8775-9c5c5bd4d497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:29.032262 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd301a23-8f8f-4478-8775-9c5c5bd4d497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:29.033695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd301a23-8f8f-4478-8775-9c5c5bd4d497 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:29.046727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 622/1257] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:32:29.052824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362530df-bd13-4e9f-bf25-02e3aad6a8e9 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:29.158054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362530df-bd13-4e9f-bf25-02e3aad6a8e9 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:29.194038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8120d3-07b4-41c5-bb56-b133f43a900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:29.194862 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8120d3-07b4-41c5-bb56-b133f43a900a None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:29.195140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8120d3-07b4-41c5-bb56-b133f43a900a None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:29.195412 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8120d3-07b4-41c5-bb56-b133f43a900a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:29.202894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8120d3-07b4-41c5-bb56-b133f43a900a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:29.204370 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8120d3-07b4-41c5-bb56-b133f43a900a None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-bc8120d3-07b4-41c5-bb56-b133f43a900a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:32:29.219437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:29.220555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:29.221493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:32:29.221493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:32:29.221493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:32:29.221493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:32:29.221493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:32:29.221493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:32:29.221493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:32:29.221493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:29.221493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 636/1258] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:32:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:29.226797 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd301a23-8f8f-4478-8775-9c5c5bd4d497 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:29.329446 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd301a23-8f8f-4478-8775-9c5c5bd4d497 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:29.363048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9997efd-b5f6-4777-a014-276ca4382713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:29.363717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997efd-b5f6-4777-a014-276ca4382713 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:29.363997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997efd-b5f6-4777-a014-276ca4382713 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:29.364286 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997efd-b5f6-4777-a014-276ca4382713 None admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:29.365085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9997efd-b5f6-4777-a014-276ca4382713 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:29.365390 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9997efd-b5f6-4777-a014-276ca4382713 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:29.366949 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9997efd-b5f6-4777-a014-276ca4382713 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:29.385457 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 623/1259] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:32:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:29.387069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8120d3-07b4-41c5-bb56-b133f43a900a None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:29.487831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8120d3-07b4-41c5-bb56-b133f43a900a None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:29.522112 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52905fed-7563-479d-ae70-7f7262b48195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:29.522707 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52905fed-7563-479d-ae70-7f7262b48195 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:29.522992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52905fed-7563-479d-ae70-7f7262b48195 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:29.523264 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52905fed-7563-479d-ae70-7f7262b48195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:29.524094 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52905fed-7563-479d-ae70-7f7262b48195 None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=745af7d676704a179668d6685724ed78, user.id=a01fa037b14c456eb533b5a86da0a370) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:29.524402 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52905fed-7563-479d-ae70-7f7262b48195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:29.525833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52905fed-7563-479d-ae70-7f7262b48195 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:29.531538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 637/1260] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:32:29 2022] GET /identity/v3/role_assignments?user.id=a01fa037b14c456eb533b5a86da0a370&scope.project.id=745af7d676704a179668d6685724ed78&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:31.776679 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14d7f3-b615-434c-8906-ca762e40b945 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:31.777215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14d7f3-b615-434c-8906-ca762e40b945 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:31.777215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14d7f3-b615-434c-8906-ca762e40b945 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:31.778594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 624/1261] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:32:31.784008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b47c37-3397-4a79-a8ba-bcded349a8a6 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:31.784413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b47c37-3397-4a79-a8ba-bcded349a8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:31.784561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b47c37-3397-4a79-a8ba-bcded349a8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:31.800838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-09b47c37-3397-4a79-a8ba-bcded349a8a6 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:32:31.802009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-09b47c37-3397-4a79-a8ba-bcded349a8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:32:31.864898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 638/1262] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:32:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:32:31.888006 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14d7f3-b615-434c-8906-ca762e40b945 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:31.985155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14d7f3-b615-434c-8906-ca762e40b945 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:32.017368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ebb89-558d-4a74-bddb-dfc5e4c41846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:32.018139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ebb89-558d-4a74-bddb-dfc5e4c41846 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:32.018416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ebb89-558d-4a74-bddb-dfc5e4c41846 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:32.018706 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ebb89-558d-4a74-bddb-dfc5e4c41846 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:32.028581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ebb89-558d-4a74-bddb-dfc5e4c41846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-287ebb89-558d-4a74-bddb-dfc5e4c41846 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:32:32.036243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:32.037362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:32.038425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:32.038425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:32.038425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:32.038425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:32.038425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:32:32.038425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:32:32.038425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:32:32.038425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:32:32.038425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:32:32.038425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:32:32.038425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:32:32.038425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:32.038425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 625/1263] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:32:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:32.043350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b47c37-3397-4a79-a8ba-bcded349a8a6 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:32.144134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b47c37-3397-4a79-a8ba-bcded349a8a6 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:32.177655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069ac5e-0767-4cb5-82ff-277de33520fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:32.178323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069ac5e-0767-4cb5-82ff-277de33520fb None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:32.178658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069ac5e-0767-4cb5-82ff-277de33520fb None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:32.178961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069ac5e-0767-4cb5-82ff-277de33520fb None admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:32.179699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069ac5e-0767-4cb5-82ff-277de33520fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:32.180003 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069ac5e-0767-4cb5-82ff-277de33520fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:32.181358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069ac5e-0767-4cb5-82ff-277de33520fb None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:32.190133 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 639/1264] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:32:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:32.196034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ebb89-558d-4a74-bddb-dfc5e4c41846 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:32.295657 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ebb89-558d-4a74-bddb-dfc5e4c41846 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:32.328934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f66b9-2b98-452f-8789-30af3b94f437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:32.329716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f66b9-2b98-452f-8789-30af3b94f437 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:32.329997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f66b9-2b98-452f-8789-30af3b94f437 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:32.330269 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f66b9-2b98-452f-8789-30af3b94f437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:32.340371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f66b9-2b98-452f-8789-30af3b94f437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:32.341810 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f66b9-2b98-452f-8789-30af3b94f437 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-ae0f66b9-2b98-452f-8789-30af3b94f437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:32:32.358188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:32.359284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:32.360279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:32:32.360279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:32:32.360279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:32.360279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:32.360279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 626/1265] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:32.365127 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069ac5e-0767-4cb5-82ff-277de33520fb None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:32.461082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069ac5e-0767-4cb5-82ff-277de33520fb None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:32.493190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece585d7-4379-455f-98e9-8255a457af36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:32.493833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece585d7-4379-455f-98e9-8255a457af36 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:32.494111 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece585d7-4379-455f-98e9-8255a457af36 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:32.494383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece585d7-4379-455f-98e9-8255a457af36 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:32.495129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece585d7-4379-455f-98e9-8255a457af36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:32.495435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece585d7-4379-455f-98e9-8255a457af36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:32.496787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece585d7-4379-455f-98e9-8255a457af36 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:32.507896 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 640/1266] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:32.513767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f66b9-2b98-452f-8789-30af3b94f437 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:32.610928 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f66b9-2b98-452f-8789-30af3b94f437 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:32.651602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0505c4-83ba-4add-b5d9-25bbce68e5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:32.652384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0505c4-83ba-4add-b5d9-25bbce68e5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:32.652661 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0505c4-83ba-4add-b5d9-25bbce68e5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:32.652931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0505c4-83ba-4add-b5d9-25bbce68e5e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:32.660097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0505c4-83ba-4add-b5d9-25bbce68e5e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:32.661530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0505c4-83ba-4add-b5d9-25bbce68e5e5 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-3e0505c4-83ba-4add-b5d9-25bbce68e5e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:32:32.675882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:32.676990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:32.682927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:32.682927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:32.682927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:32:32.682927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:32:32.682927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:32:32.682927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:32:32.682927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:32:32.682927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:32:32.682927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 17:32:32.682927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:32.682927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 627/1267] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:32.683688 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece585d7-4379-455f-98e9-8255a457af36 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:32.793998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece585d7-4379-455f-98e9-8255a457af36 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:32.825646 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8422036-8d08-4f6d-82aa-e4b580e366c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:32.826304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8422036-8d08-4f6d-82aa-e4b580e366c2 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:32.826584 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8422036-8d08-4f6d-82aa-e4b580e366c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:32.826887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8422036-8d08-4f6d-82aa-e4b580e366c2 None admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:32.828474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8422036-8d08-4f6d-82aa-e4b580e366c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:32.828781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8422036-8d08-4f6d-82aa-e4b580e366c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:32.830204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8422036-8d08-4f6d-82aa-e4b580e366c2 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:32.846797 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 641/1268] 10.222.0.76 () {56 vars in 1143 bytes} [Thu May 12 17:32:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:32.852387 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0505c4-83ba-4add-b5d9-25bbce68e5e5 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:32.951640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0505c4-83ba-4add-b5d9-25bbce68e5e5 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:32.995155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee4f82-1f91-4195-a6d5-bc3410fb5452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:32.995924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee4f82-1f91-4195-a6d5-bc3410fb5452 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:32.996209 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee4f82-1f91-4195-a6d5-bc3410fb5452 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:32.996481 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee4f82-1f91-4195-a6d5-bc3410fb5452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:33.010940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee4f82-1f91-4195-a6d5-bc3410fb5452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:33.012388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee4f82-1f91-4195-a6d5-bc3410fb5452 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-3fee4f82-1f91-4195-a6d5-bc3410fb5452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:32:33.029701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:33.030889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:33.031870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:32:33.031870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:32:33.031870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:33.031870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:33.031870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 628/1269] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:33.036767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8422036-8d08-4f6d-82aa-e4b580e366c2 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:33.129947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8422036-8d08-4f6d-82aa-e4b580e366c2 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:33.162082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeccb4-04d0-4c47-9ffa-3cd9af0873ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:33.162751 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeccb4-04d0-4c47-9ffa-3cd9af0873ca None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:33.163033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeccb4-04d0-4c47-9ffa-3cd9af0873ca None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:33.163309 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeccb4-04d0-4c47-9ffa-3cd9af0873ca None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:33.164022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeccb4-04d0-4c47-9ffa-3cd9af0873ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:33.164327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeccb4-04d0-4c47-9ffa-3cd9af0873ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:33.165698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeccb4-04d0-4c47-9ffa-3cd9af0873ca None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:33.176485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 642/1270] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:33.182025 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee4f82-1f91-4195-a6d5-bc3410fb5452 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:33.278720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee4f82-1f91-4195-a6d5-bc3410fb5452 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:33.310097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4345cb1-b9cd-47f8-b67e-b34407204ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:33.310916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4345cb1-b9cd-47f8-b67e-b34407204ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:33.311189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4345cb1-b9cd-47f8-b67e-b34407204ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:33.311456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4345cb1-b9cd-47f8-b67e-b34407204ed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:33.319013 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4345cb1-b9cd-47f8-b67e-b34407204ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:33.320435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4345cb1-b9cd-47f8-b67e-b34407204ed6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-a4345cb1-b9cd-47f8-b67e-b34407204ed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:32:33.335015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:33.336046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:33.337274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:32:33.337274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:32:33.337274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:32:33.337274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:32:33.337274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:32:33.337274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:32:33.337274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:32:33.337274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:33.337274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 629/1271] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:32:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:33.341972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeccb4-04d0-4c47-9ffa-3cd9af0873ca None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:33.436648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeccb4-04d0-4c47-9ffa-3cd9af0873ca None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:33.468669 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6b13c-232f-4b95-835c-9fae3b8cec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:33.469354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6b13c-232f-4b95-835c-9fae3b8cec0f None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:33.469626 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6b13c-232f-4b95-835c-9fae3b8cec0f None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:33.469893 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6b13c-232f-4b95-835c-9fae3b8cec0f None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:33.470716 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6b13c-232f-4b95-835c-9fae3b8cec0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:33.471081 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6b13c-232f-4b95-835c-9fae3b8cec0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:33.472499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6b13c-232f-4b95-835c-9fae3b8cec0f None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:33.484600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 643/1272] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:32:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:33.491216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4345cb1-b9cd-47f8-b67e-b34407204ed6 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:33.585424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4345cb1-b9cd-47f8-b67e-b34407204ed6 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:33.617275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc82dd-eacb-475c-bd27-a8c590b746a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:33.618142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc82dd-eacb-475c-bd27-a8c590b746a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:33.618419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc82dd-eacb-475c-bd27-a8c590b746a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:33.618711 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc82dd-eacb-475c-bd27-a8c590b746a2 None admin] PATH_INFO: `/v3/projects/745af7d676704a179668d6685724ed78/users/a01fa037b14c456eb533b5a86da0a370/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:33.620629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc82dd-eacb-475c-bd27-a8c590b746a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=745af7d676704a179668d6685724ed78, user_id=a01fa037b14c456eb533b5a86da0a370, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:33.622050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc82dd-eacb-475c-bd27-a8c590b746a2 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:33.634567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 630/1273] 10.222.0.76 () {58 vars in 1439 bytes} [Thu May 12 17:32:33 2022] PUT /identity/v3/projects/745af7d676704a179668d6685724ed78/users/a01fa037b14c456eb533b5a86da0a370/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:32:35.865566 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6dac7-cbb9-470b-9dad-b25af5d000a2 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:35.866099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6dac7-cbb9-470b-9dad-b25af5d000a2 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:35.866099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6dac7-cbb9-470b-9dad-b25af5d000a2 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:35.867507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 644/1274] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:32:35.872756 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639474a2-4341-482a-aaa3-a0a2e1f2574a None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:35.873165 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639474a2-4341-482a-aaa3-a0a2e1f2574a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:35.873299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639474a2-4341-482a-aaa3-a0a2e1f2574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:35.890755 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-639474a2-4341-482a-aaa3-a0a2e1f2574a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:32:35.892267 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-639474a2-4341-482a-aaa3-a0a2e1f2574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:32:35.955138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 631/1275] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:32:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:32:35.979357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6dac7-cbb9-470b-9dad-b25af5d000a2 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:36.078279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6dac7-cbb9-470b-9dad-b25af5d000a2 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:36.110187 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fadd9a-b2ef-44fa-b734-57f859dc4d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:36.110983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fadd9a-b2ef-44fa-b734-57f859dc4d4b None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:36.111262 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fadd9a-b2ef-44fa-b734-57f859dc4d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:36.111547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fadd9a-b2ef-44fa-b734-57f859dc4d4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:36.121077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fadd9a-b2ef-44fa-b734-57f859dc4d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-66fadd9a-b2ef-44fa-b734-57f859dc4d4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 17:32:36.129011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:36.130116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:36.131418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:36.131418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:36.131418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:36.131418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:36.131418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 17:32:36.131418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 17:32:36.131418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 17:32:36.131418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 17:32:36.131418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 17:32:36.131418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 17:32:36.131418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 17:32:36.131418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:36.131418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 645/1276] 10.222.0.76 () {56 vars in 1096 bytes} [Thu May 12 17:32:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:36.136136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639474a2-4341-482a-aaa3-a0a2e1f2574a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:36.230169 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639474a2-4341-482a-aaa3-a0a2e1f2574a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:36.263355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e967fb-75b1-4fd3-9206-3134901166cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:36.264012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e967fb-75b1-4fd3-9206-3134901166cb None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:36.264295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e967fb-75b1-4fd3-9206-3134901166cb None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:36.264568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e967fb-75b1-4fd3-9206-3134901166cb None admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:36.265308 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e967fb-75b1-4fd3-9206-3134901166cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:36.265609 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e967fb-75b1-4fd3-9206-3134901166cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:36.267191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e967fb-75b1-4fd3-9206-3134901166cb None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:36.274964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 632/1277] 10.222.0.76 () {56 vars in 1099 bytes} [Thu May 12 17:32:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:36.280607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fadd9a-b2ef-44fa-b734-57f859dc4d4b None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:36.382312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fadd9a-b2ef-44fa-b734-57f859dc4d4b None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:36.413421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff35ee-b8c0-4fdc-9377-265d3cf619a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:36.414191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff35ee-b8c0-4fdc-9377-265d3cf619a4 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:36.414466 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff35ee-b8c0-4fdc-9377-265d3cf619a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:36.414761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff35ee-b8c0-4fdc-9377-265d3cf619a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:36.425393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff35ee-b8c0-4fdc-9377-265d3cf619a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:36.426855 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff35ee-b8c0-4fdc-9377-265d3cf619a4 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-abff35ee-b8c0-4fdc-9377-265d3cf619a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:32:36.443611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:36.444655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:36.445665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:32:36.445665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:32:36.445665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:36.445665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:36.445665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 646/1278] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:36.450519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e967fb-75b1-4fd3-9206-3134901166cb None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:36.554700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e967fb-75b1-4fd3-9206-3134901166cb None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:36.586461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed2ae3-5797-421e-9f42-4cf1d4e92cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:36.587126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed2ae3-5797-421e-9f42-4cf1d4e92cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:36.587401 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed2ae3-5797-421e-9f42-4cf1d4e92cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:36.587667 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed2ae3-5797-421e-9f42-4cf1d4e92cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:36.588370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed2ae3-5797-421e-9f42-4cf1d4e92cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:36.588666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed2ae3-5797-421e-9f42-4cf1d4e92cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:36.590006 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed2ae3-5797-421e-9f42-4cf1d4e92cf1 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:36.601950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 633/1279] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:36.607775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff35ee-b8c0-4fdc-9377-265d3cf619a4 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:36.706897 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff35ee-b8c0-4fdc-9377-265d3cf619a4 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:36.746191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4caa03-d3e4-4825-9273-5273bffcad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:36.747156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4caa03-d3e4-4825-9273-5273bffcad17 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:36.747410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4caa03-d3e4-4825-9273-5273bffcad17 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:36.747691 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4caa03-d3e4-4825-9273-5273bffcad17 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:36.756877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4caa03-d3e4-4825-9273-5273bffcad17 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:36.758428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4caa03-d3e4-4825-9273-5273bffcad17 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-2a4caa03-d3e4-4825-9273-5273bffcad17 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 17:32:36.775266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:36.776393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:36.777600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:36.777600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:36.777600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 17:32:36.777600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 17:32:36.777600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 17:32:36.777600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 17:32:36.777600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 17:32:36.777600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 17:32:36.777600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 17:32:36.777600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:36.777600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 647/1280] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:36.783578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed2ae3-5797-421e-9f42-4cf1d4e92cf1 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:36.878643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed2ae3-5797-421e-9f42-4cf1d4e92cf1 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:36.911252 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda031b-90b5-4c8b-89ae-7ac01614b0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:36.911900 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda031b-90b5-4c8b-89ae-7ac01614b0ca None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:36.912174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda031b-90b5-4c8b-89ae-7ac01614b0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:36.912441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda031b-90b5-4c8b-89ae-7ac01614b0ca None admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:36.913252 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda031b-90b5-4c8b-89ae-7ac01614b0ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:36.913550 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda031b-90b5-4c8b-89ae-7ac01614b0ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:36.914967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda031b-90b5-4c8b-89ae-7ac01614b0ca None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:36.931388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 634/1281] 10.222.0.76 () {56 vars in 1143 bytes} [Thu May 12 17:32:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:32:36.937096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4caa03-d3e4-4825-9273-5273bffcad17 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:37.031602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4caa03-d3e4-4825-9273-5273bffcad17 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:37.062944 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335cf78-9409-49bc-b7f8-98d8ed5fd3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:37.064162 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335cf78-9409-49bc-b7f8-98d8ed5fd3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:37.064445 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335cf78-9409-49bc-b7f8-98d8ed5fd3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:37.064720 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335cf78-9409-49bc-b7f8-98d8ed5fd3a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:37.127614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335cf78-9409-49bc-b7f8-98d8ed5fd3a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:37.129066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335cf78-9409-49bc-b7f8-98d8ed5fd3a6 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:37.220654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 648/1282] 10.222.0.76 () {58 vars in 1282 bytes} [Thu May 12 17:32:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 17:32:37.226373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda031b-90b5-4c8b-89ae-7ac01614b0ca None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:37.321978 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda031b-90b5-4c8b-89ae-7ac01614b0ca None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:37.353776 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ca257-69ae-4b87-b374-f751f9cbc88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:37.354572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ca257-69ae-4b87-b374-f751f9cbc88f None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:37.354892 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ca257-69ae-4b87-b374-f751f9cbc88f None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:37.355162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ca257-69ae-4b87-b374-f751f9cbc88f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:37.365252 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ca257-69ae-4b87-b374-f751f9cbc88f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:37.366693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ca257-69ae-4b87-b374-f751f9cbc88f None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-743ca257-69ae-4b87-b374-f751f9cbc88f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 17:32:37.384445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:37.385338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:37.386271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 17:32:37.386271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 17:32:37.386271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 17:32:37.386271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:37.386271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 635/1283] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:37.392042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335cf78-9409-49bc-b7f8-98d8ed5fd3a6 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:37.483968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335cf78-9409-49bc-b7f8-98d8ed5fd3a6 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:37.515771 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba97f03-df5f-4519-a172-4aeff2fb7489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:37.517001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97f03-df5f-4519-a172-4aeff2fb7489 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:37.517275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97f03-df5f-4519-a172-4aeff2fb7489 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:37.517542 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97f03-df5f-4519-a172-4aeff2fb7489 None admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:37.518248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba97f03-df5f-4519-a172-4aeff2fb7489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:37.518548 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba97f03-df5f-4519-a172-4aeff2fb7489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:37.519934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba97f03-df5f-4519-a172-4aeff2fb7489 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:37.531240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 649/1284] 10.222.0.76 () {56 vars in 1109 bytes} [Thu May 12 17:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:37.536827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ca257-69ae-4b87-b374-f751f9cbc88f None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:37.632365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ca257-69ae-4b87-b374-f751f9cbc88f None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:37.664525 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4450ab-ab66-496b-9452-e8cbf6ec2341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:37.665293 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4450ab-ab66-496b-9452-e8cbf6ec2341 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:37.665568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4450ab-ab66-496b-9452-e8cbf6ec2341 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:37.665837 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4450ab-ab66-496b-9452-e8cbf6ec2341 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:37.672188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4450ab-ab66-496b-9452-e8cbf6ec2341 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:37.673758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4450ab-ab66-496b-9452-e8cbf6ec2341 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application [None req-8b4450ab-ab66-496b-9452-e8cbf6ec2341 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 17:32:37.686877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application with Lock( May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:37.688482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:37.689990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 17:32:37.689990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 17:32:37.689990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 17:32:37.689990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 17:32:37.689990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 17:32:37.689990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 17:32:37.689990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 17:32:37.689990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: ERROR keystone.server.flask.application May 12 17:32:37.689990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 636/1285] 10.222.0.76 () {56 vars in 1111 bytes} [Thu May 12 17:32:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:37.694582 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba97f03-df5f-4519-a172-4aeff2fb7489 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:37.789253 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba97f03-df5f-4519-a172-4aeff2fb7489 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:37.820725 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7b2b3-0bdb-47cf-b5d9-3d2897795ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:37.821371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7b2b3-0bdb-47cf-b5d9-3d2897795ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:37.821647 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7b2b3-0bdb-47cf-b5d9-3d2897795ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:37.821919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7b2b3-0bdb-47cf-b5d9-3d2897795ae9 None admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:37.822716 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7b2b3-0bdb-47cf-b5d9-3d2897795ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:37.823025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7b2b3-0bdb-47cf-b5d9-3d2897795ae9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:37.824446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7b2b3-0bdb-47cf-b5d9-3d2897795ae9 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:37.836363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 650/1286] 10.222.0.76 () {56 vars in 1148 bytes} [Thu May 12 17:32:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:37.842419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4450ab-ab66-496b-9452-e8cbf6ec2341 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:37.937205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4450ab-ab66-496b-9452-e8cbf6ec2341 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:37.968683 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32088d77-6160-4c0b-b51b-007430469a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:37.970024 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32088d77-6160-4c0b-b51b-007430469a54 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:37.970410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32088d77-6160-4c0b-b51b-007430469a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:37.970709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32088d77-6160-4c0b-b51b-007430469a54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:37.971526 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32088d77-6160-4c0b-b51b-007430469a54 None admin] RBAC: Adding query filter params (role.id=771b8ab3c82647f1a1639fe61486fbe0, scope.project.id=745af7d676704a179668d6685724ed78, user.id=a01fa037b14c456eb533b5a86da0a370) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:37.971831 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32088d77-6160-4c0b-b51b-007430469a54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:37.973257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32088d77-6160-4c0b-b51b-007430469a54 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:37.978857 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 637/1287] 10.222.0.76 () {56 vars in 1374 bytes} [Thu May 12 17:32:37 2022] GET /identity/v3/role_assignments?user.id=a01fa037b14c456eb533b5a86da0a370&scope.project.id=745af7d676704a179668d6685724ed78&role.id=771b8ab3c82647f1a1639fe61486fbe0 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:40.253659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275180ea-c314-4a0f-8704-b8602f8ea5d1 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:40.254160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275180ea-c314-4a0f-8704-b8602f8ea5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:40.254251 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275180ea-c314-4a0f-8704-b8602f8ea5d1 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:40.255607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 651/1288] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:32:40.260664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112a5da-88d2-493d-a796-873440d98e05 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:40.261092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112a5da-88d2-493d-a796-873440d98e05 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:40.261217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112a5da-88d2-493d-a796-873440d98e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:40.278484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-1112a5da-88d2-493d-a796-873440d98e05 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:32:40.279700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1112a5da-88d2-493d-a796-873440d98e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:32:40.343791 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 638/1289] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:32:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:32:40.366578 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275180ea-c314-4a0f-8704-b8602f8ea5d1 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:40.463792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275180ea-c314-4a0f-8704-b8602f8ea5d1 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:40.497005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dd556-d69f-4449-a8d0-7391d2fcc608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:40.497714 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dd556-d69f-4449-a8d0-7391d2fcc608 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:40.497990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dd556-d69f-4449-a8d0-7391d2fcc608 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:40.498257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dd556-d69f-4449-a8d0-7391d2fcc608 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:40.498929 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2dd556-d69f-4449-a8d0-7391d2fcc608 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:40.500289 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2dd556-d69f-4449-a8d0-7391d2fcc608 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-1b2dd556-d69f-4449-a8d0-7391d2fcc608 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:40.512324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:40.513838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:40.515139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 652/1290] 10.222.0.76 () {56 vars in 1117 bytes} [Thu May 12 17:32:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:40.519879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112a5da-88d2-493d-a796-873440d98e05 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:40.613346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112a5da-88d2-493d-a796-873440d98e05 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:40.645836 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e023aa-49e5-4da9-bed3-4fd96bcfc384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:40.646481 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e023aa-49e5-4da9-bed3-4fd96bcfc384 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:40.646783 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e023aa-49e5-4da9-bed3-4fd96bcfc384 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:40.647057 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e023aa-49e5-4da9-bed3-4fd96bcfc384 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:40.647744 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e023aa-49e5-4da9-bed3-4fd96bcfc384 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:40.648042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e023aa-49e5-4da9-bed3-4fd96bcfc384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:40.649409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e023aa-49e5-4da9-bed3-4fd96bcfc384 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:40.654008 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 639/1291] 10.222.0.76 () {56 vars in 1116 bytes} [Thu May 12 17:32:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:32:40.660148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dd556-d69f-4449-a8d0-7391d2fcc608 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:40.778638 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dd556-d69f-4449-a8d0-7391d2fcc608 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:40.810624 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b5445-971d-46a4-b016-3e7007535356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:40.811305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b5445-971d-46a4-b016-3e7007535356 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:40.811584 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b5445-971d-46a4-b016-3e7007535356 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:40.811856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b5445-971d-46a4-b016-3e7007535356 None admin] PATH_INFO: `/v3/services` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:40.812556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b5445-971d-46a4-b016-3e7007535356 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:40.812857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b5445-971d-46a4-b016-3e7007535356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:40.815001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b5445-971d-46a4-b016-3e7007535356 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:40.819248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 653/1292] 10.222.0.76 () {56 vars in 1116 bytes} [Thu May 12 17:32:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:43.042982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75abaf-f02a-4f14-ae7d-9e2117e68202 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:43.043510 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75abaf-f02a-4f14-ae7d-9e2117e68202 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:43.043600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75abaf-f02a-4f14-ae7d-9e2117e68202 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:43.044907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 640/1293] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:32:43.051025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a57f9-ffdd-4e30-a2ef-a25bb3cada91 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:43.051442 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a57f9-ffdd-4e30-a2ef-a25bb3cada91 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:43.051560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a57f9-ffdd-4e30-a2ef-a25bb3cada91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:43.068093 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-c64a57f9-ffdd-4e30-a2ef-a25bb3cada91 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:32:43.069290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c64a57f9-ffdd-4e30-a2ef-a25bb3cada91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:32:43.133524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 654/1294] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:32:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:32:43.157508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75abaf-f02a-4f14-ae7d-9e2117e68202 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:43.253846 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75abaf-f02a-4f14-ae7d-9e2117e68202 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:43.287505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e66fa-0b1c-476f-abb2-83a6c74680f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:43.288172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e66fa-0b1c-476f-abb2-83a6c74680f0 None admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:43.288453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e66fa-0b1c-476f-abb2-83a6c74680f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:43.288725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e66fa-0b1c-476f-abb2-83a6c74680f0 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:43.289454 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e66fa-0b1c-476f-abb2-83a6c74680f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:43.290855 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e66fa-0b1c-476f-abb2-83a6c74680f0 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:43.304324 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 641/1295] 10.222.0.76 () {60 vars in 1141 bytes} [Thu May 12 17:32:43 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:32:45.557495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b5cf1-4146-474f-aba9-cfca28d2a761 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:45.558023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b5cf1-4146-474f-aba9-cfca28d2a761 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:45.558023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b5cf1-4146-474f-aba9-cfca28d2a761 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:45.559429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 655/1296] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:32:45.565592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123928b-4c1b-4e40-a404-dc004070c591 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:45.566027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123928b-4c1b-4e40-a404-dc004070c591 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:45.566145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123928b-4c1b-4e40-a404-dc004070c591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:45.582337 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-8123928b-4c1b-4e40-a404-dc004070c591 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:32:45.583551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-8123928b-4c1b-4e40-a404-dc004070c591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:32:45.651925 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 642/1297] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:32:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 17:32:45.675755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b5cf1-4146-474f-aba9-cfca28d2a761 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:45.770029 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b5cf1-4146-474f-aba9-cfca28d2a761 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:45.802275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd450da-28cc-46eb-a152-4b6c70ef1b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:45.803084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd450da-28cc-46eb-a152-4b6c70ef1b03 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:45.803365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd450da-28cc-46eb-a152-4b6c70ef1b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:45.803637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd450da-28cc-46eb-a152-4b6c70ef1b03 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:45.804276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd450da-28cc-46eb-a152-4b6c70ef1b03 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:45.805661 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd450da-28cc-46eb-a152-4b6c70ef1b03 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-6bd450da-28cc-46eb-a152-4b6c70ef1b03 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:45.817564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:45.818772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:45.819890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 656/1298] 10.222.0.76 () {56 vars in 1117 bytes} [Thu May 12 17:32:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:45.824730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123928b-4c1b-4e40-a404-dc004070c591 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:45.917278 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123928b-4c1b-4e40-a404-dc004070c591 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:45.949812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76c7dd-e51a-43d8-b592-292fd079a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:45.950462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76c7dd-e51a-43d8-b592-292fd079a259 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:45.950773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76c7dd-e51a-43d8-b592-292fd079a259 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:45.951046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76c7dd-e51a-43d8-b592-292fd079a259 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:45.951738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76c7dd-e51a-43d8-b592-292fd079a259 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:45.952042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76c7dd-e51a-43d8-b592-292fd079a259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:45.953399 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76c7dd-e51a-43d8-b592-292fd079a259 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:45.958389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 643/1299] 10.222.0.76 () {56 vars in 1116 bytes} [Thu May 12 17:32:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:32:45.964217 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd450da-28cc-46eb-a152-4b6c70ef1b03 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:46.059594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd450da-28cc-46eb-a152-4b6c70ef1b03 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:46.091423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0061c0d-8a5a-4a0b-a227-d78d321af9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:46.092049 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0061c0d-8a5a-4a0b-a227-d78d321af9ac None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:46.092324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0061c0d-8a5a-4a0b-a227-d78d321af9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:46.092591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0061c0d-8a5a-4a0b-a227-d78d321af9ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:46.093363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0061c0d-8a5a-4a0b-a227-d78d321af9ac None admin] RBAC: Adding query filter params (interface=public, service_id=bc4e023d99a14f16a04c3228f571ab80, region_id=RegionOne) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:46.093666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0061c0d-8a5a-4a0b-a227-d78d321af9ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:46.095970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0061c0d-8a5a-4a0b-a227-d78d321af9ac None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:46.100770 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 657/1300] 10.222.0.76 () {56 vars in 1251 bytes} [Thu May 12 17:32:45 2022] GET /identity/v3/endpoints?service_id=bc4e023d99a14f16a04c3228f571ab80&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:46.106325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76c7dd-e51a-43d8-b592-292fd079a259 None admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:46.202142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76c7dd-e51a-43d8-b592-292fd079a259 None admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:46.235783 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c36469-aed5-4ea3-9e4a-dfe33632f0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:46.236433 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c36469-aed5-4ea3-9e4a-dfe33632f0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:46.236721 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c36469-aed5-4ea3-9e4a-dfe33632f0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:46.236990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c36469-aed5-4ea3-9e4a-dfe33632f0e6 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:46.237664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c36469-aed5-4ea3-9e4a-dfe33632f0e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:46.239074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c36469-aed5-4ea3-9e4a-dfe33632f0e6 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:46.245915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 644/1301] 10.222.0.76 () {56 vars in 1087 bytes} [Thu May 12 17:32:46 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:32:48.473394 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfa98d-9ad2-4126-b35c-d9e1967430a3 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:48.473959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfa98d-9ad2-4126-b35c-d9e1967430a3 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:48.473959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfa98d-9ad2-4126-b35c-d9e1967430a3 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:48.475337 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 658/1302] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:32:48.480714 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae27fbd-aa4a-4f47-8b2b-5f51eaebcce8 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:48.481087 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae27fbd-aa4a-4f47-8b2b-5f51eaebcce8 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:48.481256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae27fbd-aa4a-4f47-8b2b-5f51eaebcce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:48.497493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-cae27fbd-aa4a-4f47-8b2b-5f51eaebcce8 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:32:48.498605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-cae27fbd-aa4a-4f47-8b2b-5f51eaebcce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:32:48.564032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 645/1303] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:32:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 17:32:48.587562 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfa98d-9ad2-4126-b35c-d9e1967430a3 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:48.685039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfa98d-9ad2-4126-b35c-d9e1967430a3 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:48.717234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d131b6-ad35-4474-b0b1-ee82d57fff69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:48.718014 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d131b6-ad35-4474-b0b1-ee82d57fff69 None admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:48.718292 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d131b6-ad35-4474-b0b1-ee82d57fff69 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:48.718566 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d131b6-ad35-4474-b0b1-ee82d57fff69 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:48.719381 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d131b6-ad35-4474-b0b1-ee82d57fff69 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:48.720738 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d131b6-ad35-4474-b0b1-ee82d57fff69 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application [None req-d0d131b6-ad35-4474-b0b1-ee82d57fff69 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 17:32:48.732282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 17:32:48.733513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.get_or_create( May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application with Lock( May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self._enter() May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application return self.creator() May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application created_value = creator( May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: ERROR keystone.server.flask.application May 12 17:32:48.734618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 659/1304] 10.222.0.76 () {56 vars in 1117 bytes} [Thu May 12 17:32:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 17:32:48.739825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae27fbd-aa4a-4f47-8b2b-5f51eaebcce8 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:48.835493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae27fbd-aa4a-4f47-8b2b-5f51eaebcce8 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:48.866399 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcf5f4-993d-4399-bb71-cee3fe93f322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:48.867081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcf5f4-993d-4399-bb71-cee3fe93f322 None admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:48.867364 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcf5f4-993d-4399-bb71-cee3fe93f322 None admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:48.867635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcf5f4-993d-4399-bb71-cee3fe93f322 None admin] PATH_INFO: `/v3/services` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:48.868333 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efcf5f4-993d-4399-bb71-cee3fe93f322 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:32:48.868658 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efcf5f4-993d-4399-bb71-cee3fe93f322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:48.870025 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efcf5f4-993d-4399-bb71-cee3fe93f322 None admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:48.874996 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 646/1305] 10.222.0.76 () {56 vars in 1116 bytes} [Thu May 12 17:32:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:32:48.881431 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d131b6-ad35-4474-b0b1-ee82d57fff69 None admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:32:48.975346 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d131b6-ad35-4474-b0b1-ee82d57fff69 None admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:32:49.006605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6e58f-5b9c-4796-893c-424edbaf0302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:32:49.007272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e58f-5b9c-4796-893c-424edbaf0302 None admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:32:49.007553 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e58f-5b9c-4796-893c-424edbaf0302 None admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:32:49.007828 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e58f-5b9c-4796-893c-424edbaf0302 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:32:49.008567 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6e58f-5b9c-4796-893c-424edbaf0302 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:32:49.009931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6e58f-5b9c-4796-893c-424edbaf0302 None admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:32:49.027977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 660/1306] 10.222.0.76 () {60 vars in 1144 bytes} [Thu May 12 17:32:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:33:53.300754 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0358a5b-15ac-4c4e-ba7e-2a3a5eb1a574 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:33:53.301737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0358a5b-15ac-4c4e-ba7e-2a3a5eb1a574 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:33:53.302201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0358a5b-15ac-4c4e-ba7e-2a3a5eb1a574 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:33:53.307825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 647/1307] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:33:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:33:53.309184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb02d6-2d8b-4f16-a88e-8ced39fa17c5 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:33:53.309603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb02d6-2d8b-4f16-a88e-8ced39fa17c5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:33:53.309743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb02d6-2d8b-4f16-a88e-8ced39fa17c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:33:53.381626 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-b9eb02d6-2d8b-4f16-a88e-8ced39fa17c5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:33:53.383116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b9eb02d6-2d8b-4f16-a88e-8ced39fa17c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:33:53.487037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 661/1308] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:33:53.539772 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f06aa-515b-4dbd-ab15-23bdeb23f163 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:33:53.540079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f06aa-515b-4dbd-ab15-23bdeb23f163 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:33:53.540236 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f06aa-515b-4dbd-ab15-23bdeb23f163 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:33:53.544202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 648/1309] 10.222.0.76 () {54 vars in 964 bytes} [Thu May 12 17:33:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:33:53.556783 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856bf42-13e5-458a-94ab-9c0478c2664b None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:33:53.557746 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856bf42-13e5-458a-94ab-9c0478c2664b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:33:53.558567 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856bf42-13e5-458a-94ab-9c0478c2664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:33:53.698048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-a856bf42-13e5-458a-94ab-9c0478c2664b None None] MFA Rules not processed for user `731d9124a2294b95a7cf1127e5362b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:33:53.699358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a856bf42-13e5-458a-94ab-9c0478c2664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:33:53.819737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 662/1310] 10.222.0.76 () {58 vars in 1061 bytes} [Thu May 12 17:33:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:33:53.828616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f06aa-515b-4dbd-ab15-23bdeb23f163 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:33:53.830517 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a25f06aa-515b-4dbd-ab15-23bdeb23f163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:33:53.947985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f06aa-515b-4dbd-ab15-23bdeb23f163 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:33:54.024887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c484b9f-0eb0-4693-a7ee-57bd9deb77d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:33:54.025555 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c484b9f-0eb0-4693-a7ee-57bd9deb77d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:33:54.025833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c484b9f-0eb0-4693-a7ee-57bd9deb77d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:33:54.026105 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c484b9f-0eb0-4693-a7ee-57bd9deb77d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:33:54.027904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0c484b9f-0eb0-4693-a7ee-57bd9deb77d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:33:54.142657 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c484b9f-0eb0-4693-a7ee-57bd9deb77d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:33:54.144207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c484b9f-0eb0-4693-a7ee-57bd9deb77d3 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:33:54.164261 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 649/1311] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:33:56.742920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c336c-2577-460c-8a41-785390e5d4d1 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:33:56.743438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c336c-2577-460c-8a41-785390e5d4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:33:56.743521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c336c-2577-460c-8a41-785390e5d4d1 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:33:56.745138 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 663/1312] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:33:56.750302 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434be081-f63c-42a0-a429-ed7cee8bd19d None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:33:56.750754 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434be081-f63c-42a0-a429-ed7cee8bd19d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:33:56.750886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434be081-f63c-42a0-a429-ed7cee8bd19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:33:56.840704 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-434be081-f63c-42a0-a429-ed7cee8bd19d None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:33:56.841986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-434be081-f63c-42a0-a429-ed7cee8bd19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:33:56.952277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 650/1313] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:33:56.991302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c336c-2577-460c-8a41-785390e5d4d1 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:33:56.992840 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-157c336c-2577-460c-8a41-785390e5d4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:33:57.101692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c336c-2577-460c-8a41-785390e5d4d1 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:33:57.176743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca63a5-5fd6-4e21-bbf5-7acaaeebce3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:33:57.178116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca63a5-5fd6-4e21-bbf5-7acaaeebce3a service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:33:57.178116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca63a5-5fd6-4e21-bbf5-7acaaeebce3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:33:57.178443 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca63a5-5fd6-4e21-bbf5-7acaaeebce3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:33:57.180556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-77ca63a5-5fd6-4e21-bbf5-7acaaeebce3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:33:57.304461 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca63a5-5fd6-4e21-bbf5-7acaaeebce3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:33:57.306262 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca63a5-5fd6-4e21-bbf5-7acaaeebce3a service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:33:57.327762 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 664/1314] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:33:59.897402 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1131f9-cb1a-461f-a7f9-e7df6770407e None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:33:59.897946 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1131f9-cb1a-461f-a7f9-e7df6770407e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:33:59.897946 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1131f9-cb1a-461f-a7f9-e7df6770407e None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:33:59.899368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 651/1315] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:33:59.904444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bce90-4819-4fa2-8bec-e3094c593ec8 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:33:59.904832 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bce90-4819-4fa2-8bec-e3094c593ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:33:59.905002 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bce90-4819-4fa2-8bec-e3094c593ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:33:59.967612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-499bce90-4819-4fa2-8bec-e3094c593ec8 None None] MFA Rules not processed for user `19d06ea71ae34908aab1148a210d4a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:33:59.968831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-499bce90-4819-4fa2-8bec-e3094c593ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:00.060471 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 665/1316] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:33:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:00.101495 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1131f9-cb1a-461f-a7f9-e7df6770407e None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:00.103065 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4d1131f9-cb1a-461f-a7f9-e7df6770407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:00.203718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1131f9-cb1a-461f-a7f9-e7df6770407e None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:00.275335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd836a-bdec-40c2-836b-3ca6e749fd75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:00.275977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd836a-bdec-40c2-836b-3ca6e749fd75 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:00.276257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd836a-bdec-40c2-836b-3ca6e749fd75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:00.276528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd836a-bdec-40c2-836b-3ca6e749fd75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:00.278164 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c6dd836a-bdec-40c2-836b-3ca6e749fd75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:00.383348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd836a-bdec-40c2-836b-3ca6e749fd75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:00.384791 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd836a-bdec-40c2-836b-3ca6e749fd75 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:00.404192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 652/1317] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:34:03.137819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff96a2-1171-4115-ae2c-f845d2017517 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:03.138619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff96a2-1171-4115-ae2c-f845d2017517 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:03.138619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff96a2-1171-4115-ae2c-f845d2017517 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:03.140026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 666/1318] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:03.145938 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c9483-ff3b-469b-8a00-250ac523b1a6 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:03.146368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c9483-ff3b-469b-8a00-250ac523b1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:03.146492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c9483-ff3b-469b-8a00-250ac523b1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:03.209423 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-162c9483-ff3b-469b-8a00-250ac523b1a6 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:03.210621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-162c9483-ff3b-469b-8a00-250ac523b1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:03.303572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 653/1319] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:03.349215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff96a2-1171-4115-ae2c-f845d2017517 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:03.350846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f6ff96a2-1171-4115-ae2c-f845d2017517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:03.450807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff96a2-1171-4115-ae2c-f845d2017517 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:03.519872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ca3a4-4401-41c1-be8b-305b7bd00abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:03.520515 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ca3a4-4401-41c1-be8b-305b7bd00abc service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:03.520793 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ca3a4-4401-41c1-be8b-305b7bd00abc service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:03.521065 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ca3a4-4401-41c1-be8b-305b7bd00abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:03.522733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e20ca3a4-4401-41c1-be8b-305b7bd00abc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:03.628655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ca3a4-4401-41c1-be8b-305b7bd00abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:03.630082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ca3a4-4401-41c1-be8b-305b7bd00abc service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:03.648573 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 667/1320] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:34:06.559842 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a3b4d-b71a-42f8-b37b-4756e4ba0db4 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:06.560352 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a3b4d-b71a-42f8-b37b-4756e4ba0db4 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:06.560352 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a3b4d-b71a-42f8-b37b-4756e4ba0db4 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:06.561681 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 654/1321] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:06.567671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238db95-88e1-423c-a42e-9f7e1ac45ca5 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:06.568109 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238db95-88e1-423c-a42e-9f7e1ac45ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:06.568206 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238db95-88e1-423c-a42e-9f7e1ac45ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:06.630794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-4238db95-88e1-423c-a42e-9f7e1ac45ca5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:06.631993 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4238db95-88e1-423c-a42e-9f7e1ac45ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:06.726476 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 668/1322] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:06.762767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a3b4d-b71a-42f8-b37b-4756e4ba0db4 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:06.764603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d10a3b4d-b71a-42f8-b37b-4756e4ba0db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:06.865810 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a3b4d-b71a-42f8-b37b-4756e4ba0db4 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:06.938077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bb1bd-cad2-4c96-bbe9-883307bdfaa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:06.938752 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bb1bd-cad2-4c96-bbe9-883307bdfaa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:06.939031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bb1bd-cad2-4c96-bbe9-883307bdfaa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:06.939300 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bb1bd-cad2-4c96-bbe9-883307bdfaa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:06.940946 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d41bb1bd-cad2-4c96-bbe9-883307bdfaa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:07.046388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bb1bd-cad2-4c96-bbe9-883307bdfaa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:07.048652 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bb1bd-cad2-4c96-bbe9-883307bdfaa0 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:07.067161 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 655/1323] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:34:09.371044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711c191-54cf-46b3-bfdd-f5c88aa6fd9d None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:09.371615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711c191-54cf-46b3-bfdd-f5c88aa6fd9d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:09.371615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711c191-54cf-46b3-bfdd-f5c88aa6fd9d None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:09.372975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 669/1324] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:09.379131 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ed0bc-1a48-4b07-9327-9939d3b6a52f None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:09.379618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ed0bc-1a48-4b07-9327-9939d3b6a52f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:09.379724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ed0bc-1a48-4b07-9327-9939d3b6a52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:09.443200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-e49ed0bc-1a48-4b07-9327-9939d3b6a52f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:09.444456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-e49ed0bc-1a48-4b07-9327-9939d3b6a52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:09.538842 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 656/1325] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:09.575376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711c191-54cf-46b3-bfdd-f5c88aa6fd9d None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:09.576906 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-7711c191-54cf-46b3-bfdd-f5c88aa6fd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:09.676612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711c191-54cf-46b3-bfdd-f5c88aa6fd9d None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:09.748323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4d01e-bed0-4292-8d71-6c2f3527c051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:09.748961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4d01e-bed0-4292-8d71-6c2f3527c051 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:09.749236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4d01e-bed0-4292-8d71-6c2f3527c051 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:09.749505 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4d01e-bed0-4292-8d71-6c2f3527c051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:09.751682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c1b4d01e-bed0-4292-8d71-6c2f3527c051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:09.856396 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4d01e-bed0-4292-8d71-6c2f3527c051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:09.857836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4d01e-bed0-4292-8d71-6c2f3527c051 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:09.877557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 670/1326] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:34:12.189229 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2055d28-f61a-4a22-afa9-bd02a88fadd7 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:12.189773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2055d28-f61a-4a22-afa9-bd02a88fadd7 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:12.189773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2055d28-f61a-4a22-afa9-bd02a88fadd7 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:12.191182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 657/1327] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:12.196343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cf156-f0c1-4163-9a38-67910def81ea None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:12.196786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cf156-f0c1-4163-9a38-67910def81ea None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:12.196890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cf156-f0c1-4163-9a38-67910def81ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:12.260286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ed6cf156-f0c1-4163-9a38-67910def81ea None None] MFA Rules not processed for user `19d06ea71ae34908aab1148a210d4a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:12.261518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ed6cf156-f0c1-4163-9a38-67910def81ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:12.358814 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 671/1328] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:12.397279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2055d28-f61a-4a22-afa9-bd02a88fadd7 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:12.398911 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b2055d28-f61a-4a22-afa9-bd02a88fadd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:12.499067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2055d28-f61a-4a22-afa9-bd02a88fadd7 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:12.573481 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206bef6-43fa-4d92-b89b-c90c24cb13f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:12.574132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206bef6-43fa-4d92-b89b-c90c24cb13f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:12.574411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206bef6-43fa-4d92-b89b-c90c24cb13f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:12.574708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206bef6-43fa-4d92-b89b-c90c24cb13f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:12.576338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4206bef6-43fa-4d92-b89b-c90c24cb13f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:12.681994 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206bef6-43fa-4d92-b89b-c90c24cb13f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:12.683461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206bef6-43fa-4d92-b89b-c90c24cb13f5 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:12.701301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 658/1329] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:34:15.169030 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eefb44-30e5-4d24-aadd-02e174f28e7d None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:15.169565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eefb44-30e5-4d24-aadd-02e174f28e7d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:15.169565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eefb44-30e5-4d24-aadd-02e174f28e7d None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:15.170975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 672/1330] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:15.176604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563c55-c1dd-4b23-92d0-bdbe51621091 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:15.177044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563c55-c1dd-4b23-92d0-bdbe51621091 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:15.177262 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563c55-c1dd-4b23-92d0-bdbe51621091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:15.250862 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-13563c55-c1dd-4b23-92d0-bdbe51621091 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:15.252292 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-13563c55-c1dd-4b23-92d0-bdbe51621091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:15.369102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 659/1331] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:34:15.405566 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eefb44-30e5-4d24-aadd-02e174f28e7d None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:15.407878 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c3eefb44-30e5-4d24-aadd-02e174f28e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:15.519445 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eefb44-30e5-4d24-aadd-02e174f28e7d None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:15.594553 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f6aac-3841-410a-bcb4-508cba15cbf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:15.595161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f6aac-3841-410a-bcb4-508cba15cbf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:15.595440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f6aac-3841-410a-bcb4-508cba15cbf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:15.595712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f6aac-3841-410a-bcb4-508cba15cbf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:15.597423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e18f6aac-3841-410a-bcb4-508cba15cbf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:15.710610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f6aac-3841-410a-bcb4-508cba15cbf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:15.712010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f6aac-3841-410a-bcb4-508cba15cbf0 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:15.730202 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 673/1332] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:34:18.089537 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d1088-e024-447a-944d-8ad25a127445 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:18.090089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d1088-e024-447a-944d-8ad25a127445 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:18.090089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d1088-e024-447a-944d-8ad25a127445 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:18.091505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 660/1333] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:18.097599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcbb03-df53-439e-a5e9-68c89f929e8e None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:18.098034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcbb03-df53-439e-a5e9-68c89f929e8e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:18.098159 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcbb03-df53-439e-a5e9-68c89f929e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:18.161085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-cfdcbb03-df53-439e-a5e9-68c89f929e8e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:18.162280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-cfdcbb03-df53-439e-a5e9-68c89f929e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:18.257478 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 674/1334] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:18.297370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d1088-e024-447a-944d-8ad25a127445 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:18.299149 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a46d1088-e024-447a-944d-8ad25a127445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:18.400899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d1088-e024-447a-944d-8ad25a127445 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:18.471359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910158a0-6765-4bab-9ed8-7835fd6d415e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:18.471995 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910158a0-6765-4bab-9ed8-7835fd6d415e service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:18.472272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910158a0-6765-4bab-9ed8-7835fd6d415e service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:18.472538 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910158a0-6765-4bab-9ed8-7835fd6d415e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:18.474152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-910158a0-6765-4bab-9ed8-7835fd6d415e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:18.578693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910158a0-6765-4bab-9ed8-7835fd6d415e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:18.580156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910158a0-6765-4bab-9ed8-7835fd6d415e service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:18.597870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 661/1335] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:34:21.119316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ad1c7-b4b4-4d29-aaa5-47b5b915f938 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:21.119978 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ad1c7-b4b4-4d29-aaa5-47b5b915f938 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:21.119978 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ad1c7-b4b4-4d29-aaa5-47b5b915f938 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:21.121238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 675/1336] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:21.126456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b91d97-66d3-4a70-ade5-f1a45e41fb2e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:21.126927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b91d97-66d3-4a70-ade5-f1a45e41fb2e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:21.127033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b91d97-66d3-4a70-ade5-f1a45e41fb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:21.190158 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-57b91d97-66d3-4a70-ade5-f1a45e41fb2e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:21.191382 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-57b91d97-66d3-4a70-ade5-f1a45e41fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:21.290508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 662/1337] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:21.339271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5be2e-772b-4744-8ba4-c761a973df1a None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:21.339582 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5be2e-772b-4744-8ba4-c761a973df1a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:21.339863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5be2e-772b-4744-8ba4-c761a973df1a None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:21.341270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 676/1338] 10.222.0.76 () {54 vars in 964 bytes} [Thu May 12 17:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:21.347018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653dcd4-8b13-4c62-a585-a63e7b606a5e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:21.347428 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653dcd4-8b13-4c62-a585-a63e7b606a5e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:21.347710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653dcd4-8b13-4c62-a585-a63e7b606a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:21.427664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-e653dcd4-8b13-4c62-a585-a63e7b606a5e None None] MFA Rules not processed for user `731d9124a2294b95a7cf1127e5362b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:21.428781 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-e653dcd4-8b13-4c62-a585-a63e7b606a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:21.500990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 663/1339] 10.222.0.76 () {58 vars in 1061 bytes} [Thu May 12 17:34:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:21.513561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5be2e-772b-4744-8ba4-c761a973df1a None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:21.515124 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-93f5be2e-772b-4744-8ba4-c761a973df1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:21.615794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5be2e-772b-4744-8ba4-c761a973df1a None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:21.690430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec41450-e312-418f-bb6f-3d24f48952ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:21.691035 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec41450-e312-418f-bb6f-3d24f48952ad service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:21.691318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec41450-e312-418f-bb6f-3d24f48952ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:21.691592 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec41450-e312-418f-bb6f-3d24f48952ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:21.693234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-0ec41450-e312-418f-bb6f-3d24f48952ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:21.798392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec41450-e312-418f-bb6f-3d24f48952ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:21.800058 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec41450-e312-418f-bb6f-3d24f48952ad service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:21.818098 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 677/1340] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:34:26.845640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e16900-7473-4760-adf6-b9fde5a9214d None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:26.846173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e16900-7473-4760-adf6-b9fde5a9214d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:26.846173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e16900-7473-4760-adf6-b9fde5a9214d None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:26.847522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 664/1341] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:26.852748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99e465-cb20-4701-a07e-44c35f855388 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:26.853200 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99e465-cb20-4701-a07e-44c35f855388 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:26.853296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99e465-cb20-4701-a07e-44c35f855388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:26.922822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-6b99e465-cb20-4701-a07e-44c35f855388 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:26.924023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6b99e465-cb20-4701-a07e-44c35f855388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:27.025752 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 678/1342] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:27.065774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e16900-7473-4760-adf6-b9fde5a9214d None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:27.067989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-58e16900-7473-4760-adf6-b9fde5a9214d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:27.162804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e16900-7473-4760-adf6-b9fde5a9214d None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:27.166237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7b034-7d3d-4592-9317-0dff6d07caf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:27.166911 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7b034-7d3d-4592-9317-0dff6d07caf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:27.167193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7b034-7d3d-4592-9317-0dff6d07caf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:27.167468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7b034-7d3d-4592-9317-0dff6d07caf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:27.176618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7b034-7d3d-4592-9317-0dff6d07caf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:27.178056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7b034-7d3d-4592-9317-0dff6d07caf1 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:27.187554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 665/1343] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:34:30.033949 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328efde-2002-4cc3-bc66-2d199f545b6f None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:30.034465 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328efde-2002-4cc3-bc66-2d199f545b6f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:30.034465 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328efde-2002-4cc3-bc66-2d199f545b6f None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:30.035831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 679/1344] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:30.041246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c01ad-24bf-41fe-974e-8a9e6131271f None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:30.041681 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c01ad-24bf-41fe-974e-8a9e6131271f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:30.041777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c01ad-24bf-41fe-974e-8a9e6131271f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:30.070141 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-619c01ad-24bf-41fe-974e-8a9e6131271f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:30.071276 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-619c01ad-24bf-41fe-974e-8a9e6131271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:30.146029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 666/1345] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:30.183533 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328efde-2002-4cc3-bc66-2d199f545b6f None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:30.185301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a328efde-2002-4cc3-bc66-2d199f545b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:30.198593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328efde-2002-4cc3-bc66-2d199f545b6f None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:30.202143 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f81f5-d3bf-46da-8dea-5b2d89f690f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:30.202893 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f81f5-d3bf-46da-8dea-5b2d89f690f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:30.203281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f81f5-d3bf-46da-8dea-5b2d89f690f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:30.203625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f81f5-d3bf-46da-8dea-5b2d89f690f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:30.212433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f81f5-d3bf-46da-8dea-5b2d89f690f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:30.213930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f81f5-d3bf-46da-8dea-5b2d89f690f8 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:30.223916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 680/1346] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:34:34.836291 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d68c9-3b2e-411c-a462-4ed58a99e07a None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:34.836790 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d68c9-3b2e-411c-a462-4ed58a99e07a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:34.836907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d68c9-3b2e-411c-a462-4ed58a99e07a None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:34.838214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 667/1347] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:34.843457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e505c4-4165-4882-9454-3032e1964d94 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:34.843930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e505c4-4165-4882-9454-3032e1964d94 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:34.844211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e505c4-4165-4882-9454-3032e1964d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:34.861461 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-d6e505c4-4165-4882-9454-3032e1964d94 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:34.862747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d6e505c4-4165-4882-9454-3032e1964d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:34.870636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 681/1348] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:34.909384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d68c9-3b2e-411c-a462-4ed58a99e07a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:34.919824 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d68c9-3b2e-411c-a462-4ed58a99e07a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:34.924245 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec85de-cc4a-4dc6-8f3d-809f3a017fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:34.924872 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec85de-cc4a-4dc6-8f3d-809f3a017fba service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:34.925148 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec85de-cc4a-4dc6-8f3d-809f3a017fba service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:34.925420 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec85de-cc4a-4dc6-8f3d-809f3a017fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:34.934422 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec85de-cc4a-4dc6-8f3d-809f3a017fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:34.935951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec85de-cc4a-4dc6-8f3d-809f3a017fba service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:34.945369 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 668/1349] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:34:40.390990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c1f8d-d0ca-41d0-a978-3169e96080be None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:40.392227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c1f8d-d0ca-41d0-a978-3169e96080be None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:40.392227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c1f8d-d0ca-41d0-a978-3169e96080be None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:40.394280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 682/1350] 10.222.0.76 () {54 vars in 921 bytes} [Thu May 12 17:34:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:40.399927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100de469-f1d0-4688-a925-8e06b4fb5f9e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:40.400765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100de469-f1d0-4688-a925-8e06b4fb5f9e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:40.401252 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100de469-f1d0-4688-a925-8e06b4fb5f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:40.478139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-100de469-f1d0-4688-a925-8e06b4fb5f9e None None] MFA Rules not processed for user `a01fa037b14c456eb533b5a86da0a370`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:40.479940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-100de469-f1d0-4688-a925-8e06b4fb5f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:40.556480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 669/1351] 10.222.0.76 () {58 vars in 1018 bytes} [Thu May 12 17:34:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:44.862541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53eace2-eea3-4793-9244-82f25b670845 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:44.863202 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53eace2-eea3-4793-9244-82f25b670845 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:44.863202 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53eace2-eea3-4793-9244-82f25b670845 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:44.864721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 683/1352] 10.222.0.76 () {54 vars in 921 bytes} [Thu May 12 17:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:44.869609 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0923f1-85f3-45b9-be77-9b65c2fef247 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:44.870050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0923f1-85f3-45b9-be77-9b65c2fef247 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:44.870156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0923f1-85f3-45b9-be77-9b65c2fef247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:44.889140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ab0923f1-85f3-45b9-be77-9b65c2fef247 None None] MFA Rules not processed for user `a01fa037b14c456eb533b5a86da0a370`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:44.890627 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ab0923f1-85f3-45b9-be77-9b65c2fef247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:44.899493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 670/1353] 10.222.0.76 () {58 vars in 1018 bytes} [Thu May 12 17:34:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:34:46.570466 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e047cb-d9e4-48ea-a68c-103a3792c79b None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:46.571064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e047cb-d9e4-48ea-a68c-103a3792c79b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:46.571064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e047cb-d9e4-48ea-a68c-103a3792c79b None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:46.572420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 684/1354] 10.222.0.76 () {54 vars in 921 bytes} [Thu May 12 17:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:46.578173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d9103-7bb0-484b-9025-933aeda42de0 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:46.578735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d9103-7bb0-484b-9025-933aeda42de0 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:46.578893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d9103-7bb0-484b-9025-933aeda42de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:46.597788 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-fb9d9103-7bb0-484b-9025-933aeda42de0 None None] MFA Rules not processed for user `a01fa037b14c456eb533b5a86da0a370`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:46.598999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-fb9d9103-7bb0-484b-9025-933aeda42de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:46.607445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 671/1355] 10.222.0.76 () {58 vars in 1018 bytes} [Thu May 12 17:34:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:50.573934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac0a1d-a193-40f5-9bf9-ef44803ec401 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:50.574493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac0a1d-a193-40f5-9bf9-ef44803ec401 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:50.574493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac0a1d-a193-40f5-9bf9-ef44803ec401 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:50.576006 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 685/1356] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:34:50.581641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae33a12-d717-4e2b-b197-655a0c7f05db None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:50.582085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae33a12-d717-4e2b-b197-655a0c7f05db None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:50.582179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae33a12-d717-4e2b-b197-655a0c7f05db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:50.602214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-dae33a12-d717-4e2b-b197-655a0c7f05db None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:50.603418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-dae33a12-d717-4e2b-b197-655a0c7f05db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:50.612578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 672/1357] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:50.661898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560865d-8389-47ee-8387-e06453737410 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:50.662180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560865d-8389-47ee-8387-e06453737410 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:50.662453 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560865d-8389-47ee-8387-e06453737410 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:50.663932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 686/1358] 10.222.0.76 () {54 vars in 961 bytes} [Thu May 12 17:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:50.669268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82186041-f3fc-4e56-a0f5-630ba496a2ea None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:50.669658 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82186041-f3fc-4e56-a0f5-630ba496a2ea None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:50.670001 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82186041-f3fc-4e56-a0f5-630ba496a2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:50.719917 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-82186041-f3fc-4e56-a0f5-630ba496a2ea None None] MFA Rules not processed for user `04ad234318ad47589b844351cd3bb3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:50.721270 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-82186041-f3fc-4e56-a0f5-630ba496a2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:50.803877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 673/1359] 10.222.0.76 () {58 vars in 1058 bytes} [Thu May 12 17:34:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:50.811568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560865d-8389-47ee-8387-e06453737410 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:50.826896 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560865d-8389-47ee-8387-e06453737410 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:50.833191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae76138-9db0-4d26-86b8-f8fef2658759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:50.833191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae76138-9db0-4d26-86b8-f8fef2658759 service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:50.834571 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae76138-9db0-4d26-86b8-f8fef2658759 service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:50.834571 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae76138-9db0-4d26-86b8-f8fef2658759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:50.848282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae76138-9db0-4d26-86b8-f8fef2658759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:50.850001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae76138-9db0-4d26-86b8-f8fef2658759 service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:50.860380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 687/1360] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:34:53.381505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce67b2-9652-40fa-a687-1b1c4ca330bd None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:53.382097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce67b2-9652-40fa-a687-1b1c4ca330bd None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:53.382097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce67b2-9652-40fa-a687-1b1c4ca330bd None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:53.383429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 674/1361] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:53.388944 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19fcb7-dd9f-4c81-b7c0-41f55bc47d30 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:53.389400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19fcb7-dd9f-4c81-b7c0-41f55bc47d30 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:53.389522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19fcb7-dd9f-4c81-b7c0-41f55bc47d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:53.406964 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-9d19fcb7-dd9f-4c81-b7c0-41f55bc47d30 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:53.408077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9d19fcb7-dd9f-4c81-b7c0-41f55bc47d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:53.416040 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 688/1362] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:53.464211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce67b2-9652-40fa-a687-1b1c4ca330bd None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:53.479330 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce67b2-9652-40fa-a687-1b1c4ca330bd None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:53.485457 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612fc97-aad8-4783-b6c5-5d9d6323b2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:53.486199 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612fc97-aad8-4783-b6c5-5d9d6323b2dd service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:53.486552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612fc97-aad8-4783-b6c5-5d9d6323b2dd service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:53.486920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612fc97-aad8-4783-b6c5-5d9d6323b2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:53.496839 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612fc97-aad8-4783-b6c5-5d9d6323b2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:53.498445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612fc97-aad8-4783-b6c5-5d9d6323b2dd service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:53.508721 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 675/1363] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:34:56.117026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bd6e3-18da-48dd-85a6-5f94be74f030 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:56.117570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bd6e3-18da-48dd-85a6-5f94be74f030 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:56.117665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bd6e3-18da-48dd-85a6-5f94be74f030 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:56.119011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 689/1364] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:56.125142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a7067-6a43-4342-8ece-f65df54f2643 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:56.125558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a7067-6a43-4342-8ece-f65df54f2643 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:56.125757 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a7067-6a43-4342-8ece-f65df54f2643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:56.144814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-908a7067-6a43-4342-8ece-f65df54f2643 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:56.146307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-908a7067-6a43-4342-8ece-f65df54f2643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:56.154190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 676/1365] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:56.208377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dd0ab-69c0-4797-9e84-18517f0b48b2 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:56.209041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dd0ab-69c0-4797-9e84-18517f0b48b2 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:56.209382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dd0ab-69c0-4797-9e84-18517f0b48b2 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:56.210784 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 690/1366] 10.222.0.76 () {54 vars in 961 bytes} [Thu May 12 17:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:56.216175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c78f42-66fa-4e6f-b88b-f6f12a1a94d8 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:56.216460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c78f42-66fa-4e6f-b88b-f6f12a1a94d8 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:56.216735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c78f42-66fa-4e6f-b88b-f6f12a1a94d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:56.236682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-f1c78f42-66fa-4e6f-b88b-f6f12a1a94d8 None None] MFA Rules not processed for user `04ad234318ad47589b844351cd3bb3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:56.237815 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f1c78f42-66fa-4e6f-b88b-f6f12a1a94d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:56.246991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 677/1367] 10.222.0.76 () {58 vars in 1058 bytes} [Thu May 12 17:34:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:56.254891 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dd0ab-69c0-4797-9e84-18517f0b48b2 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:56.269389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dd0ab-69c0-4797-9e84-18517f0b48b2 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:56.274787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681cc07-a553-4f2b-9a8b-b7937940b80d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:56.275425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681cc07-a553-4f2b-9a8b-b7937940b80d service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:56.275709 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681cc07-a553-4f2b-9a8b-b7937940b80d service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:56.275986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681cc07-a553-4f2b-9a8b-b7937940b80d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:56.288497 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681cc07-a553-4f2b-9a8b-b7937940b80d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:56.290574 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681cc07-a553-4f2b-9a8b-b7937940b80d service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:56.301136 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 691/1368] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:34:58.622913 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d09d39-92b8-493d-bbaa-973fb2a63fd7 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:58.623989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d09d39-92b8-493d-bbaa-973fb2a63fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:58.623989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d09d39-92b8-493d-bbaa-973fb2a63fd7 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:58.625535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 678/1369] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:58.630922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e840927-18eb-49c4-886d-df0e368359d5 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:58.631685 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e840927-18eb-49c4-886d-df0e368359d5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:58.632135 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e840927-18eb-49c4-886d-df0e368359d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:58.651082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-3e840927-18eb-49c4-886d-df0e368359d5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:58.652599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3e840927-18eb-49c4-886d-df0e368359d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:58.660944 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 692/1370] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:58.707237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d09d39-92b8-493d-bbaa-973fb2a63fd7 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:58.723771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d09d39-92b8-493d-bbaa-973fb2a63fd7 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:58.729516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139e738-8555-482e-8a63-c6be2af0bdd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:58.730325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139e738-8555-482e-8a63-c6be2af0bdd9 service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:58.730823 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139e738-8555-482e-8a63-c6be2af0bdd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:58.731264 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139e738-8555-482e-8a63-c6be2af0bdd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:58.740571 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139e738-8555-482e-8a63-c6be2af0bdd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:58.742364 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139e738-8555-482e-8a63-c6be2af0bdd9 service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:58.754752 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 679/1371] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:34:58.951059 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a1cca-365e-40cf-b735-c98ffc8dec97 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:58.952174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a1cca-365e-40cf-b735-c98ffc8dec97 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:58.952627 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a1cca-365e-40cf-b735-c98ffc8dec97 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:58.954227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 693/1372] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:34:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:58.960163 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9f029-25b3-4275-96f6-8211ba319152 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:58.960445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9f029-25b3-4275-96f6-8211ba319152 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:58.960730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9f029-25b3-4275-96f6-8211ba319152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:58.980094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-43b9f029-25b3-4275-96f6-8211ba319152 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:58.981640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-43b9f029-25b3-4275-96f6-8211ba319152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:58.990362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 680/1373] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:59.322969 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53598d-9f33-4edb-b9a5-1470c353cd4b None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:59.323372 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53598d-9f33-4edb-b9a5-1470c353cd4b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:59.323756 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53598d-9f33-4edb-b9a5-1470c353cd4b None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:59.325585 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 694/1374] 10.222.0.76 () {54 vars in 963 bytes} [Thu May 12 17:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:34:59.331086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9d2c-273c-4d54-9058-2fcf293f5001 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:59.331381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9d2c-273c-4d54-9058-2fcf293f5001 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:59.331659 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9d2c-273c-4d54-9058-2fcf293f5001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:59.382076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-b59c9d2c-273c-4d54-9058-2fcf293f5001 None None] MFA Rules not processed for user `7ffc2e3a517e48c4bf368bdc0dd18ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:34:59.383292 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b59c9d2c-273c-4d54-9058-2fcf293f5001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:34:59.443724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 681/1375] 10.222.0.76 () {58 vars in 1060 bytes} [Thu May 12 17:34:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:34:59.451266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53598d-9f33-4edb-b9a5-1470c353cd4b None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:34:59.463576 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53598d-9f33-4edb-b9a5-1470c353cd4b None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:34:59.467319 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62661470-d00e-4449-9b7a-34a3f2ce84fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:34:59.468070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62661470-d00e-4449-9b7a-34a3f2ce84fa service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:34:59.468451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62661470-d00e-4449-9b7a-34a3f2ce84fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:34:59.468852 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62661470-d00e-4449-9b7a-34a3f2ce84fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:34:59.478495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62661470-d00e-4449-9b7a-34a3f2ce84fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:34:59.480084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62661470-d00e-4449-9b7a-34a3f2ce84fa service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:34:59.490866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 695/1376] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:01.047742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bfae1-afb2-4302-96c8-ffba6d384d75 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:01.048346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bfae1-afb2-4302-96c8-ffba6d384d75 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:01.048346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bfae1-afb2-4302-96c8-ffba6d384d75 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:01.049743 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 682/1377] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:01.055928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e1617-ed33-4db8-bd64-2d9b69beb8d7 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:01.056821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e1617-ed33-4db8-bd64-2d9b69beb8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:01.057100 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e1617-ed33-4db8-bd64-2d9b69beb8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:01.078047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-110e1617-ed33-4db8-bd64-2d9b69beb8d7 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:01.079328 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-110e1617-ed33-4db8-bd64-2d9b69beb8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:01.087756 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 696/1378] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:01.132988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bfae1-afb2-4302-96c8-ffba6d384d75 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:01.148580 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bfae1-afb2-4302-96c8-ffba6d384d75 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:01.154057 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264c81f-82c3-435e-8f33-91834417dd90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:01.156050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264c81f-82c3-435e-8f33-91834417dd90 service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:01.156336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264c81f-82c3-435e-8f33-91834417dd90 service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:01.156606 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264c81f-82c3-435e-8f33-91834417dd90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:01.165727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264c81f-82c3-435e-8f33-91834417dd90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:01.167379 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264c81f-82c3-435e-8f33-91834417dd90 service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:01.177967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 683/1379] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:03.485575 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd1add-b3ba-4908-a8f6-e83731ff1ec9 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:03.486141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd1add-b3ba-4908-a8f6-e83731ff1ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:03.486572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd1add-b3ba-4908-a8f6-e83731ff1ec9 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:03.488287 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 697/1380] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:35:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:03.493633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cac41c-d23a-4dc0-9bb6-e4d255ccd28e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:03.494053 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cac41c-d23a-4dc0-9bb6-e4d255ccd28e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:03.494157 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cac41c-d23a-4dc0-9bb6-e4d255ccd28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:03.512992 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-64cac41c-d23a-4dc0-9bb6-e4d255ccd28e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:03.514371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-64cac41c-d23a-4dc0-9bb6-e4d255ccd28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:03.522394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 684/1381] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:03.567778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd1add-b3ba-4908-a8f6-e83731ff1ec9 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:03.583566 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd1add-b3ba-4908-a8f6-e83731ff1ec9 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:03.589149 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9330-32c2-429b-8ee0-95295fc35118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:03.589782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9330-32c2-429b-8ee0-95295fc35118 service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:03.590057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9330-32c2-429b-8ee0-95295fc35118 service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:03.590327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9330-32c2-429b-8ee0-95295fc35118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:03.599698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b9330-32c2-429b-8ee0-95295fc35118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:03.601270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b9330-32c2-429b-8ee0-95295fc35118 service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:03.612889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 698/1382] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:05.904257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ceeae-c86c-4020-b73c-af87191b6d5d None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:05.904257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ceeae-c86c-4020-b73c-af87191b6d5d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:05.904257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ceeae-c86c-4020-b73c-af87191b6d5d None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:05.907552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 685/1383] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:05.911752 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4524a5-e93e-4059-a7c7-6b7a3e83783a None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:05.912241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4524a5-e93e-4059-a7c7-6b7a3e83783a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:05.912336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4524a5-e93e-4059-a7c7-6b7a3e83783a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:05.938124 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ab4524a5-e93e-4059-a7c7-6b7a3e83783a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:05.939920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ab4524a5-e93e-4059-a7c7-6b7a3e83783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:05.950167 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 699/1384] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:05.993141 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ceeae-c86c-4020-b73c-af87191b6d5d None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:06.009277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ceeae-c86c-4020-b73c-af87191b6d5d None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:06.016416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c84ae9-53e4-4cd2-8c36-5ddd85d3ccbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:06.017126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c84ae9-53e4-4cd2-8c36-5ddd85d3ccbd service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:06.017571 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c84ae9-53e4-4cd2-8c36-5ddd85d3ccbd service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:06.017901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c84ae9-53e4-4cd2-8c36-5ddd85d3ccbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:06.026953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c84ae9-53e4-4cd2-8c36-5ddd85d3ccbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:06.028749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c84ae9-53e4-4cd2-8c36-5ddd85d3ccbd service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:06.040279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 686/1385] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:08.299304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7272-0af1-470b-8e12-772666b6cdc2 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:08.299971 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7272-0af1-470b-8e12-772666b6cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:08.299971 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7272-0af1-470b-8e12-772666b6cdc2 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:08.301223 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 700/1386] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:08.306875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3bf91-e349-4cda-bbad-75aea7edd872 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:08.307299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3bf91-e349-4cda-bbad-75aea7edd872 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:08.307562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3bf91-e349-4cda-bbad-75aea7edd872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:08.329868 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-8ef3bf91-e349-4cda-bbad-75aea7edd872 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:08.331379 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-8ef3bf91-e349-4cda-bbad-75aea7edd872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:08.340950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 687/1387] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:08.395681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f7272-0af1-470b-8e12-772666b6cdc2 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:08.409874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f7272-0af1-470b-8e12-772666b6cdc2 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:08.415306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dd6c8-4df0-45ef-b74d-9aa943d6ad8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:08.415939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dd6c8-4df0-45ef-b74d-9aa943d6ad8f service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:08.416217 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dd6c8-4df0-45ef-b74d-9aa943d6ad8f service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:08.416488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dd6c8-4df0-45ef-b74d-9aa943d6ad8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:08.424815 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dd6c8-4df0-45ef-b74d-9aa943d6ad8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:08.426381 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dd6c8-4df0-45ef-b74d-9aa943d6ad8f service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:08.436321 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 701/1388] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:10.765960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e3bc9-bc52-4350-aa96-9c592a47429b None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:10.766501 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e3bc9-bc52-4350-aa96-9c592a47429b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:10.766742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e3bc9-bc52-4350-aa96-9c592a47429b None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:10.768529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 688/1389] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:35:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:10.773822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fa8c0-f263-40e7-a717-821c8df66eb9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:10.774264 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fa8c0-f263-40e7-a717-821c8df66eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:10.774360 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fa8c0-f263-40e7-a717-821c8df66eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:10.794399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-417fa8c0-f263-40e7-a717-821c8df66eb9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:10.795745 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-417fa8c0-f263-40e7-a717-821c8df66eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:10.803810 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 702/1390] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:10.848981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e3bc9-bc52-4350-aa96-9c592a47429b None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:10.863575 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e3bc9-bc52-4350-aa96-9c592a47429b None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:10.868941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfa6f3-aabd-4fce-809d-42dc19ba3430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:10.869589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa6f3-aabd-4fce-809d-42dc19ba3430 service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:10.869867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa6f3-aabd-4fce-809d-42dc19ba3430 service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:10.870137 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa6f3-aabd-4fce-809d-42dc19ba3430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:10.878860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfa6f3-aabd-4fce-809d-42dc19ba3430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:10.880444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfa6f3-aabd-4fce-809d-42dc19ba3430 service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:10.890727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 689/1391] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:13.163064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff29596-bf3c-4fc7-948c-28a7f8e7f32f None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:13.163797 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff29596-bf3c-4fc7-948c-28a7f8e7f32f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:13.163797 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff29596-bf3c-4fc7-948c-28a7f8e7f32f None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:13.165020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 703/1392] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:13.170533 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73ced8-7bc3-412d-ad30-ec29c69924d4 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:13.171039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73ced8-7bc3-412d-ad30-ec29c69924d4 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:13.171144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73ced8-7bc3-412d-ad30-ec29c69924d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:13.189822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-fa73ced8-7bc3-412d-ad30-ec29c69924d4 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:13.191089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-fa73ced8-7bc3-412d-ad30-ec29c69924d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:13.199065 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 690/1393] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:13.243719 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff29596-bf3c-4fc7-948c-28a7f8e7f32f None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:13.258119 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff29596-bf3c-4fc7-948c-28a7f8e7f32f None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:13.264603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8475d-d1f5-4b66-a48b-1d0778bff0e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:13.265357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8475d-d1f5-4b66-a48b-1d0778bff0e4 service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:13.265637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8475d-d1f5-4b66-a48b-1d0778bff0e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:13.265913 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8475d-d1f5-4b66-a48b-1d0778bff0e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:13.274257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8475d-d1f5-4b66-a48b-1d0778bff0e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:13.275867 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8475d-d1f5-4b66-a48b-1d0778bff0e4 service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:13.287268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 704/1394] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:15.470997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157db35-b8fa-4e98-92e7-7f2dea32c59b None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:15.471558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157db35-b8fa-4e98-92e7-7f2dea32c59b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:15.471558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157db35-b8fa-4e98-92e7-7f2dea32c59b None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:15.472959 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 691/1395] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:15.478477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2d5dd-d811-4f8e-81fc-0ef50cfa612e None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:15.478979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2d5dd-d811-4f8e-81fc-0ef50cfa612e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:15.479094 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2d5dd-d811-4f8e-81fc-0ef50cfa612e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:15.496967 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-80c2d5dd-d811-4f8e-81fc-0ef50cfa612e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:15.498660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-80c2d5dd-d811-4f8e-81fc-0ef50cfa612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:15.506418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 705/1396] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:15.562903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bda6ff-31ed-43fb-ad08-b1513ba66c86 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:15.563293 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bda6ff-31ed-43fb-ad08-b1513ba66c86 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:15.563673 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bda6ff-31ed-43fb-ad08-b1513ba66c86 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:15.565254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 692/1397] 10.222.0.76 () {54 vars in 962 bytes} [Thu May 12 17:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:15.570856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5725a39-155b-41a0-bb30-8bacc15c1e4b None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:15.571214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5725a39-155b-41a0-bb30-8bacc15c1e4b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:15.571561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5725a39-155b-41a0-bb30-8bacc15c1e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:15.581578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482cf8a-656e-43d8-a532-101e8cc3c3ae None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:15.581895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482cf8a-656e-43d8-a532-101e8cc3c3ae None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:15.582172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482cf8a-656e-43d8-a532-101e8cc3c3ae None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:15.583550 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 693/1398] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:35:15.588839 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343af9f-8314-4278-94a8-7ab77b2e156e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:15.589153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343af9f-8314-4278-94a8-7ab77b2e156e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:15.589426 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343af9f-8314-4278-94a8-7ab77b2e156e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:15.606660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-f343af9f-8314-4278-94a8-7ab77b2e156e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:15.608555 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f343af9f-8314-4278-94a8-7ab77b2e156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:15.616312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 694/1399] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:35:15.620153 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-d5725a39-155b-41a0-bb30-8bacc15c1e4b None None] MFA Rules not processed for user `1a003b6145fb4c5c8919020d9208afa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:15.621333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d5725a39-155b-41a0-bb30-8bacc15c1e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:15.660946 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343af9f-8314-4278-94a8-7ab77b2e156e None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:15.673453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343af9f-8314-4278-94a8-7ab77b2e156e None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:15.679214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5f1d0-8300-4a12-b4fe-8a908875ca23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:15.679855 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5f1d0-8300-4a12-b4fe-8a908875ca23 service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:15.680135 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5f1d0-8300-4a12-b4fe-8a908875ca23 service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:15.680410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5f1d0-8300-4a12-b4fe-8a908875ca23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:15.681278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 706/1400] 10.222.0.76 () {58 vars in 1059 bytes} [Thu May 12 17:35:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:15.688949 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5f1d0-8300-4a12-b4fe-8a908875ca23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:15.689125 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5725a39-155b-41a0-bb30-8bacc15c1e4b None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:15.690757 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5f1d0-8300-4a12-b4fe-8a908875ca23 service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:15.696337 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5725a39-155b-41a0-bb30-8bacc15c1e4b None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:15.700269 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa81b6a-3661-4b3a-94da-f985c69f4863 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a003b6145fb4c5c8919020d9208afa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:15.700434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 695/1401] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:15.700669 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa81b6a-3661-4b3a-94da-f985c69f4863 service glance] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:15.701027 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa81b6a-3661-4b3a-94da-f985c69f4863 service glance] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:15.701304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa81b6a-3661-4b3a-94da-f985c69f4863 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:15.711870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa81b6a-3661-4b3a-94da-f985c69f4863 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:15.713490 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa81b6a-3661-4b3a-94da-f985c69f4863 service glance] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:15.725804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 707/1402] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:35:16.162909 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9641685-35c0-41c6-a36e-0efa86cf8a4c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:16.163201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9641685-35c0-41c6-a36e-0efa86cf8a4c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:16.163479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9641685-35c0-41c6-a36e-0efa86cf8a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:16.213030 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-f9641685-35c0-41c6-a36e-0efa86cf8a4c None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:16.214232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f9641685-35c0-41c6-a36e-0efa86cf8a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:16.304621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 696/1403] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:35:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:16.353086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e9b57-3ce7-484f-b163-a219a1d714e9 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:16.353369 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e9b57-3ce7-484f-b163-a219a1d714e9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:16.353640 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e9b57-3ce7-484f-b163-a219a1d714e9 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:16.355041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 708/1404] 10.222.0.76 () {54 vars in 942 bytes} [Thu May 12 17:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:16.365039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e629fd-9028-4729-b496-58c94b8cc30d None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:16.365334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e629fd-9028-4729-b496-58c94b8cc30d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:16.365627 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e629fd-9028-4729-b496-58c94b8cc30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:16.415080 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-07e629fd-9028-4729-b496-58c94b8cc30d None None] MFA Rules not processed for user `0e679573cc984993b98e416fabd586d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:16.416267 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-07e629fd-9028-4729-b496-58c94b8cc30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:16.486950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 697/1405] 10.222.0.76 () {58 vars in 1039 bytes} [Thu May 12 17:35:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:16.496754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e9b57-3ce7-484f-b163-a219a1d714e9 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:16.510534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e9b57-3ce7-484f-b163-a219a1d714e9 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:16.516228 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557336fc-3076-4eaf-8bea-8bb22607adb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:16.516862 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557336fc-3076-4eaf-8bea-8bb22607adb4 service swift] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:16.517141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557336fc-3076-4eaf-8bea-8bb22607adb4 service swift] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:16.517411 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557336fc-3076-4eaf-8bea-8bb22607adb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:16.525603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557336fc-3076-4eaf-8bea-8bb22607adb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:16.527240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557336fc-3076-4eaf-8bea-8bb22607adb4 service swift] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:16.536528 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 709/1406] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:35:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:35:18.043297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3520-8ea5-4ecc-ba0d-5386f4de2123 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:18.044255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3520-8ea5-4ecc-ba0d-5386f4de2123 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:18.044713 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf3520-8ea5-4ecc-ba0d-5386f4de2123 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:18.046408 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 698/1407] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:18.052145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4111374-964a-4586-9fb7-19f0626c6ee8 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:18.052607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4111374-964a-4586-9fb7-19f0626c6ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:18.052707 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4111374-964a-4586-9fb7-19f0626c6ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:18.073320 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-a4111374-964a-4586-9fb7-19f0626c6ee8 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:18.074846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a4111374-964a-4586-9fb7-19f0626c6ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:18.084548 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 710/1408] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:18.215182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf3520-8ea5-4ecc-ba0d-5386f4de2123 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:18.249398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf3520-8ea5-4ecc-ba0d-5386f4de2123 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:18.256172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc8613-18c5-48c9-9e17-450ef85340c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:18.256822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc8613-18c5-48c9-9e17-450ef85340c0 service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:18.257100 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc8613-18c5-48c9-9e17-450ef85340c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:18.257371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc8613-18c5-48c9-9e17-450ef85340c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:18.267941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc8613-18c5-48c9-9e17-450ef85340c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:18.269708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc8613-18c5-48c9-9e17-450ef85340c0 service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:18.280533 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 699/1409] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:39.985618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f700-1606-460b-a3e7-fa30e7641c57 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:39.986260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f700-1606-460b-a3e7-fa30e7641c57 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:39.986260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f700-1606-460b-a3e7-fa30e7641c57 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:39.987582 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 711/1410] 10.222.0.76 () {54 vars in 918 bytes} [Thu May 12 17:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:39.993368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13702404-62d7-4011-98ff-5486c6b66d42 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:39.993850 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13702404-62d7-4011-98ff-5486c6b66d42 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:39.993955 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13702404-62d7-4011-98ff-5486c6b66d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:40.012876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-13702404-62d7-4011-98ff-5486c6b66d42 None None] MFA Rules not processed for user `a01fa037b14c456eb533b5a86da0a370`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:40.014079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-13702404-62d7-4011-98ff-5486c6b66d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:40.022477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 700/1411] 10.222.0.76 () {58 vars in 1015 bytes} [Thu May 12 17:35:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:40.037164 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c553e2a-0d64-44d4-90d5-e915ab349259 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:40.037454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c553e2a-0d64-44d4-90d5-e915ab349259 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:40.037734 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c553e2a-0d64-44d4-90d5-e915ab349259 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:40.039137 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 712/1412] 10.222.0.76 () {54 vars in 918 bytes} [Thu May 12 17:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:40.044025 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba7565-fb4d-4ecc-9356-747425dedfd3 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:40.044985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba7565-fb4d-4ecc-9356-747425dedfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:40.045365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba7565-fb4d-4ecc-9356-747425dedfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:40.063101 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-70ba7565-fb4d-4ecc-9356-747425dedfd3 None None] MFA Rules not processed for user `04ad234318ad47589b844351cd3bb3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:40.064274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-70ba7565-fb4d-4ecc-9356-747425dedfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:40.073051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 701/1413] 10.222.0.76 () {58 vars in 1015 bytes} [Thu May 12 17:35:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:35:42.794242 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3728b4-f43f-4c78-9bf7-480211ebcc52 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:42.794808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3728b4-f43f-4c78-9bf7-480211ebcc52 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:42.794938 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3728b4-f43f-4c78-9bf7-480211ebcc52 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:42.796256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:42.801765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f4645-3f38-4ff5-b499-6936e0621998 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:42.802214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f4645-3f38-4ff5-b499-6936e0621998 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:42.802334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f4645-3f38-4ff5-b499-6936e0621998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:42.819809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-4e6f4645-3f38-4ff5-b499-6936e0621998 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:42.821007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4e6f4645-3f38-4ff5-b499-6936e0621998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:42.829465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:35:42.871315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3728b4-f43f-4c78-9bf7-480211ebcc52 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:42.885701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3728b4-f43f-4c78-9bf7-480211ebcc52 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:42.892265 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3667b-3138-4cae-a604-8a7584f6796e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:42.892890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3667b-3138-4cae-a604-8a7584f6796e service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:42.893166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3667b-3138-4cae-a604-8a7584f6796e service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:42.893436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3667b-3138-4cae-a604-8a7584f6796e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:42.901250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3667b-3138-4cae-a604-8a7584f6796e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:42.902849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3667b-3138-4cae-a604-8a7584f6796e service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:42.912911 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 714/1416] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:43.906068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb90e8-7bb4-4fb5-8ce6-63f138f31816 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:43.906651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb90e8-7bb4-4fb5-8ce6-63f138f31816 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:43.906651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb90e8-7bb4-4fb5-8ce6-63f138f31816 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:43.908032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:43.913031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5154dbb-5f43-4f4e-b0e5-e1e716f00e6e None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:43.913471 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5154dbb-5f43-4f4e-b0e5-e1e716f00e6e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:43.913616 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5154dbb-5f43-4f4e-b0e5-e1e716f00e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:43.930990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-f5154dbb-5f43-4f4e-b0e5-e1e716f00e6e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:43.932184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f5154dbb-5f43-4f4e-b0e5-e1e716f00e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:43.940537 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:44.102430 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb90e8-7bb4-4fb5-8ce6-63f138f31816 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:44.117052 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb90e8-7bb4-4fb5-8ce6-63f138f31816 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:44.122936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3271bff-3241-4745-ae9e-5f7690d0840b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:44.123631 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3271bff-3241-4745-ae9e-5f7690d0840b service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:44.123914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3271bff-3241-4745-ae9e-5f7690d0840b service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:44.124193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3271bff-3241-4745-ae9e-5f7690d0840b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:44.132157 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3271bff-3241-4745-ae9e-5f7690d0840b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:44.133741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3271bff-3241-4745-ae9e-5f7690d0840b service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:44.143274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 704/1419] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:45.090254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b5e41-4813-4430-89d4-199a1b7c90ae None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:45.091466 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b5e41-4813-4430-89d4-199a1b7c90ae None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:45.091660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b5e41-4813-4430-89d4-199a1b7c90ae None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:45.093040 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:45.098549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292bb5d-e36d-4061-92c6-0e9c3b65236e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:45.099049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292bb5d-e36d-4061-92c6-0e9c3b65236e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:45.099156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292bb5d-e36d-4061-92c6-0e9c3b65236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:45.116539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-b292bb5d-e36d-4061-92c6-0e9c3b65236e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:45.117777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b292bb5d-e36d-4061-92c6-0e9c3b65236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:45.125636 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:45.276060 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b5e41-4813-4430-89d4-199a1b7c90ae None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:45.290192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b5e41-4813-4430-89d4-199a1b7c90ae None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:45.295739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f253f-0034-4ef4-a775-0b3e3fd0dcc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:45.296372 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f253f-0034-4ef4-a775-0b3e3fd0dcc0 service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:45.296651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f253f-0034-4ef4-a775-0b3e3fd0dcc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:45.296924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f253f-0034-4ef4-a775-0b3e3fd0dcc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:45.304918 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f253f-0034-4ef4-a775-0b3e3fd0dcc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:45.306489 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f253f-0034-4ef4-a775-0b3e3fd0dcc0 service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:45.316594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 717/1422] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:46.251528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a32dca-1a70-40e4-9bcd-0190dd9cf8cc None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:46.252005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a32dca-1a70-40e4-9bcd-0190dd9cf8cc None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:46.252123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a32dca-1a70-40e4-9bcd-0190dd9cf8cc None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:46.253451 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:46.258335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c022dc7-7f7b-4208-b1c8-6dfa918a60b6 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:46.258755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c022dc7-7f7b-4208-b1c8-6dfa918a60b6 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:46.258927 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c022dc7-7f7b-4208-b1c8-6dfa918a60b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:46.276682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-7c022dc7-7f7b-4208-b1c8-6dfa918a60b6 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:46.277867 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-7c022dc7-7f7b-4208-b1c8-6dfa918a60b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:46.286278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:35:46.435492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a32dca-1a70-40e4-9bcd-0190dd9cf8cc None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:46.450645 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a32dca-1a70-40e4-9bcd-0190dd9cf8cc None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:46.456076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f558-da55-4353-86a8-f179fb0bc16e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:46.456709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f558-da55-4353-86a8-f179fb0bc16e service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:46.456991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f558-da55-4353-86a8-f179fb0bc16e service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:46.457263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f558-da55-4353-86a8-f179fb0bc16e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:46.465346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f558-da55-4353-86a8-f179fb0bc16e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:46.467795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f558-da55-4353-86a8-f179fb0bc16e service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:46.477008 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 707/1425] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:47.412390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb77a6-32e2-4be9-81c9-e9755d66e243 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:47.412941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb77a6-32e2-4be9-81c9-e9755d66e243 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:47.412941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb77a6-32e2-4be9-81c9-e9755d66e243 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:47.414302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:47.419914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccbeee-4466-4b13-9cdf-1fa89bd095ba None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:47.420325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccbeee-4466-4b13-9cdf-1fa89bd095ba None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:47.420494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccbeee-4466-4b13-9cdf-1fa89bd095ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:47.439310 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-8dccbeee-4466-4b13-9cdf-1fa89bd095ba None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:47.440505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-8dccbeee-4466-4b13-9cdf-1fa89bd095ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:47.448219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:47.599925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb77a6-32e2-4be9-81c9-e9755d66e243 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:47.614798 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb77a6-32e2-4be9-81c9-e9755d66e243 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:47.620245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a19b08-9f13-4583-aff9-b2cf1d9f97b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:47.620878 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a19b08-9f13-4583-aff9-b2cf1d9f97b8 service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:47.621161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a19b08-9f13-4583-aff9-b2cf1d9f97b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:47.621437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a19b08-9f13-4583-aff9-b2cf1d9f97b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:47.629581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a19b08-9f13-4583-aff9-b2cf1d9f97b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:47.631180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a19b08-9f13-4583-aff9-b2cf1d9f97b8 service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:47.641288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 720/1428] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:48.526444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33670-6a6b-4da9-8aa9-93743ba1f368 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:48.527002 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33670-6a6b-4da9-8aa9-93743ba1f368 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:48.527002 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33670-6a6b-4da9-8aa9-93743ba1f368 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:48.528374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:48.533270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa9897-9cc0-4d36-85d3-95eb48b32d81 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:48.533712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa9897-9cc0-4d36-85d3-95eb48b32d81 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:48.533820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa9897-9cc0-4d36-85d3-95eb48b32d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:48.551643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-05fa9897-9cc0-4d36-85d3-95eb48b32d81 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:48.552813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-05fa9897-9cc0-4d36-85d3-95eb48b32d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:48.561769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:48.712252 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb33670-6a6b-4da9-8aa9-93743ba1f368 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:48.726231 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb33670-6a6b-4da9-8aa9-93743ba1f368 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:48.732111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a5033-cec2-4f74-a49c-081546ccbdc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:48.732738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a5033-cec2-4f74-a49c-081546ccbdc1 service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:48.733016 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a5033-cec2-4f74-a49c-081546ccbdc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:48.733286 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a5033-cec2-4f74-a49c-081546ccbdc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:48.741221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a5033-cec2-4f74-a49c-081546ccbdc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:48.742847 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a5033-cec2-4f74-a49c-081546ccbdc1 service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:48.752680 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 710/1431] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:49.628047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ea29a-3648-40fb-9ecc-206bda5fe0a1 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:49.628658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ea29a-3648-40fb-9ecc-206bda5fe0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:49.628658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ea29a-3648-40fb-9ecc-206bda5fe0a1 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:49.630011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:49.635061 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e2085-2a5b-44b8-a985-b9f99b7dae15 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:49.635478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e2085-2a5b-44b8-a985-b9f99b7dae15 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:49.635617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e2085-2a5b-44b8-a985-b9f99b7dae15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:49.654665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-a26e2085-2a5b-44b8-a985-b9f99b7dae15 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:49.655893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a26e2085-2a5b-44b8-a985-b9f99b7dae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:49.663629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:49.816880 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ea29a-3648-40fb-9ecc-206bda5fe0a1 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:49.831763 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ea29a-3648-40fb-9ecc-206bda5fe0a1 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:49.836989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e2856-5488-4eb2-b3c2-b29390ec7385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:49.837621 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e2856-5488-4eb2-b3c2-b29390ec7385 service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:49.837898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e2856-5488-4eb2-b3c2-b29390ec7385 service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:49.838169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e2856-5488-4eb2-b3c2-b29390ec7385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:49.846196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e2856-5488-4eb2-b3c2-b29390ec7385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:49.847791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e2856-5488-4eb2-b3c2-b29390ec7385 service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:49.856967 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 723/1434] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:50.756532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d19bc-8f54-446d-af71-f9c0a99c3dbc None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:50.757110 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d19bc-8f54-446d-af71-f9c0a99c3dbc None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:50.757110 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d19bc-8f54-446d-af71-f9c0a99c3dbc None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:50.758504 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:50.764076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc3a6e-9a8d-49e6-81aa-9f348a7eb778 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:50.764553 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc3a6e-9a8d-49e6-81aa-9f348a7eb778 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:50.764710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc3a6e-9a8d-49e6-81aa-9f348a7eb778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:50.782739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-eefc3a6e-9a8d-49e6-81aa-9f348a7eb778 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:50.783972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-eefc3a6e-9a8d-49e6-81aa-9f348a7eb778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:50.791802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:50.948032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d19bc-8f54-446d-af71-f9c0a99c3dbc None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:50.962559 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d19bc-8f54-446d-af71-f9c0a99c3dbc None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:50.968528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04289d18-6560-47a6-b3b1-322bb41f2dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:50.969160 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04289d18-6560-47a6-b3b1-322bb41f2dda service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:50.969447 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04289d18-6560-47a6-b3b1-322bb41f2dda service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:50.969723 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04289d18-6560-47a6-b3b1-322bb41f2dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:50.977612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04289d18-6560-47a6-b3b1-322bb41f2dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:50.979239 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04289d18-6560-47a6-b3b1-322bb41f2dda service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:50.988489 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 713/1437] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:51.871124 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc952266-91da-4ccf-8d6d-d1dacbcb23e0 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:51.871769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc952266-91da-4ccf-8d6d-d1dacbcb23e0 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:51.871769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc952266-91da-4ccf-8d6d-d1dacbcb23e0 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:51.873618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:51.878641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d4115-140b-4dbc-9ca2-4297c0ce71c4 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:51.879101 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d4115-140b-4dbc-9ca2-4297c0ce71c4 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:51.879213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d4115-140b-4dbc-9ca2-4297c0ce71c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:51.897373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-029d4115-140b-4dbc-9ca2-4297c0ce71c4 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:51.898553 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-029d4115-140b-4dbc-9ca2-4297c0ce71c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:51.906861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:52.062397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc952266-91da-4ccf-8d6d-d1dacbcb23e0 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:52.076639 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc952266-91da-4ccf-8d6d-d1dacbcb23e0 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:52.081990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c2724-2e81-44a6-a8bc-7be376912412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:52.082623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c2724-2e81-44a6-a8bc-7be376912412 service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:52.082929 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c2724-2e81-44a6-a8bc-7be376912412 service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:52.083204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c2724-2e81-44a6-a8bc-7be376912412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:52.092150 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c2724-2e81-44a6-a8bc-7be376912412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:52.093722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c2724-2e81-44a6-a8bc-7be376912412 service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:52.103222 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 726/1440] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:54.215882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01388b50-1a46-48a1-9a97-b1883e3834ed None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:54.216430 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01388b50-1a46-48a1-9a97-b1883e3834ed None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:54.216430 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01388b50-1a46-48a1-9a97-b1883e3834ed None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:54.217799 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:35:54.223093 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62dc76-03f8-4479-b275-a7fc32b35088 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:54.223526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62dc76-03f8-4479-b275-a7fc32b35088 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:54.223649 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62dc76-03f8-4479-b275-a7fc32b35088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:54.242238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-fc62dc76-03f8-4479-b275-a7fc32b35088 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:54.243486 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-fc62dc76-03f8-4479-b275-a7fc32b35088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:54.251871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:54.290537 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01388b50-1a46-48a1-9a97-b1883e3834ed None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:54.302098 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01388b50-1a46-48a1-9a97-b1883e3834ed None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:54.306340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb12b9b-a19d-4bf3-9d4e-dc614a250b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:54.307090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb12b9b-a19d-4bf3-9d4e-dc614a250b74 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:54.307408 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb12b9b-a19d-4bf3-9d4e-dc614a250b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:54.307720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb12b9b-a19d-4bf3-9d4e-dc614a250b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:54.316744 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb12b9b-a19d-4bf3-9d4e-dc614a250b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:54.318201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb12b9b-a19d-4bf3-9d4e-dc614a250b74 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:54.327516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 716/1443] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:56.746328 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76175c-2306-42c3-8e32-fe9b128fa625 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:56.747592 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76175c-2306-42c3-8e32-fe9b128fa625 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:56.747758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76175c-2306-42c3-8e32-fe9b128fa625 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:56.749082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:56.754463 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9879-ad21-46c9-9150-696b38622325 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:56.754939 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9879-ad21-46c9-9150-696b38622325 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:56.755048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9879-ad21-46c9-9150-696b38622325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:56.773191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ccee9879-ad21-46c9-9150-696b38622325 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:56.774385 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ccee9879-ad21-46c9-9150-696b38622325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:56.782380 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:56.820292 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76175c-2306-42c3-8e32-fe9b128fa625 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:56.831587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76175c-2306-42c3-8e32-fe9b128fa625 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:56.835100 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77406643-676c-4483-8c30-bb57e1054f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:56.835727 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77406643-676c-4483-8c30-bb57e1054f0b service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:56.836006 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77406643-676c-4483-8c30-bb57e1054f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:56.836277 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77406643-676c-4483-8c30-bb57e1054f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:56.845449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77406643-676c-4483-8c30-bb57e1054f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:56.846840 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77406643-676c-4483-8c30-bb57e1054f0b service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:56.856674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 729/1446] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:35:59.388494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951d835-619e-4057-85cb-c98affaf8aed None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:59.389039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951d835-619e-4057-85cb-c98affaf8aed None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:59.389039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951d835-619e-4057-85cb-c98affaf8aed None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:59.390427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:35:59.395753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f344a43-138d-43bc-acab-987cdf41908c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:59.396182 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f344a43-138d-43bc-acab-987cdf41908c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:59.396343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f344a43-138d-43bc-acab-987cdf41908c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:59.413537 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-8f344a43-138d-43bc-acab-987cdf41908c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:35:59.414761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8f344a43-138d-43bc-acab-987cdf41908c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:35:59.423285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:35:59.461835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951d835-619e-4057-85cb-c98affaf8aed None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:35:59.472344 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951d835-619e-4057-85cb-c98affaf8aed None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:35:59.475813 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59bfd4-5fa2-45d8-81aa-0ae4d96aa7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:35:59.476420 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59bfd4-5fa2-45d8-81aa-0ae4d96aa7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:35:59.476700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59bfd4-5fa2-45d8-81aa-0ae4d96aa7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:35:59.476973 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59bfd4-5fa2-45d8-81aa-0ae4d96aa7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:35:59.486115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59bfd4-5fa2-45d8-81aa-0ae4d96aa7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:35:59.487571 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59bfd4-5fa2-45d8-81aa-0ae4d96aa7a1 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:35:59.497558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 719/1449] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:36:01.851927 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c7b65-c899-4237-95a4-dab92c250cf8 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:01.852565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c7b65-c899-4237-95a4-dab92c250cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:01.852565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c7b65-c899-4237-95a4-dab92c250cf8 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:01.853848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:36:01.859348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02457-b6cb-4f9a-a7e4-c827b22aea92 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:01.859810 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02457-b6cb-4f9a-a7e4-c827b22aea92 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:01.859917 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02457-b6cb-4f9a-a7e4-c827b22aea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:01.877716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-0ec02457-b6cb-4f9a-a7e4-c827b22aea92 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:36:01.878936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0ec02457-b6cb-4f9a-a7e4-c827b22aea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:36:01.886609 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:36:01.924887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c7b65-c899-4237-95a4-dab92c250cf8 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:36:01.935951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c7b65-c899-4237-95a4-dab92c250cf8 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:36:01.939434 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1d1b1-7aea-4182-a901-00796dfa2062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:36:01.940062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1d1b1-7aea-4182-a901-00796dfa2062 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:01.940342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1d1b1-7aea-4182-a901-00796dfa2062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:01.940616 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1d1b1-7aea-4182-a901-00796dfa2062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:01.949404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1d1b1-7aea-4182-a901-00796dfa2062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:36:01.951525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1d1b1-7aea-4182-a901-00796dfa2062 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:36:01.960805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 732/1452] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:36:04.305675 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562985b5-52ac-40ee-9a82-936efe40ab92 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:04.306207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562985b5-52ac-40ee-9a82-936efe40ab92 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:04.306207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562985b5-52ac-40ee-9a82-936efe40ab92 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:04.307704 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:36:04.313851 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c123-1a69-49d5-bb9f-60f3abe3c32e None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:04.314283 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c123-1a69-49d5-bb9f-60f3abe3c32e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:04.314547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828c123-1a69-49d5-bb9f-60f3abe3c32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:04.332690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-d828c123-1a69-49d5-bb9f-60f3abe3c32e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:36:04.333863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d828c123-1a69-49d5-bb9f-60f3abe3c32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:36:04.341680 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:36:04.380031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562985b5-52ac-40ee-9a82-936efe40ab92 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:36:04.390800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562985b5-52ac-40ee-9a82-936efe40ab92 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:36:04.394241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb6324-ac4b-4f64-b33c-2e82ce5f8925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:36:04.394906 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb6324-ac4b-4f64-b33c-2e82ce5f8925 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:04.395188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb6324-ac4b-4f64-b33c-2e82ce5f8925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:04.395461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb6324-ac4b-4f64-b33c-2e82ce5f8925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:04.404117 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb6324-ac4b-4f64-b33c-2e82ce5f8925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:36:04.405551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb6324-ac4b-4f64-b33c-2e82ce5f8925 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:36:04.414732 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 722/1455] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:36:06.700924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b22677-f8ec-4a10-96ac-a8ad3faf13f2 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:06.701499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b22677-f8ec-4a10-96ac-a8ad3faf13f2 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:06.701499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b22677-f8ec-4a10-96ac-a8ad3faf13f2 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:06.702872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:36:06.708234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53782c-67b1-4bb6-aa5f-c9fd9012535e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:06.708681 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53782c-67b1-4bb6-aa5f-c9fd9012535e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:06.708779 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53782c-67b1-4bb6-aa5f-c9fd9012535e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:06.726745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-2e53782c-67b1-4bb6-aa5f-c9fd9012535e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:36:06.727958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2e53782c-67b1-4bb6-aa5f-c9fd9012535e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:36:06.735859 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:36:06.773781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b22677-f8ec-4a10-96ac-a8ad3faf13f2 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:36:06.784782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b22677-f8ec-4a10-96ac-a8ad3faf13f2 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:36:06.788279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a8e2b-b152-4378-8281-4909445a22be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:36:06.788909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a8e2b-b152-4378-8281-4909445a22be service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:06.789195 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a8e2b-b152-4378-8281-4909445a22be service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:06.789467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a8e2b-b152-4378-8281-4909445a22be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:06.798373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a8e2b-b152-4378-8281-4909445a22be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:36:06.799829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a8e2b-b152-4378-8281-4909445a22be service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:36:06.809189 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 735/1458] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:36:09.093196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c73227-5475-4f55-b4ef-036825ea2551 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:09.093806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c73227-5475-4f55-b4ef-036825ea2551 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:09.093806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c73227-5475-4f55-b4ef-036825ea2551 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:09.095157 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:36:09.100575 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c822f-e922-469e-8b8a-a40ea1c27be9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:09.101018 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c822f-e922-469e-8b8a-a40ea1c27be9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:09.101160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c822f-e922-469e-8b8a-a40ea1c27be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:09.119076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-206c822f-e922-469e-8b8a-a40ea1c27be9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:36:09.120258 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-206c822f-e922-469e-8b8a-a40ea1c27be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:36:09.128970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:36:09.165637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c73227-5475-4f55-b4ef-036825ea2551 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:36:09.176698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c73227-5475-4f55-b4ef-036825ea2551 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:36:09.180188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cdf78-fe03-44b3-bc07-a5230e2da2b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:36:09.180822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cdf78-fe03-44b3-bc07-a5230e2da2b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:09.181103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cdf78-fe03-44b3-bc07-a5230e2da2b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:09.181378 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cdf78-fe03-44b3-bc07-a5230e2da2b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:09.190827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cdf78-fe03-44b3-bc07-a5230e2da2b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:36:09.192250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cdf78-fe03-44b3-bc07-a5230e2da2b7 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:36:09.201382 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 725/1461] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:36:11.503361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7f241-07ae-4217-81a8-bd1457cf4743 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:11.503888 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7f241-07ae-4217-81a8-bd1457cf4743 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:11.503888 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7f241-07ae-4217-81a8-bd1457cf4743 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:11.505185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:36:11.510534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e65b-4a5f-49d1-8414-40e5c8a500fe None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:11.511026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e65b-4a5f-49d1-8414-40e5c8a500fe None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:11.511128 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e65b-4a5f-49d1-8414-40e5c8a500fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:11.529074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-15c5e65b-4a5f-49d1-8414-40e5c8a500fe None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:36:11.530264 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-15c5e65b-4a5f-49d1-8414-40e5c8a500fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:36:11.537925 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:36:11.575711 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7f241-07ae-4217-81a8-bd1457cf4743 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:36:11.586179 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7f241-07ae-4217-81a8-bd1457cf4743 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:36:11.590168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb1378-8c35-481c-81bf-80deffb67e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:36:11.590835 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb1378-8c35-481c-81bf-80deffb67e02 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:11.591116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb1378-8c35-481c-81bf-80deffb67e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:11.591388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb1378-8c35-481c-81bf-80deffb67e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:11.600068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb1378-8c35-481c-81bf-80deffb67e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:36:11.601486 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb1378-8c35-481c-81bf-80deffb67e02 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:36:11.611584 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 738/1464] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:36:13.877639 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2569f3-7569-48f6-9aa1-0262b4cb9047 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:13.878172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2569f3-7569-48f6-9aa1-0262b4cb9047 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:13.878172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2569f3-7569-48f6-9aa1-0262b4cb9047 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:13.879584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:36:13.884994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8142e-c5f0-4209-a7cd-e6d90f658394 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:13.885459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8142e-c5f0-4209-a7cd-e6d90f658394 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:13.885587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8142e-c5f0-4209-a7cd-e6d90f658394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:13.903850 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-04d8142e-c5f0-4209-a7cd-e6d90f658394 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:36:13.905042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-04d8142e-c5f0-4209-a7cd-e6d90f658394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:36:13.912775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:36:13.950022 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2569f3-7569-48f6-9aa1-0262b4cb9047 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:36:13.960291 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2569f3-7569-48f6-9aa1-0262b4cb9047 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:36:13.963745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220b2ca-2a24-4b59-94af-bbf8916d2087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:36:13.964368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220b2ca-2a24-4b59-94af-bbf8916d2087 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:13.965407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220b2ca-2a24-4b59-94af-bbf8916d2087 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:13.965822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220b2ca-2a24-4b59-94af-bbf8916d2087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:13.974825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220b2ca-2a24-4b59-94af-bbf8916d2087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:36:13.976256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220b2ca-2a24-4b59-94af-bbf8916d2087 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:36:13.986031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 728/1467] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:36:16.209225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2da50-a0b8-4f15-abbd-872f72e9718f None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:16.209771 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2da50-a0b8-4f15-abbd-872f72e9718f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:16.209771 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2da50-a0b8-4f15-abbd-872f72e9718f None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:16.211174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:36:16.216760 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e7d5b-fab4-4930-a322-8336af6b4808 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:16.217198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e7d5b-fab4-4930-a322-8336af6b4808 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:16.217327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e7d5b-fab4-4930-a322-8336af6b4808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:16.234930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-e93e7d5b-fab4-4930-a322-8336af6b4808 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:36:16.236123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-e93e7d5b-fab4-4930-a322-8336af6b4808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:36:16.243771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:36:16.281498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2da50-a0b8-4f15-abbd-872f72e9718f None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:36:16.292475 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2da50-a0b8-4f15-abbd-872f72e9718f None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:36:16.296364 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f9fbf-8c13-4905-bd67-d10b0bc0441e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:36:16.296996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f9fbf-8c13-4905-bd67-d10b0bc0441e service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:16.297272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f9fbf-8c13-4905-bd67-d10b0bc0441e service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:16.297569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f9fbf-8c13-4905-bd67-d10b0bc0441e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:16.306311 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f9fbf-8c13-4905-bd67-d10b0bc0441e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:36:16.307759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f9fbf-8c13-4905-bd67-d10b0bc0441e service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:36:16.318369 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 741/1470] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:36:49.837072 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e78b8-c423-4490-ae0f-cbaa0173ae9f None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:49.837683 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e78b8-c423-4490-ae0f-cbaa0173ae9f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:49.837683 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e78b8-c423-4490-ae0f-cbaa0173ae9f None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:49.839675 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 730/1471] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:36:49.844731 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286236a-7c63-4943-9f57-ade17add868c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:49.845188 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286236a-7c63-4943-9f57-ade17add868c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:49.845373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286236a-7c63-4943-9f57-ade17add868c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:49.863323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-2286236a-7c63-4943-9f57-ade17add868c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:36:49.864523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-2286236a-7c63-4943-9f57-ade17add868c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:36:49.872494 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 742/1472] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:36:49.920156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874bf77-16c4-4a8c-b85e-a042efccecb0 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:49.920439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874bf77-16c4-4a8c-b85e-a042efccecb0 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:49.920710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874bf77-16c4-4a8c-b85e-a042efccecb0 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:49.922064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 731/1473] 10.222.0.76 () {54 vars in 962 bytes} [Thu May 12 17:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:36:49.926629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6addf-6a6d-40d3-9f18-63d1f067f48b None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:49.926954 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6addf-6a6d-40d3-9f18-63d1f067f48b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:49.927236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6addf-6a6d-40d3-9f18-63d1f067f48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:49.944922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-43b6addf-6a6d-40d3-9f18-63d1f067f48b None None] MFA Rules not processed for user `1a003b6145fb4c5c8919020d9208afa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:36:49.946096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-43b6addf-6a6d-40d3-9f18-63d1f067f48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:36:49.952726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 743/1474] 10.222.0.76 () {58 vars in 1059 bytes} [Thu May 12 17:36:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:36:49.959666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874bf77-16c4-4a8c-b85e-a042efccecb0 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:36:49.971098 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874bf77-16c4-4a8c-b85e-a042efccecb0 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:36:49.974541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627f90b-8dd1-4bb1-b51b-7de8be1d95dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a003b6145fb4c5c8919020d9208afa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:36:49.975201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627f90b-8dd1-4bb1-b51b-7de8be1d95dc service glance] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:49.975479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627f90b-8dd1-4bb1-b51b-7de8be1d95dc service glance] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:49.975748 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627f90b-8dd1-4bb1-b51b-7de8be1d95dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:49.985181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627f90b-8dd1-4bb1-b51b-7de8be1d95dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:36:49.986599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627f90b-8dd1-4bb1-b51b-7de8be1d95dc service glance] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:36:49.996249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 732/1475] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:36:52.325961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1b61c-7dd1-4b5d-84a7-252f4e70ee9e None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:52.326512 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1b61c-7dd1-4b5d-84a7-252f4e70ee9e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:52.326512 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1b61c-7dd1-4b5d-84a7-252f4e70ee9e None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:52.327922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 744/1476] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:36:52.333126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a62bb2-93cb-4caa-b05c-6d85fa6f7930 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:52.333559 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a62bb2-93cb-4caa-b05c-6d85fa6f7930 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:52.333671 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a62bb2-93cb-4caa-b05c-6d85fa6f7930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:52.351327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-d6a62bb2-93cb-4caa-b05c-6d85fa6f7930 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:36:52.352520 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d6a62bb2-93cb-4caa-b05c-6d85fa6f7930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:36:52.360962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 733/1477] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:36:52.383881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1b61c-7dd1-4b5d-84a7-252f4e70ee9e None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:36:52.397106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1b61c-7dd1-4b5d-84a7-252f4e70ee9e None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:36:52.402108 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3799f3b-4ae0-41f4-b0d7-7d0aeb54a36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:36:52.402777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3799f3b-4ae0-41f4-b0d7-7d0aeb54a36d admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:52.403062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3799f3b-4ae0-41f4-b0d7-7d0aeb54a36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:52.403333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3799f3b-4ae0-41f4-b0d7-7d0aeb54a36d admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:52.404057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3799f3b-4ae0-41f4-b0d7-7d0aeb54a36d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:36:52.405833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: WARNING py.warnings [None req-b3799f3b-4ae0-41f4-b0d7-7d0aeb54a36d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:36:52.405833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: warnings.warn(msg) May 12 17:36:52.405833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: May 12 17:36:52.407126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3799f3b-4ae0-41f4-b0d7-7d0aeb54a36d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:36:52.425571 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 745/1478] 10.222.0.76 () {56 vars in 1108 bytes} [Thu May 12 17:36:52 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:36:54.688884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe903-be51-4061-999d-ff1f4f679c56 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:54.689430 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe903-be51-4061-999d-ff1f4f679c56 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:54.689430 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe903-be51-4061-999d-ff1f4f679c56 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:54.690876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 734/1479] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:36:54.696153 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6f24b-8f01-47b1-bb38-977ab4c9b865 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:54.696604 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6f24b-8f01-47b1-bb38-977ab4c9b865 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:54.696715 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6f24b-8f01-47b1-bb38-977ab4c9b865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:54.715846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ddf6f24b-8f01-47b1-bb38-977ab4c9b865 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:36:54.717019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ddf6f24b-8f01-47b1-bb38-977ab4c9b865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:36:54.725303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 746/1480] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:36:54.767486 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe903-be51-4061-999d-ff1f4f679c56 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:36:54.782174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe903-be51-4061-999d-ff1f4f679c56 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:36:54.787558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdab79-8dae-40c6-886b-0257c32a781e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:36:54.788191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdab79-8dae-40c6-886b-0257c32a781e service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:54.788474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdab79-8dae-40c6-886b-0257c32a781e service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:54.788752 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdab79-8dae-40c6-886b-0257c32a781e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:54.796982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdab79-8dae-40c6-886b-0257c32a781e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:36:54.798562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdab79-8dae-40c6-886b-0257c32a781e service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:36:54.807982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 735/1481] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:36:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:36:57.260819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8585b1f-cacc-470a-8935-8f95eb6c0b2d None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:57.261357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8585b1f-cacc-470a-8935-8f95eb6c0b2d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:57.261357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8585b1f-cacc-470a-8935-8f95eb6c0b2d None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:57.263007 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 747/1482] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:36:57.268391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cef8c-16c3-4f9e-95e8-234fc8b467e8 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:57.268838 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cef8c-16c3-4f9e-95e8-234fc8b467e8 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:57.268934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cef8c-16c3-4f9e-95e8-234fc8b467e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:57.286399 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-455cef8c-16c3-4f9e-95e8-234fc8b467e8 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:36:57.287636 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-455cef8c-16c3-4f9e-95e8-234fc8b467e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:36:57.295742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 736/1483] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:36:57.332475 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8585b1f-cacc-470a-8935-8f95eb6c0b2d None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:36:57.343097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8585b1f-cacc-470a-8935-8f95eb6c0b2d None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:36:57.346561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eff572-3a6d-4366-93ac-03d99490f815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:36:57.347251 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eff572-3a6d-4366-93ac-03d99490f815 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:57.347743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eff572-3a6d-4366-93ac-03d99490f815 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:57.347743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eff572-3a6d-4366-93ac-03d99490f815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:57.356644 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eff572-3a6d-4366-93ac-03d99490f815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:36:57.358077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eff572-3a6d-4366-93ac-03d99490f815 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:36:57.367259 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 748/1484] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:36:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:36:59.643816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613325d7-bdb5-4a5c-b5bd-ec661d40651e None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:59.643816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613325d7-bdb5-4a5c-b5bd-ec661d40651e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:59.644629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613325d7-bdb5-4a5c-b5bd-ec661d40651e None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:59.645414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 737/1485] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:36:59.650599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7f1c-4875-4a00-bc73-1df39259f9df None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:59.651084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7f1c-4875-4a00-bc73-1df39259f9df None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:59.651183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7f1c-4875-4a00-bc73-1df39259f9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:59.668532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-f0ad7f1c-4875-4a00-bc73-1df39259f9df None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:36:59.669722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f0ad7f1c-4875-4a00-bc73-1df39259f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:36:59.677526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 749/1486] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:36:59.715382 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613325d7-bdb5-4a5c-b5bd-ec661d40651e None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:36:59.726370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613325d7-bdb5-4a5c-b5bd-ec661d40651e None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:36:59.730021 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90ad6d-61e3-47a4-bfe1-d40ba03ae24e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:36:59.730650 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90ad6d-61e3-47a4-bfe1-d40ba03ae24e service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:36:59.730963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90ad6d-61e3-47a4-bfe1-d40ba03ae24e service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:36:59.731237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90ad6d-61e3-47a4-bfe1-d40ba03ae24e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:36:59.739811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90ad6d-61e3-47a4-bfe1-d40ba03ae24e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:36:59.741226 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90ad6d-61e3-47a4-bfe1-d40ba03ae24e service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:36:59.750861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 738/1487] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:37:02.144970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c9942-7866-4ee6-a73b-a7f294c955b6 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:37:02.145580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c9942-7866-4ee6-a73b-a7f294c955b6 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:37:02.145580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c9942-7866-4ee6-a73b-a7f294c955b6 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:37:02.147077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 750/1488] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:37:02.152805 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558621f-3b0d-4309-8e5b-2ba0d051203c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:37:02.153230 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558621f-3b0d-4309-8e5b-2ba0d051203c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:37:02.153365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558621f-3b0d-4309-8e5b-2ba0d051203c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:37:02.171274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-7558621f-3b0d-4309-8e5b-2ba0d051203c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:37:02.172470 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-7558621f-3b0d-4309-8e5b-2ba0d051203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:37:02.180158 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 739/1489] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:37:02.221358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c9942-7866-4ee6-a73b-a7f294c955b6 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:37:02.232005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c9942-7866-4ee6-a73b-a7f294c955b6 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:37:02.235569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d4fa8-f131-4da0-a1dd-2bae8df605a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:37:02.236207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d4fa8-f131-4da0-a1dd-2bae8df605a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:37:02.236490 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d4fa8-f131-4da0-a1dd-2bae8df605a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:37:02.236765 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d4fa8-f131-4da0-a1dd-2bae8df605a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:37:02.245797 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d4fa8-f131-4da0-a1dd-2bae8df605a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:37:02.247279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d4fa8-f131-4da0-a1dd-2bae8df605a7 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:37:02.256452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 751/1490] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:37:04.703473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b639-e636-447f-ad8d-27d5a5abb5ed None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:37:04.704045 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b639-e636-447f-ad8d-27d5a5abb5ed None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:37:04.704045 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b639-e636-447f-ad8d-27d5a5abb5ed None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:37:04.705381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 740/1491] 10.222.0.76 () {54 vars in 926 bytes} [Thu May 12 17:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:37:04.710722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0232c22-45ca-4ace-98ed-e1f67b95c7a5 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:37:04.711130 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0232c22-45ca-4ace-98ed-e1f67b95c7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:37:04.711278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0232c22-45ca-4ace-98ed-e1f67b95c7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:37:04.730840 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-f0232c22-45ca-4ace-98ed-e1f67b95c7a5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:37:04.732023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f0232c22-45ca-4ace-98ed-e1f67b95c7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:37:04.739667 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 752/1492] 10.222.0.76 () {58 vars in 1023 bytes} [Thu May 12 17:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:37:04.778161 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998b639-e636-447f-ad8d-27d5a5abb5ed None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:37:04.788674 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998b639-e636-447f-ad8d-27d5a5abb5ed None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:37:04.793322 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fcec7-2836-4080-91e8-c01156685966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:37:04.793944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fcec7-2836-4080-91e8-c01156685966 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:37:04.794220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fcec7-2836-4080-91e8-c01156685966 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:37:04.794488 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fcec7-2836-4080-91e8-c01156685966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:37:04.803746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fcec7-2836-4080-91e8-c01156685966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:37:04.805161 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fcec7-2836-4080-91e8-c01156685966 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:37:04.814646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 741/1493] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:38:41.369609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bebb62-2fa3-4745-b7f7-092f4dd34aa1 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:41.370203 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bebb62-2fa3-4745-b7f7-092f4dd34aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:41.370203 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bebb62-2fa3-4745-b7f7-092f4dd34aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:41.388188 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-24bebb62-2fa3-4745-b7f7-092f4dd34aa1 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:38:41.389377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-24bebb62-2fa3-4745-b7f7-092f4dd34aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:38:41.397172 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 753/1494] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:38:41.407068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58b7ea-6554-43bb-b00f-da8f11173768 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:41.407527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58b7ea-6554-43bb-b00f-da8f11173768 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:41.407630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58b7ea-6554-43bb-b00f-da8f11173768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:41.425565 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-0d58b7ea-6554-43bb-b00f-da8f11173768 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:38:41.426783 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0d58b7ea-6554-43bb-b00f-da8f11173768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:38:41.435067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 742/1495] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:38:41.439489 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bebb62-2fa3-4745-b7f7-092f4dd34aa1 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:38:41.449842 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bebb62-2fa3-4745-b7f7-092f4dd34aa1 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:38:41.454305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96d90f-4e85-4f08-a957-c7ab0fb2eb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:38:41.454989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96d90f-4e85-4f08-a957-c7ab0fb2eb3e admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:41.455270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96d90f-4e85-4f08-a957-c7ab0fb2eb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:41.455546 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96d90f-4e85-4f08-a957-c7ab0fb2eb3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:41.456281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96d90f-4e85-4f08-a957-c7ab0fb2eb3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:38:41.456589 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96d90f-4e85-4f08-a957-c7ab0fb2eb3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:38:41.457610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: WARNING py.warnings [None req-de96d90f-4e85-4f08-a957-c7ab0fb2eb3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:38:41.457610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: warnings.warn(msg) May 12 17:38:41.457610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: May 12 17:38:41.458491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96d90f-4e85-4f08-a957-c7ab0fb2eb3e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:38:41.469985 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 754/1496] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:38:41.478058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58b7ea-6554-43bb-b00f-da8f11173768 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:38:41.486977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58b7ea-6554-43bb-b00f-da8f11173768 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:38:41.491492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f797fe-e5d2-4349-a24f-61d2ffbd7c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:38:41.492076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f797fe-e5d2-4349-a24f-61d2ffbd7c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:41.492908 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f797fe-e5d2-4349-a24f-61d2ffbd7c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:41.493332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f797fe-e5d2-4349-a24f-61d2ffbd7c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:41.494029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f797fe-e5d2-4349-a24f-61d2ffbd7c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:38:41.495827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: WARNING py.warnings [None req-27f797fe-e5d2-4349-a24f-61d2ffbd7c10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:38:41.495827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: warnings.warn(msg) May 12 17:38:41.495827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: May 12 17:38:41.497030 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f797fe-e5d2-4349-a24f-61d2ffbd7c10 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:38:41.533482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 743/1497] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:38:41 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:38:41.537858 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96d90f-4e85-4f08-a957-c7ab0fb2eb3e admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:38:41.548173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96d90f-4e85-4f08-a957-c7ab0fb2eb3e admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:38:41.604112 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc94003-d576-41f1-9931-845b6fecd018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:38:41.604768 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc94003-d576-41f1-9931-845b6fecd018 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:41.605046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc94003-d576-41f1-9931-845b6fecd018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:41.605315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc94003-d576-41f1-9931-845b6fecd018 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:41.606028 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc94003-d576-41f1-9931-845b6fecd018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:38:41.607096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: WARNING py.warnings [None req-afc94003-d576-41f1-9931-845b6fecd018 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:38:41.607096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: warnings.warn(msg) May 12 17:38:41.607096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: May 12 17:38:41.608305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc94003-d576-41f1-9931-845b6fecd018 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:38:41.628142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 755/1498] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:38:41 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:38:41.632253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f797fe-e5d2-4349-a24f-61d2ffbd7c10 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:38:41.643048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f797fe-e5d2-4349-a24f-61d2ffbd7c10 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:38:41.647494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679a964-1ec5-4939-ab26-8c16a2b88131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:38:41.648145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679a964-1ec5-4939-ab26-8c16a2b88131 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:41.648426 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679a964-1ec5-4939-ab26-8c16a2b88131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:41.649363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679a964-1ec5-4939-ab26-8c16a2b88131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:41.650300 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679a964-1ec5-4939-ab26-8c16a2b88131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:38:41.651143 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: WARNING py.warnings [None req-c679a964-1ec5-4939-ab26-8c16a2b88131 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:38:41.651143 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: warnings.warn(msg) May 12 17:38:41.651143 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: May 12 17:38:41.652035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679a964-1ec5-4939-ab26-8c16a2b88131 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:38:41.664705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 744/1499] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:38:41.668718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc94003-d576-41f1-9931-845b6fecd018 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:38:41.678712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc94003-d576-41f1-9931-845b6fecd018 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:38:41.683540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a50e1d-eb84-428d-8c2e-1a679c9a3d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:38:41.684193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a50e1d-eb84-428d-8c2e-1a679c9a3d7e admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:41.684472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a50e1d-eb84-428d-8c2e-1a679c9a3d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:41.684746 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a50e1d-eb84-428d-8c2e-1a679c9a3d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:41.685459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a50e1d-eb84-428d-8c2e-1a679c9a3d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:38:41.686467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: WARNING py.warnings [None req-f7a50e1d-eb84-428d-8c2e-1a679c9a3d7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:38:41.686467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: warnings.warn(msg) May 12 17:38:41.686467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: May 12 17:38:41.687368 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a50e1d-eb84-428d-8c2e-1a679c9a3d7e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:38:41.700875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 756/1500] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:38:41.704922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679a964-1ec5-4939-ab26-8c16a2b88131 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:38:41.715225 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679a964-1ec5-4939-ab26-8c16a2b88131 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:38:41.719704 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c16111-6b6d-451c-81a5-5f7a80280ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:38:41.720575 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c16111-6b6d-451c-81a5-5f7a80280ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:41.720856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c16111-6b6d-451c-81a5-5f7a80280ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:41.721130 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c16111-6b6d-451c-81a5-5f7a80280ce4 admin admin] PATH_INFO: `/v3/projects/ee8bc42c5f574c5ab8c261070b6f34dc/users/6f03154d0f504a1190ca48868535e332/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:41.735441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c16111-6b6d-451c-81a5-5f7a80280ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8bc42c5f574c5ab8c261070b6f34dc, user_id=6f03154d0f504a1190ca48868535e332, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:38:41.736478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: WARNING py.warnings [None req-01c16111-6b6d-451c-81a5-5f7a80280ce4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:38:41.736478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: warnings.warn(msg) May 12 17:38:41.736478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: May 12 17:38:41.738432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c16111-6b6d-451c-81a5-5f7a80280ce4 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:38:41.750918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 745/1501] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:38:41 2022] PUT /identity/v3/projects/ee8bc42c5f574c5ab8c261070b6f34dc/users/6f03154d0f504a1190ca48868535e332/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:38:41.763140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d8f2b-8bc4-49b3-a44a-95657d695256 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:41.763428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d8f2b-8bc4-49b3-a44a-95657d695256 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:41.763704 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d8f2b-8bc4-49b3-a44a-95657d695256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:41.789520 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-9e4d8f2b-8bc4-49b3-a44a-95657d695256 None None] MFA Rules not processed for user `6f03154d0f504a1190ca48868535e332`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:38:41.790937 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9e4d8f2b-8bc4-49b3-a44a-95657d695256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:38:41.850905 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 757/1502] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:38:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:38:41.864826 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf93c0-82f5-48d7-ab12-63fa3a8eba00 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:41.865117 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf93c0-82f5-48d7-ab12-63fa3a8eba00 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:41.865397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf93c0-82f5-48d7-ab12-63fa3a8eba00 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:41.866789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 746/1503] 10.222.0.76 () {54 vars in 963 bytes} [Thu May 12 17:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:38:41.872447 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59048e1a-e99e-429a-86b1-757eda202b43 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:41.872737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59048e1a-e99e-429a-86b1-757eda202b43 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:41.873015 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59048e1a-e99e-429a-86b1-757eda202b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:41.890813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-59048e1a-e99e-429a-86b1-757eda202b43 None None] MFA Rules not processed for user `7ffc2e3a517e48c4bf368bdc0dd18ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:38:41.892005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-59048e1a-e99e-429a-86b1-757eda202b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:38:41.941418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 758/1504] 10.222.0.76 () {58 vars in 1060 bytes} [Thu May 12 17:38:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:38:41.949705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf93c0-82f5-48d7-ab12-63fa3a8eba00 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:38:41.959844 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf93c0-82f5-48d7-ab12-63fa3a8eba00 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:38:41.963903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f811c-53cc-4ef2-8b6f-a1ae28782705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:38:41.964528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f811c-53cc-4ef2-8b6f-a1ae28782705 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:41.964806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f811c-53cc-4ef2-8b6f-a1ae28782705 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:41.965077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f811c-53cc-4ef2-8b6f-a1ae28782705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:41.973635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f811c-53cc-4ef2-8b6f-a1ae28782705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:38:41.975099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f811c-53cc-4ef2-8b6f-a1ae28782705 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:38:41.984960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 747/1505] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:38:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:38:42.027244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29536c91-f32d-451b-8ac5-a0f79e0df25f None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:42.027826 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29536c91-f32d-451b-8ac5-a0f79e0df25f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:42.027826 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29536c91-f32d-451b-8ac5-a0f79e0df25f None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:42.029043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 759/1506] 10.222.0.76 () {52 vars in 829 bytes} [Thu May 12 17:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:38:42.033133 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f811c-53cc-4ef2-8b6f-a1ae28782705 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:38:42.094209 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f811c-53cc-4ef2-8b6f-a1ae28782705 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:38:42.098575 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:38:42.099454 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:42.099728 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:42.099996 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] PATH_INFO: `/v3/users/6f03154d0f504a1190ca48868535e332` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:42.101143 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f03154d0f504a1190ca48868535e332)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:38:42.102944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: WARNING py.warnings [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:38:42.102944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: warnings.warn(msg) May 12 17:38:42.102944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: May 12 17:38:42.104132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:38:42.168029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f03154d0f504a1190ca48868535e332'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:38:42.168680 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f03154d0f504a1190ca48868535e332'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:38:42.169401 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f03154d0f504a1190ca48868535e332'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:38:42.187377 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f03154d0f504a1190ca48868535e332'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:38:42.199805 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f03154d0f504a1190ca48868535e332'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:38:42.214662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 748/1507] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:38:42 2022] DELETE /identity/v3/users/6f03154d0f504a1190ca48868535e332 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:38:42.219240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab4e4a-953f-4f22-8126-2bb9320af65d None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:42.219622 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab4e4a-953f-4f22-8126-2bb9320af65d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:42.219899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab4e4a-953f-4f22-8126-2bb9320af65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:42.238481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-53ab4e4a-953f-4f22-8126-2bb9320af65d None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:38:42.239747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-53ab4e4a-953f-4f22-8126-2bb9320af65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:38:42.298154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 760/1508] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:38:42.308281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:38:42.309691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:38:42.364537 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707f63f-13a6-43f5-ac23-7eec8453851b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:38:42.368745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ee18e-ebaf-4107-8ba4-bf6fe0d0e4bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:38:42.369387 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ee18e-ebaf-4107-8ba4-bf6fe0d0e4bb service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:42.369670 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ee18e-ebaf-4107-8ba4-bf6fe0d0e4bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:42.369944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ee18e-ebaf-4107-8ba4-bf6fe0d0e4bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:42.378658 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ee18e-ebaf-4107-8ba4-bf6fe0d0e4bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:38:42.380115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ee18e-ebaf-4107-8ba4-bf6fe0d0e4bb service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:38:42.389722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 749/1509] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:38:42.729673 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab4e4a-953f-4f22-8126-2bb9320af65d None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:38:42.731202 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-53ab4e4a-953f-4f22-8126-2bb9320af65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:38:42.743575 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab4e4a-953f-4f22-8126-2bb9320af65d None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:38:42.748593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aab95-fa4a-4213-b05a-925b9b143a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:38:42.750573 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aab95-fa4a-4213-b05a-925b9b143a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:38:42.750892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aab95-fa4a-4213-b05a-925b9b143a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:38:42.751341 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aab95-fa4a-4213-b05a-925b9b143a0f admin admin] PATH_INFO: `/v3/projects/ee8bc42c5f574c5ab8c261070b6f34dc` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:38:42.752544 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aab95-fa4a-4213-b05a-925b9b143a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8bc42c5f574c5ab8c261070b6f34dc)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:38:42.753569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: WARNING py.warnings [None req-9d1aab95-fa4a-4213-b05a-925b9b143a0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:38:42.753569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: warnings.warn(msg) May 12 17:38:42.753569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: May 12 17:38:42.755459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aab95-fa4a-4213-b05a-925b9b143a0f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:38:42.816748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9d1aab95-fa4a-4213-b05a-925b9b143a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8bc42c5f574c5ab8c261070b6f34dc', 'request_id': 'req-9d1aab95-fa4a-4213-b05a-925b9b143a0f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:38:42.827171 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9d1aab95-fa4a-4213-b05a-925b9b143a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8bc42c5f574c5ab8c261070b6f34dc', 'request_id': 'req-9d1aab95-fa4a-4213-b05a-925b9b143a0f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:38:42.833090 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9d1aab95-fa4a-4213-b05a-925b9b143a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8bc42c5f574c5ab8c261070b6f34dc', 'request_id': 'req-9d1aab95-fa4a-4213-b05a-925b9b143a0f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:38:42.851576 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9d1aab95-fa4a-4213-b05a-925b9b143a0f admin admin] The token cache is being invalidate because project ee8bc42c5f574c5ab8c261070b6f34dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:38:42.852559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9d1aab95-fa4a-4213-b05a-925b9b143a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:38:42.853216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9d1aab95-fa4a-4213-b05a-925b9b143a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:38:42.854901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 761/1510] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:38:42 2022] DELETE /identity/v3/projects/ee8bc42c5f574c5ab8c261070b6f34dc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:40:30.631801 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a15f13-59f5-4800-a853-db0f27067ab0 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:30.632440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a15f13-59f5-4800-a853-db0f27067ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:30.632440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a15f13-59f5-4800-a853-db0f27067ab0 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:30.634484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:40:30.639898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad6bcc-86e8-4f47-a16b-924303f594f6 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:30.640403 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad6bcc-86e8-4f47-a16b-924303f594f6 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:30.640540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad6bcc-86e8-4f47-a16b-924303f594f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:30.660050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-9dad6bcc-86e8-4f47-a16b-924303f594f6 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:40:30.663018 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9dad6bcc-86e8-4f47-a16b-924303f594f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:30.735925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:40:30.937612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a15f13-59f5-4800-a853-db0f27067ab0 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:40:30.939273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a6a15f13-59f5-4800-a853-db0f27067ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:31.026718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a15f13-59f5-4800-a853-db0f27067ab0 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:40:31.032027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2d061-3682-4143-b626-ccc8c52ac123 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:40:31.032678 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2d061-3682-4143-b626-ccc8c52ac123 service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:31.033056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2d061-3682-4143-b626-ccc8c52ac123 service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:31.034605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2d061-3682-4143-b626-ccc8c52ac123 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:31.044197 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2d061-3682-4143-b626-ccc8c52ac123 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:40:31.045799 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2d061-3682-4143-b626-ccc8c52ac123 service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:40:31.057283 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 751/1513] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:40:31.993734 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd279-6d0e-4a4b-b523-aa2ffbc3e93d None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:31.994310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd279-6d0e-4a4b-b523-aa2ffbc3e93d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:31.994310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd279-6d0e-4a4b-b523-aa2ffbc3e93d None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:31.995708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:40:32.000422 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559bade-2e77-4819-a8e9-f49c61800077 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:32.000820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559bade-2e77-4819-a8e9-f49c61800077 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:32.000977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559bade-2e77-4819-a8e9-f49c61800077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:32.019374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-2559bade-2e77-4819-a8e9-f49c61800077 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:40:32.020595 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2559bade-2e77-4819-a8e9-f49c61800077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:32.030788 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:40:32.191001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bd279-6d0e-4a4b-b523-aa2ffbc3e93d None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:40:32.205967 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bd279-6d0e-4a4b-b523-aa2ffbc3e93d None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:40:32.212071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ade9a-7036-452e-b888-c38f07dcce36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:40:32.212699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ade9a-7036-452e-b888-c38f07dcce36 service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:32.212976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ade9a-7036-452e-b888-c38f07dcce36 service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:32.213249 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ade9a-7036-452e-b888-c38f07dcce36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:32.221014 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ade9a-7036-452e-b888-c38f07dcce36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:40:32.222614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ade9a-7036-452e-b888-c38f07dcce36 service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:40:32.231899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 764/1516] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:40:33.883686 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05052e8-ea9e-4a29-80f1-9df57f542a08 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:33.884178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05052e8-ea9e-4a29-80f1-9df57f542a08 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:33.884293 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05052e8-ea9e-4a29-80f1-9df57f542a08 None None] PATH_INFO: `/v3` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:33.885569 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 753/1517] 10.222.0.89 () {54 vars in 925 bytes} [Thu May 12 17:40:33 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:40:33.894926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44fa93-7316-4d8b-bff0-50ab8a3b3b5f None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:33.895385 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44fa93-7316-4d8b-bff0-50ab8a3b3b5f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:33.895485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44fa93-7316-4d8b-bff0-50ab8a3b3b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:33.915698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-2f44fa93-7316-4d8b-bff0-50ab8a3b3b5f None None] MFA Rules not processed for user `a01fa037b14c456eb533b5a86da0a370`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:40:33.916920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-2f44fa93-7316-4d8b-bff0-50ab8a3b3b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:33.979157 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 765/1518] 10.222.0.89 () {58 vars in 1015 bytes} [Thu May 12 17:40:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:40:38.399485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95af53-2d3b-4c9d-90f7-78bebaf9bef5 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:38.400077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95af53-2d3b-4c9d-90f7-78bebaf9bef5 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:38.400077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95af53-2d3b-4c9d-90f7-78bebaf9bef5 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:38.401432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 754/1519] 10.222.0.76 () {54 vars in 960 bytes} [Thu May 12 17:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:40:38.406292 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb66758-3832-4db5-b3e7-5fb176223aa3 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:38.406841 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb66758-3832-4db5-b3e7-5fb176223aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:38.407311 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb66758-3832-4db5-b3e7-5fb176223aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:38.425351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ddb66758-3832-4db5-b3e7-5fb176223aa3 None None] MFA Rules not processed for user `a01fa037b14c456eb533b5a86da0a370`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:40:38.426541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ddb66758-3832-4db5-b3e7-5fb176223aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:38.435570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 766/1520] 10.222.0.76 () {58 vars in 1057 bytes} [Thu May 12 17:40:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:40:38.443123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95af53-2d3b-4c9d-90f7-78bebaf9bef5 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:40:38.456950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95af53-2d3b-4c9d-90f7-78bebaf9bef5 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:40:38.462312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a43ed-6848-47c4-bb2c-dd30425f2c11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01fa037b14c456eb533b5a86da0a370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:40:38.462974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a43ed-6848-47c4-bb2c-dd30425f2c11 service placement] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:38.463257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a43ed-6848-47c4-bb2c-dd30425f2c11 service placement] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:38.463529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a43ed-6848-47c4-bb2c-dd30425f2c11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:38.471750 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a43ed-6848-47c4-bb2c-dd30425f2c11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:40:38.473331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a43ed-6848-47c4-bb2c-dd30425f2c11 service placement] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:40:38.483521 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 755/1521] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:40:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:40:43.559769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80591b06-12ff-47f8-9928-d511ff5943a5 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:43.560281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80591b06-12ff-47f8-9928-d511ff5943a5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:43.560281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80591b06-12ff-47f8-9928-d511ff5943a5 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:43.561621 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:40:43.566661 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847949b-a4f7-4c7d-8953-499cb8d68f9d None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:43.567092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847949b-a4f7-4c7d-8953-499cb8d68f9d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:43.567245 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847949b-a4f7-4c7d-8953-499cb8d68f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:43.585456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-1847949b-a4f7-4c7d-8953-499cb8d68f9d None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:40:43.586652 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1847949b-a4f7-4c7d-8953-499cb8d68f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:43.594249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:40:43.751645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80591b06-12ff-47f8-9928-d511ff5943a5 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:40:43.765946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80591b06-12ff-47f8-9928-d511ff5943a5 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:40:43.771216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816636e3-31fe-446a-bddc-1f70927ddcaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:40:43.771844 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816636e3-31fe-446a-bddc-1f70927ddcaf service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:43.772677 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816636e3-31fe-446a-bddc-1f70927ddcaf service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:43.772913 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816636e3-31fe-446a-bddc-1f70927ddcaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:43.780929 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816636e3-31fe-446a-bddc-1f70927ddcaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:40:43.782497 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816636e3-31fe-446a-bddc-1f70927ddcaf service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:40:43.792542 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 768/1524] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:40:44.695308 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1626389-3776-4b5a-a089-1e83e996441f None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:44.695891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1626389-3776-4b5a-a089-1e83e996441f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:44.695891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1626389-3776-4b5a-a089-1e83e996441f None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:44.697272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:40:44.701968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23afe3a-41fe-49e9-a64b-47d4d462c856 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:44.702369 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23afe3a-41fe-49e9-a64b-47d4d462c856 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:44.702514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23afe3a-41fe-49e9-a64b-47d4d462c856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:44.720414 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-b23afe3a-41fe-49e9-a64b-47d4d462c856 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:40:44.721589 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b23afe3a-41fe-49e9-a64b-47d4d462c856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:44.730336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:40:44.882432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1626389-3776-4b5a-a089-1e83e996441f None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:40:44.896857 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1626389-3776-4b5a-a089-1e83e996441f None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:40:44.903085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b5926-c0c9-462b-a484-1f5a4227d5e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:40:44.903712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b5926-c0c9-462b-a484-1f5a4227d5e0 service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:44.903989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b5926-c0c9-462b-a484-1f5a4227d5e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:44.904257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b5926-c0c9-462b-a484-1f5a4227d5e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:44.912182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b5926-c0c9-462b-a484-1f5a4227d5e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:40:44.913817 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b5926-c0c9-462b-a484-1f5a4227d5e0 service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:40:44.922836 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 758/1527] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:40:49.188309 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50571a20-a9ed-482a-85d3-c6cbf53c6059 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:49.188884 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50571a20-a9ed-482a-85d3-c6cbf53c6059 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:49.188884 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50571a20-a9ed-482a-85d3-c6cbf53c6059 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:49.190236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:40:49.196347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014f1c-da4c-4447-b392-0819455f492d None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:49.196790 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014f1c-da4c-4447-b392-0819455f492d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:49.196893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014f1c-da4c-4447-b392-0819455f492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:49.216736 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ec014f1c-da4c-4447-b392-0819455f492d None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:40:49.217936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ec014f1c-da4c-4447-b392-0819455f492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:49.225930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:40:49.264530 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50571a20-a9ed-482a-85d3-c6cbf53c6059 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:40:49.266254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-50571a20-a9ed-482a-85d3-c6cbf53c6059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:49.323109 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50571a20-a9ed-482a-85d3-c6cbf53c6059 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:40:49.326601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73936d-39b1-429e-9586-d3d2ed934b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:40:49.327274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73936d-39b1-429e-9586-d3d2ed934b18 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:49.327555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73936d-39b1-429e-9586-d3d2ed934b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:49.327831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73936d-39b1-429e-9586-d3d2ed934b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:49.336497 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73936d-39b1-429e-9586-d3d2ed934b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:40:49.337916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73936d-39b1-429e-9586-d3d2ed934b18 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:40:49.347075 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 771/1530] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:40:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:40:51.584614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9039e9d-9d0e-4d4d-a0d3-029147a85706 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:51.585632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9039e9d-9d0e-4d4d-a0d3-029147a85706 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:51.585632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9039e9d-9d0e-4d4d-a0d3-029147a85706 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:51.586651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:40:51.591840 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47202cc-5d4c-4786-9279-8698d7018d2d None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:51.592273 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47202cc-5d4c-4786-9279-8698d7018d2d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:51.592387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47202cc-5d4c-4786-9279-8698d7018d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:51.610584 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-b47202cc-5d4c-4786-9279-8698d7018d2d None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:40:51.611802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b47202cc-5d4c-4786-9279-8698d7018d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:51.620430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:40:51.657023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9039e9d-9d0e-4d4d-a0d3-029147a85706 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:40:51.658765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b9039e9d-9d0e-4d4d-a0d3-029147a85706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:51.672453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9039e9d-9d0e-4d4d-a0d3-029147a85706 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:40:51.675916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210597a-54f0-45c8-85d1-cbd4cd5644e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:40:51.676554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210597a-54f0-45c8-85d1-cbd4cd5644e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:51.676835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210597a-54f0-45c8-85d1-cbd4cd5644e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:51.677108 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210597a-54f0-45c8-85d1-cbd4cd5644e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:51.686522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210597a-54f0-45c8-85d1-cbd4cd5644e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:40:51.687977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210597a-54f0-45c8-85d1-cbd4cd5644e0 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:40:51.697235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 761/1533] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:40:55.501980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c976df-e94f-4dbd-be2f-de0e290fdd24 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:55.502460 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c976df-e94f-4dbd-be2f-de0e290fdd24 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:55.502556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c976df-e94f-4dbd-be2f-de0e290fdd24 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:55.503914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:40:55.509254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f35e0-3a16-4450-a47b-dc6be44d16ec None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:55.509703 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f35e0-3a16-4450-a47b-dc6be44d16ec None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:55.509822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f35e0-3a16-4450-a47b-dc6be44d16ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:55.527687 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-bd4f35e0-3a16-4450-a47b-dc6be44d16ec None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:40:55.528881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-bd4f35e0-3a16-4450-a47b-dc6be44d16ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:55.536560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:40:55.812769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c976df-e94f-4dbd-be2f-de0e290fdd24 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:40:55.814471 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-67c976df-e94f-4dbd-be2f-de0e290fdd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:55.870416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c976df-e94f-4dbd-be2f-de0e290fdd24 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:40:55.873951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fa228-5e2f-4efa-acb6-70c0668ea910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:40:55.874589 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fa228-5e2f-4efa-acb6-70c0668ea910 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:55.874899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fa228-5e2f-4efa-acb6-70c0668ea910 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:55.875179 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fa228-5e2f-4efa-acb6-70c0668ea910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:55.884046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fa228-5e2f-4efa-acb6-70c0668ea910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:40:55.885511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fa228-5e2f-4efa-acb6-70c0668ea910 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:40:55.894995 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 774/1536] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:40:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:40:58.176738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be40e5-d79e-47b0-8843-205d485ba5cb None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:58.177624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be40e5-d79e-47b0-8843-205d485ba5cb None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:58.177624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be40e5-d79e-47b0-8843-205d485ba5cb None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:58.179975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:40:58.185112 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d736831-80f6-4046-a097-36be5ae57bc0 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:58.185522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d736831-80f6-4046-a097-36be5ae57bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:58.185661 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d736831-80f6-4046-a097-36be5ae57bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:58.204336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-5d736831-80f6-4046-a097-36be5ae57bc0 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:40:58.205514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5d736831-80f6-4046-a097-36be5ae57bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:58.213503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:40:58.483975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be40e5-d79e-47b0-8843-205d485ba5cb None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:40:58.485654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-e6be40e5-d79e-47b0-8843-205d485ba5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:40:58.499401 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be40e5-d79e-47b0-8843-205d485ba5cb None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:40:58.502873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5852a-cccf-4281-9c2b-f0eb94933422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:40:58.503529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5852a-cccf-4281-9c2b-f0eb94933422 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:40:58.503804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5852a-cccf-4281-9c2b-f0eb94933422 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:40:58.504068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5852a-cccf-4281-9c2b-f0eb94933422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:40:58.513179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5852a-cccf-4281-9c2b-f0eb94933422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:40:58.514875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5852a-cccf-4281-9c2b-f0eb94933422 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:40:58.524385 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 764/1539] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:30.511212 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6b55-a938-4aec-b635-d29a166870d9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:30.511975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6b55-a938-4aec-b635-d29a166870d9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:30.511975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6b55-a938-4aec-b635-d29a166870d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:30.555641 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-45ae6b55-a938-4aec-b635-d29a166870d9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:30.557871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-45ae6b55-a938-4aec-b635-d29a166870d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:30.574497 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 776/1540] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:30.585363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1361f6-2d4d-48df-b7c5-3667d7d6966c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:30.585956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1361f6-2d4d-48df-b7c5-3667d7d6966c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:30.585956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1361f6-2d4d-48df-b7c5-3667d7d6966c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:30.617962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-be1361f6-2d4d-48df-b7c5-3667d7d6966c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:30.620042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-be1361f6-2d4d-48df-b7c5-3667d7d6966c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:30.629030 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 765/1541] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:30.634280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae6b55-a938-4aec-b635-d29a166870d9 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:30.650220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae6b55-a938-4aec-b635-d29a166870d9 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:30.658706 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c3a4f-5a3a-4f18-96ce-f3aedd383493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:30.659516 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c3a4f-5a3a-4f18-96ce-f3aedd383493 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:30.659800 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c3a4f-5a3a-4f18-96ce-f3aedd383493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:30.660077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c3a4f-5a3a-4f18-96ce-f3aedd383493 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:30.661105 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c3a4f-5a3a-4f18-96ce-f3aedd383493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:42:30.661422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c3a4f-5a3a-4f18-96ce-f3aedd383493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:30.663086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c3a4f-5a3a-4f18-96ce-f3aedd383493 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:30.682512 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 777/1542] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:42:30.690816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1361f6-2d4d-48df-b7c5-3667d7d6966c None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:30.707307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c935259-93de-4f33-b129-c7ff23289e3a None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:30.707641 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c935259-93de-4f33-b129-c7ff23289e3a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:30.708000 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c935259-93de-4f33-b129-c7ff23289e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:30.708811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1361f6-2d4d-48df-b7c5-3667d7d6966c None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:30.732151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-2c935259-93de-4f33-b129-c7ff23289e3a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:30.732666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-2c935259-93de-4f33-b129-c7ff23289e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:30.737181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7c104-6ab6-497c-aee8-686aa1b593eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:30.738301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7c104-6ab6-497c-aee8-686aa1b593eb admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:30.738847 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7c104-6ab6-497c-aee8-686aa1b593eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:30.739352 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7c104-6ab6-497c-aee8-686aa1b593eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:30.740839 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7c104-6ab6-497c-aee8-686aa1b593eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:30.746151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7c104-6ab6-497c-aee8-686aa1b593eb admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:30.752171 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 778/1543] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:30.764494 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32184528-54fe-4142-9beb-af9dd111b8a6 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:30.764713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32184528-54fe-4142-9beb-af9dd111b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:30.765124 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32184528-54fe-4142-9beb-af9dd111b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:30.801033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 766/1544] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:30 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:30.807628 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419a4b7-6c8c-4f64-9677-6aef689f8dfa None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:30.808794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419a4b7-6c8c-4f64-9677-6aef689f8dfa None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:30.809251 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-32184528-54fe-4142-9beb-af9dd111b8a6 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:30.809869 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419a4b7-6c8c-4f64-9677-6aef689f8dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:30.810480 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-32184528-54fe-4142-9beb-af9dd111b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:30.843676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-d419a4b7-6c8c-4f64-9677-6aef689f8dfa None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:30.845566 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d419a4b7-6c8c-4f64-9677-6aef689f8dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:30.913665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 779/1545] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:30.914312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32184528-54fe-4142-9beb-af9dd111b8a6 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:30.931788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32184528-54fe-4142-9beb-af9dd111b8a6 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:30.937923 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 767/1546] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:30.939541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ce2b-2e11-48f2-bcaa-6ec538e247ce None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:30.939874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454027c-e457-4a41-92d0-d3de670c6c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:30.940407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ce2b-2e11-48f2-bcaa-6ec538e247ce None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:30.940527 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454027c-e457-4a41-92d0-d3de670c6c83 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:30.940814 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454027c-e457-4a41-92d0-d3de670c6c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:30.941257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ce2b-2e11-48f2-bcaa-6ec538e247ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:30.941498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454027c-e457-4a41-92d0-d3de670c6c83 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:30.942202 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454027c-e457-4a41-92d0-d3de670c6c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:30.946095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454027c-e457-4a41-92d0-d3de670c6c83 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:30.967414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-e5a5ce2b-2e11-48f2-bcaa-6ec538e247ce None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:30.969096 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-e5a5ce2b-2e11-48f2-bcaa-6ec538e247ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:30.972430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 780/1547] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:30 2022] POST /identity/v3/users => generated 287 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:30.976740 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8f14e-d6a3-45a5-8619-cc810cd725d5 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:30.977548 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8f14e-d6a3-45a5-8619-cc810cd725d5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:30.978452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8f14e-d6a3-45a5-8619-cc810cd725d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:30.984981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 768/1548] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:30.990223 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b81805-8562-4dc8-88a5-a93976b4c7f8 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:30.990223 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b81805-8562-4dc8-88a5-a93976b4c7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:30.990223 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b81805-8562-4dc8-88a5-a93976b4c7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.008966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-d6a8f14e-d6a3-45a5-8619-cc810cd725d5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:31.011439 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d6a8f14e-d6a3-45a5-8619-cc810cd725d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:31.026235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-b3b81805-8562-4dc8-88a5-a93976b4c7f8 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:31.027546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b3b81805-8562-4dc8-88a5-a93976b4c7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:31.029334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 781/1549] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:31.030792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dd47f-a09b-4404-a37d-8188bd7174fc None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.031077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dd47f-a09b-4404-a37d-8188bd7174fc None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.031344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dd47f-a09b-4404-a37d-8188bd7174fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.040440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 769/1550] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:31.042072 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b81805-8562-4dc8-88a5-a93976b4c7f8 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.053050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b81805-8562-4dc8-88a5-a93976b4c7f8 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.058693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f4e90-473e-4370-9f0d-1f0b6f370c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.059373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f4e90-473e-4370-9f0d-1f0b6f370c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.059653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f4e90-473e-4370-9f0d-1f0b6f370c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.059801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-953dd47f-a09b-4404-a37d-8188bd7174fc None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:31.059915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f4e90-473e-4370-9f0d-1f0b6f370c4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.060648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f4e90-473e-4370-9f0d-1f0b6f370c4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:42:31.060951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f4e90-473e-4370-9f0d-1f0b6f370c4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.061056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-953dd47f-a09b-4404-a37d-8188bd7174fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:31.061997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: WARNING py.warnings [None req-017f4e90-473e-4370-9f0d-1f0b6f370c4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:42:31.061997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: warnings.warn(msg) May 12 17:42:31.061997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: May 12 17:42:31.063033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f4e90-473e-4370-9f0d-1f0b6f370c4f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.072678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 782/1551] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:31.073225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dd47f-a09b-4404-a37d-8188bd7174fc None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.079329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 770/1552] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:42:31.080576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12b724-0936-46a2-80e8-e80b0b6f20a6 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.080788 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12b724-0936-46a2-80e8-e80b0b6f20a6 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.081067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12b724-0936-46a2-80e8-e80b0b6f20a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.084281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dd47f-a09b-4404-a37d-8188bd7174fc None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.090628 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31bf74-a9c1-4135-bb57-a4ea0da7abcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.091389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31bf74-a9c1-4135-bb57-a4ea0da7abcf admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.091604 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31bf74-a9c1-4135-bb57-a4ea0da7abcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.091879 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31bf74-a9c1-4135-bb57-a4ea0da7abcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.092655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31bf74-a9c1-4135-bb57-a4ea0da7abcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.096121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31bf74-a9c1-4135-bb57-a4ea0da7abcf admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.098928 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-1c12b724-0936-46a2-80e8-e80b0b6f20a6 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:31.100145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1c12b724-0936-46a2-80e8-e80b0b6f20a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:31.108039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 771/1553] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:31.108214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 783/1554] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:31.112542 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeca7c-98c4-4a91-a5b5-e5b592d27370 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.112542 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeca7c-98c4-4a91-a5b5-e5b592d27370 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.112542 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeca7c-98c4-4a91-a5b5-e5b592d27370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.112960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1e69d-6c98-4d75-8293-e78f08bbad21 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.112960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1e69d-6c98-4d75-8293-e78f08bbad21 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.112960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1e69d-6c98-4d75-8293-e78f08bbad21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.129943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-44aeca7c-98c4-4a91-a5b5-e5b592d27370 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:31.131154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-44aeca7c-98c4-4a91-a5b5-e5b592d27370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:31.135144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-9ef1e69d-6c98-4d75-8293-e78f08bbad21 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:31.136517 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9ef1e69d-6c98-4d75-8293-e78f08bbad21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:31.140940 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 784/1555] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:31.143796 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a6a90-7504-4934-a704-4c154aa9790b None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.144254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a6a90-7504-4934-a704-4c154aa9790b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.144745 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a6a90-7504-4934-a704-4c154aa9790b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.144867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 772/1556] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:31.152016 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449599-11f5-4a13-a25e-4ace0e644a59 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.152341 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449599-11f5-4a13-a25e-4ace0e644a59 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.152709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449599-11f5-4a13-a25e-4ace0e644a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.166142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-5d0a6a90-7504-4934-a704-4c154aa9790b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:31.167398 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5d0a6a90-7504-4934-a704-4c154aa9790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:31.170536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-38449599-11f5-4a13-a25e-4ace0e644a59 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:31.171736 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-38449599-11f5-4a13-a25e-4ace0e644a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:31.175367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 785/1557] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:31.176172 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a6a90-7504-4934-a704-4c154aa9790b None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.184036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 773/1558] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:31.185038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38449599-11f5-4a13-a25e-4ace0e644a59 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.190620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a6a90-7504-4934-a704-4c154aa9790b None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.195518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40621855-004b-4e26-842f-8f5d059664e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.195904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38449599-11f5-4a13-a25e-4ace0e644a59 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.196181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40621855-004b-4e26-842f-8f5d059664e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.197221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40621855-004b-4e26-842f-8f5d059664e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.197375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40621855-004b-4e26-842f-8f5d059664e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.198015 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40621855-004b-4e26-842f-8f5d059664e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:42:31.198492 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40621855-004b-4e26-842f-8f5d059664e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.200133 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40621855-004b-4e26-842f-8f5d059664e9 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.201746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1b5c5-a0fd-4656-9082-7d56b0751cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.202205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1b5c5-a0fd-4656-9082-7d56b0751cfd admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.202482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1b5c5-a0fd-4656-9082-7d56b0751cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.202919 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1b5c5-a0fd-4656-9082-7d56b0751cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.203651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1b5c5-a0fd-4656-9082-7d56b0751cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.205587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1b5c5-a0fd-4656-9082-7d56b0751cfd admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.215094 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 786/1559] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:42:31.216566 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40621855-004b-4e26-842f-8f5d059664e9 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.232690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40621855-004b-4e26-842f-8f5d059664e9 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.236265 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 774/1560] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:31.237241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1b5c5-a0fd-4656-9082-7d56b0751cfd admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.242299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40614de8-06d6-4792-b5e7-6d3c2bb1ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.244254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614de8-06d6-4792-b5e7-6d3c2bb1ae1d admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.244755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614de8-06d6-4792-b5e7-6d3c2bb1ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.245220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614de8-06d6-4792-b5e7-6d3c2bb1ae1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.246601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40614de8-06d6-4792-b5e7-6d3c2bb1ae1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.249004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40614de8-06d6-4792-b5e7-6d3c2bb1ae1d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.261387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 787/1561] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:31.262777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a98f7-9b5e-41c3-8045-ac5022a42bc2 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.263061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a98f7-9b5e-41c3-8045-ac5022a42bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.263416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a98f7-9b5e-41c3-8045-ac5022a42bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.284496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-590a98f7-9b5e-41c3-8045-ac5022a42bc2 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:31.285644 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-590a98f7-9b5e-41c3-8045-ac5022a42bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:31.311738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1b5c5-a0fd-4656-9082-7d56b0751cfd admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.325968 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5096c-8398-448e-b909-b5d084426d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.326755 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5096c-8398-448e-b909-b5d084426d54 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.327048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5096c-8398-448e-b909-b5d084426d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.327330 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5096c-8398-448e-b909-b5d084426d54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.328070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5096c-8398-448e-b909-b5d084426d54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:42:31.328381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5096c-8398-448e-b909-b5d084426d54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.330022 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5096c-8398-448e-b909-b5d084426d54 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.342240 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 775/1562] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:42:31.346983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 788/1563] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:31.347505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edb156-c5e0-4677-b6c3-746472fc2237 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.348019 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edb156-c5e0-4677-b6c3-746472fc2237 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.348141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a98f7-9b5e-41c3-8045-ac5022a42bc2 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.348640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edb156-c5e0-4677-b6c3-746472fc2237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.360371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a98f7-9b5e-41c3-8045-ac5022a42bc2 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.364989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c903cf0-527b-4abf-9537-054120790a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.365636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c903cf0-527b-4abf-9537-054120790a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.365922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c903cf0-527b-4abf-9537-054120790a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.366198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c903cf0-527b-4abf-9537-054120790a3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.366951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c903cf0-527b-4abf-9537-054120790a3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:42:31.367261 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c903cf0-527b-4abf-9537-054120790a3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.369615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c903cf0-527b-4abf-9537-054120790a3e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.369804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-80edb156-c5e0-4677-b6c3-746472fc2237 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:31.371925 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-80edb156-c5e0-4677-b6c3-746472fc2237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:31.383033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 776/1564] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:31.383906 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edb156-c5e0-4677-b6c3-746472fc2237 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.384653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 789/1565] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:42:31.385383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c903cf0-527b-4abf-9537-054120790a3e admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.396082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c903cf0-527b-4abf-9537-054120790a3e admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.396998 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edb156-c5e0-4677-b6c3-746472fc2237 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.401051 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51270f2a-2f7d-480f-912f-69dd30923507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.401728 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270f2a-2f7d-480f-912f-69dd30923507 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.401870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85299991-dde0-4116-ba27-b7bef998306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.401992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270f2a-2f7d-480f-912f-69dd30923507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.402267 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270f2a-2f7d-480f-912f-69dd30923507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.402494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85299991-dde0-4116-ba27-b7bef998306a admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.402806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85299991-dde0-4116-ba27-b7bef998306a admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.403001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51270f2a-2f7d-480f-912f-69dd30923507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.403104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85299991-dde0-4116-ba27-b7bef998306a admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.403819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85299991-dde0-4116-ba27-b7bef998306a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:42:31.404039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: WARNING py.warnings [None req-51270f2a-2f7d-480f-912f-69dd30923507 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:42:31.404039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: warnings.warn(msg) May 12 17:42:31.404039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: May 12 17:42:31.404307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85299991-dde0-4116-ba27-b7bef998306a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.405192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51270f2a-2f7d-480f-912f-69dd30923507 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.405703 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85299991-dde0-4116-ba27-b7bef998306a admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.418901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 777/1566] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:42:31.419685 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85299991-dde0-4116-ba27-b7bef998306a admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.433623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 790/1567] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:31.434693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51270f2a-2f7d-480f-912f-69dd30923507 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.440850 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85299991-dde0-4116-ba27-b7bef998306a admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.496842 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51270f2a-2f7d-480f-912f-69dd30923507 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.499456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb1cff-3e3d-43b8-8546-fce743f3595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.500204 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb1cff-3e3d-43b8-8546-fce743f3595e admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.500486 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb1cff-3e3d-43b8-8546-fce743f3595e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.500760 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb1cff-3e3d-43b8-8546-fce743f3595e admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.501444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb1cff-3e3d-43b8-8546-fce743f3595e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.501634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1dfe0-b40d-464d-ac14-379225deeef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.502462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: WARNING py.warnings [None req-e3bb1cff-3e3d-43b8-8546-fce743f3595e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:42:31.502462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: warnings.warn(msg) May 12 17:42:31.502462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: May 12 17:42:31.502732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1dfe0-b40d-464d-ac14-379225deeef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.502813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1dfe0-b40d-464d-ac14-379225deeef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.503057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1dfe0-b40d-464d-ac14-379225deeef9 admin admin] PATH_INFO: `/v3/projects/602bab993c484805a00eca75f117ca3d/users/248fdba5632b4c0f87d66fada5d3c5b3/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.503698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb1cff-3e3d-43b8-8546-fce743f3595e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.518889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1dfe0-b40d-464d-ac14-379225deeef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602bab993c484805a00eca75f117ca3d, user_id=248fdba5632b4c0f87d66fada5d3c5b3, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.519950 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: WARNING py.warnings [None req-d6c1dfe0-b40d-464d-ac14-379225deeef9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:42:31.519950 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: warnings.warn(msg) May 12 17:42:31.519950 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: May 12 17:42:31.521838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1dfe0-b40d-464d-ac14-379225deeef9 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.524080 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 778/1568] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:31.525103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb1cff-3e3d-43b8-8546-fce743f3595e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.534597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb1cff-3e3d-43b8-8546-fce743f3595e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.541539 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 791/1569] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:31 2022] PUT /identity/v3/projects/602bab993c484805a00eca75f117ca3d/users/248fdba5632b4c0f87d66fada5d3c5b3/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:31.542090 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1dfe0-b40d-464d-ac14-379225deeef9 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.597495 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ecff7-7b89-4ae8-a61b-49b956d51a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.598148 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ecff7-7b89-4ae8-a61b-49b956d51a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.598432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ecff7-7b89-4ae8-a61b-49b956d51a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.598734 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ecff7-7b89-4ae8-a61b-49b956d51a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.599439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ecff7-7b89-4ae8-a61b-49b956d51a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.601350 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ecff7-7b89-4ae8-a61b-49b956d51a99 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.602526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1dfe0-b40d-464d-ac14-379225deeef9 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.607701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc4ed0-d642-4803-bfd4-d063011ea2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.608353 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc4ed0-d642-4803-bfd4-d063011ea2ac admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.608627 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc4ed0-d642-4803-bfd4-d063011ea2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.608900 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc4ed0-d642-4803-bfd4-d063011ea2ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.609826 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc4ed0-d642-4803-bfd4-d063011ea2ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:42:31.610129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc4ed0-d642-4803-bfd4-d063011ea2ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.611770 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc4ed0-d642-4803-bfd4-d063011ea2ac admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.624084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 792/1570] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:42:31.624985 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc4ed0-d642-4803-bfd4-d063011ea2ac admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.635419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 779/1571] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:31.636056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ecff7-7b89-4ae8-a61b-49b956d51a99 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.641838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc4ed0-d642-4803-bfd4-d063011ea2ac admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.697645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab324419-c0c1-4556-8283-a6c3ab6f8027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.698317 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab324419-c0c1-4556-8283-a6c3ab6f8027 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.698597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab324419-c0c1-4556-8283-a6c3ab6f8027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.698923 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab324419-c0c1-4556-8283-a6c3ab6f8027 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.699644 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab324419-c0c1-4556-8283-a6c3ab6f8027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:42:31.699966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab324419-c0c1-4556-8283-a6c3ab6f8027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.701558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab324419-c0c1-4556-8283-a6c3ab6f8027 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.702166 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ecff7-7b89-4ae8-a61b-49b956d51a99 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.706838 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eda4c7-3ccf-4f53-bd2d-ab3019873cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.707497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eda4c7-3ccf-4f53-bd2d-ab3019873cbb admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.707775 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eda4c7-3ccf-4f53-bd2d-ab3019873cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.708046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eda4c7-3ccf-4f53-bd2d-ab3019873cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.708735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eda4c7-3ccf-4f53-bd2d-ab3019873cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.710625 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eda4c7-3ccf-4f53-bd2d-ab3019873cbb admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.714950 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 793/1572] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:42:31.715737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab324419-c0c1-4556-8283-a6c3ab6f8027 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.725402 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab324419-c0c1-4556-8283-a6c3ab6f8027 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.730832 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baa501-31c8-4990-898b-06375ad4f28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.731490 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baa501-31c8-4990-898b-06375ad4f28b admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.731869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baa501-31c8-4990-898b-06375ad4f28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.732235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baa501-31c8-4990-898b-06375ad4f28b admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.733047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86baa501-31c8-4990-898b-06375ad4f28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.735290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86baa501-31c8-4990-898b-06375ad4f28b admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.745248 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 780/1573] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:31.745248 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eda4c7-3ccf-4f53-bd2d-ab3019873cbb admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.760643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 794/1574] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:31.761287 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baa501-31c8-4990-898b-06375ad4f28b admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.806625 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eda4c7-3ccf-4f53-bd2d-ab3019873cbb admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.821307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baa501-31c8-4990-898b-06375ad4f28b admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.826768 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0130aab-b809-4a3a-9b8a-be339bf7a95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.827423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130aab-b809-4a3a-9b8a-be339bf7a95c admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.827701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130aab-b809-4a3a-9b8a-be339bf7a95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.827969 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130aab-b809-4a3a-9b8a-be339bf7a95c admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.828680 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0130aab-b809-4a3a-9b8a-be339bf7a95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.830253 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0130aab-b809-4a3a-9b8a-be339bf7a95c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.840948 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 795/1575] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:31.842149 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60921833-85aa-409a-9008-703fc207df95 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.842435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60921833-85aa-409a-9008-703fc207df95 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.842732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60921833-85aa-409a-9008-703fc207df95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.861087 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90241ae-1068-44ee-b9b4-3bc46e16e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.861749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90241ae-1068-44ee-b9b4-3bc46e16e7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.862027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90241ae-1068-44ee-b9b4-3bc46e16e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.862298 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90241ae-1068-44ee-b9b4-3bc46e16e7f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.863008 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90241ae-1068-44ee-b9b4-3bc46e16e7f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.864925 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90241ae-1068-44ee-b9b4-3bc46e16e7f3 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.868231 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-60921833-85aa-409a-9008-703fc207df95 None None] MFA Rules not processed for user `248fdba5632b4c0f87d66fada5d3c5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:31.870158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-60921833-85aa-409a-9008-703fc207df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:31.893907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 781/1576] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:31.895777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90241ae-1068-44ee-b9b4-3bc46e16e7f3 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.905308 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90241ae-1068-44ee-b9b4-3bc46e16e7f3 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.909918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313a87d-5287-4dd1-8f89-1a7d8ee1e605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:31.910558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313a87d-5287-4dd1-8f89-1a7d8ee1e605 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:31.910873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313a87d-5287-4dd1-8f89-1a7d8ee1e605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:31.911153 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313a87d-5287-4dd1-8f89-1a7d8ee1e605 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:31.911865 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313a87d-5287-4dd1-8f89-1a7d8ee1e605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:31.913764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313a87d-5287-4dd1-8f89-1a7d8ee1e605 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:31.935940 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 796/1577] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:31.936865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60921833-85aa-409a-9008-703fc207df95 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:31.944685 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 782/1578] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:31.948433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60921833-85aa-409a-9008-703fc207df95 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:31.948962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313a87d-5287-4dd1-8f89-1a7d8ee1e605 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.002858 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601ed15-8331-4de2-9b03-6577dbcaee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.003521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601ed15-8331-4de2-9b03-6577dbcaee95 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.003798 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601ed15-8331-4de2-9b03-6577dbcaee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.004068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601ed15-8331-4de2-9b03-6577dbcaee95 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.004779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601ed15-8331-4de2-9b03-6577dbcaee95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.006749 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601ed15-8331-4de2-9b03-6577dbcaee95 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.008549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313a87d-5287-4dd1-8f89-1a7d8ee1e605 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.014175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d03c92-afff-4c47-9693-93d69a68bac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.014921 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d03c92-afff-4c47-9693-93d69a68bac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.015273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d03c92-afff-4c47-9693-93d69a68bac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.015873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d03c92-afff-4c47-9693-93d69a68bac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.016707 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d03c92-afff-4c47-9693-93d69a68bac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.018995 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d03c92-afff-4c47-9693-93d69a68bac0 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.027736 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 797/1579] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:32.031577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601ed15-8331-4de2-9b03-6577dbcaee95 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.043737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601ed15-8331-4de2-9b03-6577dbcaee95 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.051075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 783/1580] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:31 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:32.051075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d03c92-afff-4c47-9693-93d69a68bac0 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.051995 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed876b-7378-4532-b11c-38260c2a9a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.052663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed876b-7378-4532-b11c-38260c2a9a16 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.052946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed876b-7378-4532-b11c-38260c2a9a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.053227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed876b-7378-4532-b11c-38260c2a9a16 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.053922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed876b-7378-4532-b11c-38260c2a9a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.055933 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed876b-7378-4532-b11c-38260c2a9a16 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.076646 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 798/1581] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:32 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:32.077449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed876b-7378-4532-b11c-38260c2a9a16 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.087767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed876b-7378-4532-b11c-38260c2a9a16 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.111951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d03c92-afff-4c47-9693-93d69a68bac0 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.117187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5c49d-97f3-491a-8aa3-9561593b297e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.117858 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5c49d-97f3-491a-8aa3-9561593b297e admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.118168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5c49d-97f3-491a-8aa3-9561593b297e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.118501 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5c49d-97f3-491a-8aa3-9561593b297e admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.119733 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5c49d-97f3-491a-8aa3-9561593b297e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.121847 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5c49d-97f3-491a-8aa3-9561593b297e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.141381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 784/1582] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:32 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:32.142189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5c49d-97f3-491a-8aa3-9561593b297e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.143225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ee918-a832-40af-9ac6-40a863ab2369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.143921 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ee918-a832-40af-9ac6-40a863ab2369 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.144296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ee918-a832-40af-9ac6-40a863ab2369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.144637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ee918-a832-40af-9ac6-40a863ab2369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.145366 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ee918-a832-40af-9ac6-40a863ab2369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.146987 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ee918-a832-40af-9ac6-40a863ab2369 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.153228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5c49d-97f3-491a-8aa3-9561593b297e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.159635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 799/1583] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:32.159635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ee918-a832-40af-9ac6-40a863ab2369 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.160555 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e7079-944b-444d-bd4a-0dd04d1404bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.161248 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e7079-944b-444d-bd4a-0dd04d1404bb admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.161554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e7079-944b-444d-bd4a-0dd04d1404bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.161835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e7079-944b-444d-bd4a-0dd04d1404bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.162880 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e7079-944b-444d-bd4a-0dd04d1404bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.164617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e7079-944b-444d-bd4a-0dd04d1404bb admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.169028 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ee918-a832-40af-9ac6-40a863ab2369 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.173734 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014fcaa-db3a-4394-91e3-a70bc8ee3bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.174457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014fcaa-db3a-4394-91e3-a70bc8ee3bcc admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.174837 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014fcaa-db3a-4394-91e3-a70bc8ee3bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.175113 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014fcaa-db3a-4394-91e3-a70bc8ee3bcc admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.175790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014fcaa-db3a-4394-91e3-a70bc8ee3bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.176160 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 785/1584] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:32.179520 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ac745-4c8f-4ba9-89aa-7eabb66a8386 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.179652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014fcaa-db3a-4394-91e3-a70bc8ee3bcc admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.179764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ac745-4c8f-4ba9-89aa-7eabb66a8386 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.179764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ac745-4c8f-4ba9-89aa-7eabb66a8386 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.179764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 786/1585] 10.222.0.76 () {54 vars in 961 bytes} [Thu May 12 17:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:42:32.180558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ac745-4c8f-4ba9-89aa-7eabb66a8386 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.194240 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ac745-4c8f-4ba9-89aa-7eabb66a8386 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.199691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea6b27-e299-42b1-b4e3-365bbb8bc580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.199875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 800/1586] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:32 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:32.200395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea6b27-e299-42b1-b4e3-365bbb8bc580 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.200517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014fcaa-db3a-4394-91e3-a70bc8ee3bcc admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.200714 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea6b27-e299-42b1-b4e3-365bbb8bc580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.200952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea6b27-e299-42b1-b4e3-365bbb8bc580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.201776 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea6b27-e299-42b1-b4e3-365bbb8bc580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.203643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea6b27-e299-42b1-b4e3-365bbb8bc580 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.211590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014fcaa-db3a-4394-91e3-a70bc8ee3bcc admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.214252 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 787/1587] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:32.215127 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea6b27-e299-42b1-b4e3-365bbb8bc580 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.217487 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06cc89-cfe8-47cc-ba94-1260cc035f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.218198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06cc89-cfe8-47cc-ba94-1260cc035f1c admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.218486 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06cc89-cfe8-47cc-ba94-1260cc035f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.218829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06cc89-cfe8-47cc-ba94-1260cc035f1c admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.219518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06cc89-cfe8-47cc-ba94-1260cc035f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.221606 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06cc89-cfe8-47cc-ba94-1260cc035f1c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.224469 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea6b27-e299-42b1-b4e3-365bbb8bc580 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.229198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237377e-d403-4e3c-b1f4-0f59c3ffaa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.229839 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237377e-d403-4e3c-b1f4-0f59c3ffaa9b admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.230122 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237377e-d403-4e3c-b1f4-0f59c3ffaa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.230394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237377e-d403-4e3c-b1f4-0f59c3ffaa9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.231136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237377e-d403-4e3c-b1f4-0f59c3ffaa9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.232718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237377e-d403-4e3c-b1f4-0f59c3ffaa9b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.243302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 801/1588] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:32 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:32.246642 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 788/1589] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:32.247308 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06cc89-cfe8-47cc-ba94-1260cc035f1c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.247528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237377e-d403-4e3c-b1f4-0f59c3ffaa9b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.256765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237377e-d403-4e3c-b1f4-0f59c3ffaa9b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.256921 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06cc89-cfe8-47cc-ba94-1260cc035f1c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.262323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cead582-27ea-4b3c-b13a-415459111627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.262512 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b59128-8321-48c0-b06d-57e610e4d774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.263007 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cead582-27ea-4b3c-b13a-415459111627 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.263427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b59128-8321-48c0-b06d-57e610e4d774 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.263568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cead582-27ea-4b3c-b13a-415459111627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.263711 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b59128-8321-48c0-b06d-57e610e4d774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.263850 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cead582-27ea-4b3c-b13a-415459111627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.264012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b59128-8321-48c0-b06d-57e610e4d774 admin admin] PATH_INFO: `/v3/projects/cc12aaf43fbf477997a42bb50359afd4/users/58b1cc1cc14f4ef99fab65cb70fac01b/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.264571 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cead582-27ea-4b3c-b13a-415459111627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.266409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cead582-27ea-4b3c-b13a-415459111627 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.277328 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 802/1590] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:32.278007 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cead582-27ea-4b3c-b13a-415459111627 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.279852 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b59128-8321-48c0-b06d-57e610e4d774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc12aaf43fbf477997a42bb50359afd4, user_id=58b1cc1cc14f4ef99fab65cb70fac01b, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.282700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b59128-8321-48c0-b06d-57e610e4d774 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.288035 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cead582-27ea-4b3c-b13a-415459111627 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.293241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f2490-910c-43b3-acbd-3ba6e21fa652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.293916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f2490-910c-43b3-acbd-3ba6e21fa652 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.294319 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f2490-910c-43b3-acbd-3ba6e21fa652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.294594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f2490-910c-43b3-acbd-3ba6e21fa652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.295344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f2490-910c-43b3-acbd-3ba6e21fa652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.296284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 789/1591] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:32 2022] PUT /identity/v3/projects/cc12aaf43fbf477997a42bb50359afd4/users/58b1cc1cc14f4ef99fab65cb70fac01b/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:32.296983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f2490-910c-43b3-acbd-3ba6e21fa652 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.297559 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081e612-aaf2-4f83-96a3-2c19e35ddea8 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.297844 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081e612-aaf2-4f83-96a3-2c19e35ddea8 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.298114 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081e612-aaf2-4f83-96a3-2c19e35ddea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.308815 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 803/1592] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:32.309717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f2490-910c-43b3-acbd-3ba6e21fa652 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.316247 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-b081e612-aaf2-4f83-96a3-2c19e35ddea8 None None] MFA Rules not processed for user `04ad234318ad47589b844351cd3bb3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:32.317451 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b081e612-aaf2-4f83-96a3-2c19e35ddea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:32.319179 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f2490-910c-43b3-acbd-3ba6e21fa652 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.373787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bf8f0-fee8-4e54-8804-5c40a512a10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.374365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf8f0-fee8-4e54-8804-5c40a512a10e admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.374649 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf8f0-fee8-4e54-8804-5c40a512a10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.374960 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf8f0-fee8-4e54-8804-5c40a512a10e admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.375679 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bf8f0-fee8-4e54-8804-5c40a512a10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.377263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bf8f0-fee8-4e54-8804-5c40a512a10e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.382947 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 790/1593] 10.222.0.76 () {58 vars in 1058 bytes} [Thu May 12 17:42:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:32.383895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081e612-aaf2-4f83-96a3-2c19e35ddea8 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.387810 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 804/1594] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:32.388484 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bf8f0-fee8-4e54-8804-5c40a512a10e admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.395203 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081e612-aaf2-4f83-96a3-2c19e35ddea8 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.398310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bf8f0-fee8-4e54-8804-5c40a512a10e admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.399789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1886b-9ad8-45c1-a7de-ec792dbe7e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.400567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1886b-9ad8-45c1-a7de-ec792dbe7e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.400886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1886b-9ad8-45c1-a7de-ec792dbe7e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.401165 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1886b-9ad8-45c1-a7de-ec792dbe7e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.401911 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1886b-9ad8-45c1-a7de-ec792dbe7e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.403114 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24aff35-2a6e-46c7-a967-a6ecdb5615f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.403528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1886b-9ad8-45c1-a7de-ec792dbe7e0b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.403754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aff35-2a6e-46c7-a967-a6ecdb5615f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.404037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aff35-2a6e-46c7-a967-a6ecdb5615f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.404318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aff35-2a6e-46c7-a967-a6ecdb5615f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.405032 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24aff35-2a6e-46c7-a967-a6ecdb5615f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.407751 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24aff35-2a6e-46c7-a967-a6ecdb5615f8 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.413665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 791/1595] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:32.414560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1886b-9ad8-45c1-a7de-ec792dbe7e0b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.420770 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 805/1596] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:32.421358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24aff35-2a6e-46c7-a967-a6ecdb5615f8 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.424229 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1886b-9ad8-45c1-a7de-ec792dbe7e0b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.428807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5c730-92b6-4a49-9894-ebb3c3b6f92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.429451 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5c730-92b6-4a49-9894-ebb3c3b6f92c admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.429738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5c730-92b6-4a49-9894-ebb3c3b6f92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.430014 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5c730-92b6-4a49-9894-ebb3c3b6f92c admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.430755 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5c730-92b6-4a49-9894-ebb3c3b6f92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.431852 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24aff35-2a6e-46c7-a967-a6ecdb5615f8 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.433001 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5c730-92b6-4a49-9894-ebb3c3b6f92c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.436214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40692a-d193-4749-90c8-08ac0aea43b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.436850 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40692a-d193-4749-90c8-08ac0aea43b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.437133 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40692a-d193-4749-90c8-08ac0aea43b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.437408 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40692a-d193-4749-90c8-08ac0aea43b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.438216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40692a-d193-4749-90c8-08ac0aea43b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.439707 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40692a-d193-4749-90c8-08ac0aea43b5 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.443048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 792/1597] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:32.444139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9aa97-fc15-45f0-af8b-633333542af8 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.444431 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9aa97-fc15-45f0-af8b-633333542af8 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.444708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9aa97-fc15-45f0-af8b-633333542af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.451831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 806/1598] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:32.452615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40692a-d193-4749-90c8-08ac0aea43b5 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.461812 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40692a-d193-4749-90c8-08ac0aea43b5 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.464863 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-62d9aa97-fc15-45f0-af8b-633333542af8 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:32.466064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-62d9aa97-fc15-45f0-af8b-633333542af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:32.466819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c43f89-1e2a-49c6-9467-4e8510b0a745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.467680 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c43f89-1e2a-49c6-9467-4e8510b0a745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.467961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c43f89-1e2a-49c6-9467-4e8510b0a745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.468232 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c43f89-1e2a-49c6-9467-4e8510b0a745 admin admin] PATH_INFO: `/v3/projects/c07bc791aa8d45d4a9e72758f39f6a85/users/10626535b6874ef58b63d259f059cd15/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.473892 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 793/1599] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:32.474650 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9aa97-fc15-45f0-af8b-633333542af8 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.483084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c43f89-1e2a-49c6-9467-4e8510b0a745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c07bc791aa8d45d4a9e72758f39f6a85, user_id=10626535b6874ef58b63d259f059cd15, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.483850 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9aa97-fc15-45f0-af8b-633333542af8 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.485734 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c43f89-1e2a-49c6-9467-4e8510b0a745 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.488743 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124712b-05ca-4829-b42a-91c06e47ef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.489396 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124712b-05ca-4829-b42a-91c06e47ef88 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.489678 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124712b-05ca-4829-b42a-91c06e47ef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.489949 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124712b-05ca-4829-b42a-91c06e47ef88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.490883 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124712b-05ca-4829-b42a-91c06e47ef88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.492649 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124712b-05ca-4829-b42a-91c06e47ef88 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.500470 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 807/1600] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:32 2022] PUT /identity/v3/projects/c07bc791aa8d45d4a9e72758f39f6a85/users/10626535b6874ef58b63d259f059cd15/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:32.501279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c43f89-1e2a-49c6-9467-4e8510b0a745 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.503547 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 794/1601] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:32.507190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124712b-05ca-4829-b42a-91c06e47ef88 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.517375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124712b-05ca-4829-b42a-91c06e47ef88 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.570181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c43f89-1e2a-49c6-9467-4e8510b0a745 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.570738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446074e-9401-4d7e-a7af-e15ef45f0dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.571571 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446074e-9401-4d7e-a7af-e15ef45f0dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.572415 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446074e-9401-4d7e-a7af-e15ef45f0dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.572925 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446074e-9401-4d7e-a7af-e15ef45f0dd0 admin admin] PATH_INFO: `/v3/projects/bf607837a27e47bf99a32b3b095df070/users/d8866c723166455a9711559eb7f125c4/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.576679 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389d933-7ecc-41e9-876c-d61cf3e4895e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.577327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389d933-7ecc-41e9-876c-d61cf3e4895e service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.577611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389d933-7ecc-41e9-876c-d61cf3e4895e service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.577889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389d933-7ecc-41e9-876c-d61cf3e4895e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.587041 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446074e-9401-4d7e-a7af-e15ef45f0dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf607837a27e47bf99a32b3b095df070, user_id=d8866c723166455a9711559eb7f125c4, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.589936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446074e-9401-4d7e-a7af-e15ef45f0dd0 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.603454 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 795/1602] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:32 2022] PUT /identity/v3/projects/bf607837a27e47bf99a32b3b095df070/users/d8866c723166455a9711559eb7f125c4/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:32.604242 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446074e-9401-4d7e-a7af-e15ef45f0dd0 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.635079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389d933-7ecc-41e9-876c-d61cf3e4895e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.636726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389d933-7ecc-41e9-876c-d61cf3e4895e service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.645817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 808/1603] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:32.647638 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389d933-7ecc-41e9-876c-d61cf3e4895e service nova] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.657699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389d933-7ecc-41e9-876c-d61cf3e4895e service nova] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.670062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446074e-9401-4d7e-a7af-e15ef45f0dd0 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.675637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857edc5e-7213-464d-befd-a2fc7e252259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.677074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edc5e-7213-464d-befd-a2fc7e252259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.677427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edc5e-7213-464d-befd-a2fc7e252259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.677770 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edc5e-7213-464d-befd-a2fc7e252259 admin admin] PATH_INFO: `/v3/projects/5b9fc19853b84a7da47009ee4a59fb80/users/ea691a2a7ff1465aaba5a0e8c19fd5e9/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.693426 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857edc5e-7213-464d-befd-a2fc7e252259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9fc19853b84a7da47009ee4a59fb80, user_id=ea691a2a7ff1465aaba5a0e8c19fd5e9, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.696101 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857edc5e-7213-464d-befd-a2fc7e252259 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.711126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 796/1604] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:32 2022] PUT /identity/v3/projects/5b9fc19853b84a7da47009ee4a59fb80/users/ea691a2a7ff1465aaba5a0e8c19fd5e9/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:32.712196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857edc5e-7213-464d-befd-a2fc7e252259 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.723547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b0f61-6914-481a-a6de-b768b977389d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.724212 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0f61-6914-481a-a6de-b768b977389d admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.724490 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0f61-6914-481a-a6de-b768b977389d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.724810 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0f61-6914-481a-a6de-b768b977389d admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.725543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b0f61-6914-481a-a6de-b768b977389d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.727229 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b0f61-6914-481a-a6de-b768b977389d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.738333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 809/1605] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:32.739190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b0f61-6914-481a-a6de-b768b977389d admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.786103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857edc5e-7213-464d-befd-a2fc7e252259 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.792071 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19585226-fe5f-4c25-a989-dbab8bafd607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.793185 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19585226-fe5f-4c25-a989-dbab8bafd607 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.793475 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19585226-fe5f-4c25-a989-dbab8bafd607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.793749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19585226-fe5f-4c25-a989-dbab8bafd607 admin admin] PATH_INFO: `/v3/projects/38aae8b9be064fabb6e07ea34a5dcdb9/users/ac1708b4ee7e43afaac75452be3b195e/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.795755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b0f61-6914-481a-a6de-b768b977389d admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.809579 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19585226-fe5f-4c25-a989-dbab8bafd607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38aae8b9be064fabb6e07ea34a5dcdb9, user_id=ac1708b4ee7e43afaac75452be3b195e, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.812340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19585226-fe5f-4c25-a989-dbab8bafd607 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.827608 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 797/1606] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:32 2022] PUT /identity/v3/projects/38aae8b9be064fabb6e07ea34a5dcdb9/users/ac1708b4ee7e43afaac75452be3b195e/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:32.828816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd95890-4389-4f35-b273-ecb266d19618 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.829105 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd95890-4389-4f35-b273-ecb266d19618 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.829380 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd95890-4389-4f35-b273-ecb266d19618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.845402 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eb95a-9c9f-42f1-bc14-a99e24559324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.846198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eb95a-9c9f-42f1-bc14-a99e24559324 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.846493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eb95a-9c9f-42f1-bc14-a99e24559324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.846721 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-6dd95890-4389-4f35-b273-ecb266d19618 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:32.846850 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eb95a-9c9f-42f1-bc14-a99e24559324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.848040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-6dd95890-4389-4f35-b273-ecb266d19618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:32.857760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3eb95a-9c9f-42f1-bc14-a99e24559324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.858665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3eb95a-9c9f-42f1-bc14-a99e24559324 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.869754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 810/1607] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:32.870728 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eb95a-9c9f-42f1-bc14-a99e24559324 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:32.880740 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eb95a-9c9f-42f1-bc14-a99e24559324 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:32.910774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 798/1608] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:32.912106 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12408c03-dbd6-4ba1-8b80-c63610e51f35 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.912522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12408c03-dbd6-4ba1-8b80-c63610e51f35 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.912897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12408c03-dbd6-4ba1-8b80-c63610e51f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.935552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-12408c03-dbd6-4ba1-8b80-c63610e51f35 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:32.936904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-12408c03-dbd6-4ba1-8b80-c63610e51f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:32.945534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 799/1609] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:32.946971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316828-bffa-4aaf-a26a-096ef8442858 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.947259 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316828-bffa-4aaf-a26a-096ef8442858 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.947539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316828-bffa-4aaf-a26a-096ef8442858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.952804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7349242-752b-430c-9809-ab9ec9b2696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:32.953811 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7349242-752b-430c-9809-ab9ec9b2696d admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:32.954144 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7349242-752b-430c-9809-ab9ec9b2696d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:32.954429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7349242-752b-430c-9809-ab9ec9b2696d admin admin] PATH_INFO: `/v3/projects/502fa29d3bf3465d8616f5e9286733eb/users/ee6837a9c14d408c8b1da84f7862d144/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:32.971017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7349242-752b-430c-9809-ab9ec9b2696d admin admin] RBAC: Authorizing `identity:create_grant(project_id=502fa29d3bf3465d8616f5e9286733eb, user_id=ee6837a9c14d408c8b1da84f7862d144, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:32.973729 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7349242-752b-430c-9809-ab9ec9b2696d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:32.975839 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-34316828-bffa-4aaf-a26a-096ef8442858 None None] MFA Rules not processed for user `ea691a2a7ff1465aaba5a0e8c19fd5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:32.977676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-34316828-bffa-4aaf-a26a-096ef8442858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:32.994751 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 811/1610] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:32 2022] PUT /identity/v3/projects/502fa29d3bf3465d8616f5e9286733eb/users/ee6837a9c14d408c8b1da84f7862d144/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:32.996047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7349242-752b-430c-9809-ab9ec9b2696d admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:33.062954 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 800/1611] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:33.062954 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055d64c-95b0-41fa-8879-5d3f3bcde7d9 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.062954 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055d64c-95b0-41fa-8879-5d3f3bcde7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.062954 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055d64c-95b0-41fa-8879-5d3f3bcde7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.076329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7349242-752b-430c-9809-ab9ec9b2696d admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:33.083078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481c90f-6a1b-4113-aa46-5e42d537f187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:33.084137 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481c90f-6a1b-4113-aa46-5e42d537f187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.084421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481c90f-6a1b-4113-aa46-5e42d537f187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.084699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481c90f-6a1b-4113-aa46-5e42d537f187 admin admin] PATH_INFO: `/v3/projects/c8a539bdf69e4849bd340749791e6e13/users/50a489bfc4094a22a8cdb9b85411a3e0/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.093226 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-5055d64c-95b0-41fa-8879-5d3f3bcde7d9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:33.094460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-5055d64c-95b0-41fa-8879-5d3f3bcde7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:33.103487 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 801/1612] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:33.103983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481c90f-6a1b-4113-aa46-5e42d537f187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a539bdf69e4849bd340749791e6e13, user_id=50a489bfc4094a22a8cdb9b85411a3e0, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:33.104795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46cec-6bb2-4dc4-b7d5-8f120e2d9b78 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.105081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46cec-6bb2-4dc4-b7d5-8f120e2d9b78 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.105361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46cec-6bb2-4dc4-b7d5-8f120e2d9b78 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.106932 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 802/1613] 10.222.0.76 () {54 vars in 912 bytes} [Thu May 12 17:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:42:33.107649 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf46cec-6bb2-4dc4-b7d5-8f120e2d9b78 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:33.116029 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481c90f-6a1b-4113-aa46-5e42d537f187 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:33.129897 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 812/1614] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:32 2022] PUT /identity/v3/projects/c8a539bdf69e4849bd340749791e6e13/users/50a489bfc4094a22a8cdb9b85411a3e0/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:33.130571 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481c90f-6a1b-4113-aa46-5e42d537f187 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:33.178067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf46cec-6bb2-4dc4-b7d5-8f120e2d9b78 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:33.194005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481c90f-6a1b-4113-aa46-5e42d537f187 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:33.198091 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54658b32-f3c8-49ea-9458-a5fb7496d6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:33.198855 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54658b32-f3c8-49ea-9458-a5fb7496d6af service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.199198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54658b32-f3c8-49ea-9458-a5fb7496d6af service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.199544 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54658b32-f3c8-49ea-9458-a5fb7496d6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.244102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf36df-da4f-494a-99e6-554993b5e811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:33.244806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf36df-da4f-494a-99e6-554993b5e811 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.245090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf36df-da4f-494a-99e6-554993b5e811 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.245367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf36df-da4f-494a-99e6-554993b5e811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.274051 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54658b32-f3c8-49ea-9458-a5fb7496d6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:33.276720 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54658b32-f3c8-49ea-9458-a5fb7496d6af service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:33.292098 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 813/1615] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:33.293444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e158886-48fa-4dfd-89d6-bed0cae44e9f None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.293738 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e158886-48fa-4dfd-89d6-bed0cae44e9f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.294021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e158886-48fa-4dfd-89d6-bed0cae44e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.312469 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-0e158886-48fa-4dfd-89d6-bed0cae44e9f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:33.313945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-0e158886-48fa-4dfd-89d6-bed0cae44e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:33.324107 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 814/1616] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:33.325438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba074461-3d7d-4e63-8835-014b6c8ceb89 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.325730 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba074461-3d7d-4e63-8835-014b6c8ceb89 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.326009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba074461-3d7d-4e63-8835-014b6c8ceb89 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.331748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 815/1617] 10.222.0.76 () {54 vars in 961 bytes} [Thu May 12 17:42:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:42:33.332577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba074461-3d7d-4e63-8835-014b6c8ceb89 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:33.335564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf36df-da4f-494a-99e6-554993b5e811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:33.337793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf36df-da4f-494a-99e6-554993b5e811 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:33.346122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba074461-3d7d-4e63-8835-014b6c8ceb89 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:33.348541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 803/1618] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:33.349665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8891d38-9d64-4930-a665-531bcc92049b None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.349952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8891d38-9d64-4930-a665-531bcc92049b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.350242 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8891d38-9d64-4930-a665-531bcc92049b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.350749 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb31f9-b312-44f1-91f4-204c15f39086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:33.351621 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb31f9-b312-44f1-91f4-204c15f39086 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.351978 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb31f9-b312-44f1-91f4-204c15f39086 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.352312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb31f9-b312-44f1-91f4-204c15f39086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.365784 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb31f9-b312-44f1-91f4-204c15f39086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:33.367699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb31f9-b312-44f1-91f4-204c15f39086 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:33.369759 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-a8891d38-9d64-4930-a665-531bcc92049b None None] MFA Rules not processed for user `04ad234318ad47589b844351cd3bb3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:33.370970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a8891d38-9d64-4930-a665-531bcc92049b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:33.381739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 816/1619] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:33.383247 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b363a-1a3e-4cb0-83f9-f4f08722e2dd None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.383705 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b363a-1a3e-4cb0-83f9-f4f08722e2dd None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.384014 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b363a-1a3e-4cb0-83f9-f4f08722e2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.418261 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-6b2b363a-1a3e-4cb0-83f9-f4f08722e2dd None None] MFA Rules not processed for user `50a489bfc4094a22a8cdb9b85411a3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:33.420351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6b2b363a-1a3e-4cb0-83f9-f4f08722e2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:33.451036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 804/1620] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:42:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:33.452704 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f380a-2f43-4563-ae7d-d6aa6340163e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.453323 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f380a-2f43-4563-ae7d-d6aa6340163e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.453323 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f380a-2f43-4563-ae7d-d6aa6340163e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.474446 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-9c4f380a-2f43-4563-ae7d-d6aa6340163e None None] MFA Rules not processed for user `04ad234318ad47589b844351cd3bb3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:33.476382 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9c4f380a-2f43-4563-ae7d-d6aa6340163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:33.494576 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 817/1621] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:33.496427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b363a-1a3e-4cb0-83f9-f4f08722e2dd None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:33.498042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 805/1622] 10.222.0.76 () {58 vars in 1058 bytes} [Thu May 12 17:42:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:33.499677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f380a-2f43-4563-ae7d-d6aa6340163e None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:33.507823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b363a-1a3e-4cb0-83f9-f4f08722e2dd None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:33.512307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa492-b34d-4da7-9d61-30fc1f79c58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:33.513069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa492-b34d-4da7-9d61-30fc1f79c58b service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.513418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa492-b34d-4da7-9d61-30fc1f79c58b service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.513758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa492-b34d-4da7-9d61-30fc1f79c58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.525684 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffa492-b34d-4da7-9d61-30fc1f79c58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:33.527250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffa492-b34d-4da7-9d61-30fc1f79c58b service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:33.541295 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 818/1623] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:33.542165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa492-b34d-4da7-9d61-30fc1f79c58b service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:33.551470 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa492-b34d-4da7-9d61-30fc1f79c58b service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:33.556379 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be90f3d-e70c-4cfd-a41b-759eafe557b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:33.557059 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be90f3d-e70c-4cfd-a41b-759eafe557b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.557499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be90f3d-e70c-4cfd-a41b-759eafe557b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.557633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be90f3d-e70c-4cfd-a41b-759eafe557b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.558481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be90f3d-e70c-4cfd-a41b-759eafe557b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:33.560894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be90f3d-e70c-4cfd-a41b-759eafe557b1 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:33.569160 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f380a-2f43-4563-ae7d-d6aa6340163e None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:33.580660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9926db-5e96-4551-97eb-28474b2ca6e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:33.581355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9926db-5e96-4551-97eb-28474b2ca6e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.581615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9926db-5e96-4551-97eb-28474b2ca6e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.581987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9926db-5e96-4551-97eb-28474b2ca6e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.596272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9926db-5e96-4551-97eb-28474b2ca6e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:33.598307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9926db-5e96-4551-97eb-28474b2ca6e6 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:33.603758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 819/1624] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:33 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:33.603758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be90f3d-e70c-4cfd-a41b-759eafe557b1 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:33.614545 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 806/1625] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:33.615675 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9926db-5e96-4551-97eb-28474b2ca6e6 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:33.628067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9926db-5e96-4551-97eb-28474b2ca6e6 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:33.694404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0183f-fff3-46f7-aabc-b84ae3b3761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:33.695234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0183f-fff3-46f7-aabc-b84ae3b3761a admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.695587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0183f-fff3-46f7-aabc-b84ae3b3761a admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.695930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0183f-fff3-46f7-aabc-b84ae3b3761a admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.696777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0183f-fff3-46f7-aabc-b84ae3b3761a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:33.698850 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0183f-fff3-46f7-aabc-b84ae3b3761a admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:33.731665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 807/1626] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:33 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:33.735561 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0183f-fff3-46f7-aabc-b84ae3b3761a admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:33.748539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0183f-fff3-46f7-aabc-b84ae3b3761a admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:33.754006 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bf2c8-2a7d-4915-91e0-7fa5bcb4ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:33.754970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bf2c8-2a7d-4915-91e0-7fa5bcb4ebba admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.755324 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bf2c8-2a7d-4915-91e0-7fa5bcb4ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.755709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bf2c8-2a7d-4915-91e0-7fa5bcb4ebba admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.756666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bf2c8-2a7d-4915-91e0-7fa5bcb4ebba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:33.758300 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bf2c8-2a7d-4915-91e0-7fa5bcb4ebba admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:33.771671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be90f3d-e70c-4cfd-a41b-759eafe557b1 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:33.777793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 808/1627] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:33.779612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bf2c8-2a7d-4915-91e0-7fa5bcb4ebba admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:33.789085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb294a-e2c7-4158-9bc9-fdd2f928dadc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:33.789901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb294a-e2c7-4158-9bc9-fdd2f928dadc service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.790185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb294a-e2c7-4158-9bc9-fdd2f928dadc service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.791315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb294a-e2c7-4158-9bc9-fdd2f928dadc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.794564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bf2c8-2a7d-4915-91e0-7fa5bcb4ebba admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:33.799988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6233f-9c30-41c6-a9bd-720f4ceff428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:33.801110 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6233f-9c30-41c6-a9bd-720f4ceff428 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.801538 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6233f-9c30-41c6-a9bd-720f4ceff428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.801920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6233f-9c30-41c6-a9bd-720f4ceff428 admin admin] PATH_INFO: `/v3/projects/0a1cf08091af4e938452e25e57b21b36/users/693f81ff75674b8c8accc3b5f065d9a4/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.822202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6233f-9c30-41c6-a9bd-720f4ceff428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1cf08091af4e938452e25e57b21b36, user_id=693f81ff75674b8c8accc3b5f065d9a4, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:33.827209 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6233f-9c30-41c6-a9bd-720f4ceff428 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:33.851556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 809/1628] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:33 2022] PUT /identity/v3/projects/0a1cf08091af4e938452e25e57b21b36/users/693f81ff75674b8c8accc3b5f065d9a4/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:42:33.856957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6233f-9c30-41c6-a9bd-720f4ceff428 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:33.933693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6233f-9c30-41c6-a9bd-720f4ceff428 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:33.939616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4203a-e947-45c3-a998-8510ccee065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:33.940325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4203a-e947-45c3-a998-8510ccee065b admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.940676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4203a-e947-45c3-a998-8510ccee065b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.940950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4203a-e947-45c3-a998-8510ccee065b admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.941828 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb294a-e2c7-4158-9bc9-fdd2f928dadc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:33.941968 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4203a-e947-45c3-a998-8510ccee065b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:33.944260 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4203a-e947-45c3-a998-8510ccee065b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:33.947306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb294a-e2c7-4158-9bc9-fdd2f928dadc service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:33.958238 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 810/1629] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:33.963058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4203a-e947-45c3-a998-8510ccee065b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:33.974360 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 820/1630] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:33.976752 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4203a-e947-45c3-a998-8510ccee065b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:33.984844 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb68da1-fdd0-45ff-b8e2-649fccf45ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:33.985815 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb68da1-fdd0-45ff-b8e2-649fccf45ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:33.986123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb68da1-fdd0-45ff-b8e2-649fccf45ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:33.986572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb68da1-fdd0-45ff-b8e2-649fccf45ffd admin admin] PATH_INFO: `/v3/projects/0a1cf08091af4e938452e25e57b21b36/users/693f81ff75674b8c8accc3b5f065d9a4/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:33.988796 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb68da1-fdd0-45ff-b8e2-649fccf45ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1cf08091af4e938452e25e57b21b36, user_id=693f81ff75674b8c8accc3b5f065d9a4, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:33.991852 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb68da1-fdd0-45ff-b8e2-649fccf45ffd admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:34.003973 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 811/1631] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:33 2022] PUT /identity/v3/projects/0a1cf08091af4e938452e25e57b21b36/users/693f81ff75674b8c8accc3b5f065d9a4/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:34.017424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0bb71-172a-455e-bd27-98dbb3a3d179 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:34.017774 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0bb71-172a-455e-bd27-98dbb3a3d179 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:34.018358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0bb71-172a-455e-bd27-98dbb3a3d179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:34.090722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-66e0bb71-172a-455e-bd27-98dbb3a3d179 None None] MFA Rules not processed for user `693f81ff75674b8c8accc3b5f065d9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:34.094012 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-66e0bb71-172a-455e-bd27-98dbb3a3d179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:34.245463 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 821/1632] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:34.277490 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb68da1-fdd0-45ff-b8e2-649fccf45ffd admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:34.408280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ccafe-e146-4975-9417-6180f4541868 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:34.408905 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ccafe-e146-4975-9417-6180f4541868 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:34.409354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ccafe-e146-4975-9417-6180f4541868 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:34.410985 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 822/1633] 10.222.0.76 () {54 vars in 912 bytes} [Thu May 12 17:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:42:34.422316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b5226-f34c-46ca-80b2-3e3896af2fe0 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:34.422871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b5226-f34c-46ca-80b2-3e3896af2fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:34.423297 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b5226-f34c-46ca-80b2-3e3896af2fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:34.438827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb68da1-fdd0-45ff-b8e2-649fccf45ffd admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:34.443392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f06cf6-079d-41b4-922f-beeff00e2937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:34.444373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06cf6-079d-41b4-922f-beeff00e2937 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:34.444884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06cf6-079d-41b4-922f-beeff00e2937 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:34.445227 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06cf6-079d-41b4-922f-beeff00e2937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:34.452925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-fa0b5226-f34c-46ca-80b2-3e3896af2fe0 None None] MFA Rules not processed for user `04ad234318ad47589b844351cd3bb3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:34.454497 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-fa0b5226-f34c-46ca-80b2-3e3896af2fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:34.573787 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f06cf6-079d-41b4-922f-beeff00e2937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:34.575368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f06cf6-079d-41b4-922f-beeff00e2937 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:34.614303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 823/1634] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:42:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:34.615465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 812/1635] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:34.736968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ea1e7-6de0-403c-952a-4ee6cb2f4234 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:34.737284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ea1e7-6de0-403c-952a-4ee6cb2f4234 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:34.737526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ea1e7-6de0-403c-952a-4ee6cb2f4234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:34.819591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-a63ea1e7-6de0-403c-952a-4ee6cb2f4234 None None] MFA Rules not processed for user `58b1cc1cc14f4ef99fab65cb70fac01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:34.823180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a63ea1e7-6de0-403c-952a-4ee6cb2f4234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:34.834903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f06cf6-079d-41b4-922f-beeff00e2937 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:34.849696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f06cf6-079d-41b4-922f-beeff00e2937 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:34.875388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31af08-cf85-40ff-a660-3a60090f04f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:34.876450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31af08-cf85-40ff-a660-3a60090f04f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:34.877074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31af08-cf85-40ff-a660-3a60090f04f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:34.877074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31af08-cf85-40ff-a660-3a60090f04f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:34.911756 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31af08-cf85-40ff-a660-3a60090f04f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:34.917709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31af08-cf85-40ff-a660-3a60090f04f1 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:34.963291 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 813/1636] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:42:34.975589 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 824/1637] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:34.980457 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31af08-cf85-40ff-a660-3a60090f04f1 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:35.203860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31af08-cf85-40ff-a660-3a60090f04f1 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:35.214948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6fb85-d2d1-4d1e-9ee6-0b3892599ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:35.216007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6fb85-d2d1-4d1e-9ee6-0b3892599ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:35.216518 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6fb85-d2d1-4d1e-9ee6-0b3892599ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:35.216998 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6fb85-d2d1-4d1e-9ee6-0b3892599ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:35.217933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6fb85-d2d1-4d1e-9ee6-0b3892599ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:35.224687 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6fb85-d2d1-4d1e-9ee6-0b3892599ba2 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:35.333190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 814/1638] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:34 2022] POST /identity/v3/projects => generated 401 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:35.338183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ea1e7-6de0-403c-952a-4ee6cb2f4234 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:35.358481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ea1e7-6de0-403c-952a-4ee6cb2f4234 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:35.386902 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6fb85-d2d1-4d1e-9ee6-0b3892599ba2 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:35.507478 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f4d9b-fd1e-48f1-93ee-2201e1068672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:35.512932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f4d9b-fd1e-48f1-93ee-2201e1068672 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:35.514572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6fb85-d2d1-4d1e-9ee6-0b3892599ba2 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:35.517105 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f4d9b-fd1e-48f1-93ee-2201e1068672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:35.517484 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f4d9b-fd1e-48f1-93ee-2201e1068672 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:35.519561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f4d9b-fd1e-48f1-93ee-2201e1068672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:35.525728 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f4d9b-fd1e-48f1-93ee-2201e1068672 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:35.529933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321273bf-e435-46d2-b5b2-f7dacf3bc02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:35.531608 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321273bf-e435-46d2-b5b2-f7dacf3bc02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:35.533238 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321273bf-e435-46d2-b5b2-f7dacf3bc02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:35.533691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321273bf-e435-46d2-b5b2-f7dacf3bc02f admin admin] PATH_INFO: `/v3/users/ea691a2a7ff1465aaba5a0e8c19fd5e9` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:35.543372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321273bf-e435-46d2-b5b2-f7dacf3bc02f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea691a2a7ff1465aaba5a0e8c19fd5e9)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:35.545562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321273bf-e435-46d2-b5b2-f7dacf3bc02f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:35.577447 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 825/1639] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:35 2022] POST /identity/v3/users => generated 307 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:35.582151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f4d9b-fd1e-48f1-93ee-2201e1068672 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:35.610359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f4d9b-fd1e-48f1-93ee-2201e1068672 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:35.620063 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0767f5a-06a3-4d0b-ac84-b4f3d7da5d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:35.620850 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0767f5a-06a3-4d0b-ac84-b4f3d7da5d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:35.621209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0767f5a-06a3-4d0b-ac84-b4f3d7da5d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:35.621544 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0767f5a-06a3-4d0b-ac84-b4f3d7da5d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:35.622369 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0767f5a-06a3-4d0b-ac84-b4f3d7da5d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:35.625272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0767f5a-06a3-4d0b-ac84-b4f3d7da5d2b admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:35.651960 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 826/1640] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:35.653437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377582c3-2248-431f-9f8b-ba6e64c4a456 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:35.653729 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377582c3-2248-431f-9f8b-ba6e64c4a456 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:35.654026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-321273bf-e435-46d2-b5b2-f7dacf3bc02f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea691a2a7ff1465aaba5a0e8c19fd5e9'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:35.654739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377582c3-2248-431f-9f8b-ba6e64c4a456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:35.656948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-321273bf-e435-46d2-b5b2-f7dacf3bc02f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea691a2a7ff1465aaba5a0e8c19fd5e9'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:35.660769 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-321273bf-e435-46d2-b5b2-f7dacf3bc02f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea691a2a7ff1465aaba5a0e8c19fd5e9'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:35.695508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-321273bf-e435-46d2-b5b2-f7dacf3bc02f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea691a2a7ff1465aaba5a0e8c19fd5e9'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:35.708140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-321273bf-e435-46d2-b5b2-f7dacf3bc02f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea691a2a7ff1465aaba5a0e8c19fd5e9'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:35.721511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-377582c3-2248-431f-9f8b-ba6e64c4a456 None None] MFA Rules not processed for user `ee6837a9c14d408c8b1da84f7862d144`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:35.723093 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-377582c3-2248-431f-9f8b-ba6e64c4a456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:35.727394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 815/1641] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:42:35 2022] DELETE /identity/v3/users/ea691a2a7ff1465aaba5a0e8c19fd5e9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:35.730205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321273bf-e435-46d2-b5b2-f7dacf3bc02f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:35.732734 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-321273bf-e435-46d2-b5b2-f7dacf3bc02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:35.901081 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 827/1642] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:35.902927 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b69f4-cc7a-4467-910c-949ae45c1b84 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:35.903720 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b69f4-cc7a-4467-910c-949ae45c1b84 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:35.904013 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b69f4-cc7a-4467-910c-949ae45c1b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:35.922629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321273bf-e435-46d2-b5b2-f7dacf3bc02f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:35.931936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e87787-143d-4a5f-82d3-246475df9b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:35.933026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e87787-143d-4a5f-82d3-246475df9b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:35.933462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e87787-143d-4a5f-82d3-246475df9b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:35.933748 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e87787-143d-4a5f-82d3-246475df9b27 admin admin] PATH_INFO: `/v3/projects/98b839ccbdd54efbb709b7b8339034d5/users/fe36943e8e9e4c069bde8eca5428fc89/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:35.950996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-db2b69f4-cc7a-4467-910c-949ae45c1b84 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:35.952231 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-db2b69f4-cc7a-4467-910c-949ae45c1b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:35.955250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e87787-143d-4a5f-82d3-246475df9b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b839ccbdd54efbb709b7b8339034d5, user_id=fe36943e8e9e4c069bde8eca5428fc89, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:35.959284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e87787-143d-4a5f-82d3-246475df9b27 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:35.978262 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 828/1643] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:35.978435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 816/1644] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:35 2022] PUT /identity/v3/projects/98b839ccbdd54efbb709b7b8339034d5/users/fe36943e8e9e4c069bde8eca5428fc89/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:35.978525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead1c3-7afa-474c-8cdb-ed1f957714fd None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:35.978525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead1c3-7afa-474c-8cdb-ed1f957714fd None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:35.981043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead1c3-7afa-474c-8cdb-ed1f957714fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:35.981687 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e87787-143d-4a5f-82d3-246475df9b27 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:36.018416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-a7ead1c3-7afa-474c-8cdb-ed1f957714fd None None] MFA Rules not processed for user `ee6837a9c14d408c8b1da84f7862d144`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:36.019712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a7ead1c3-7afa-474c-8cdb-ed1f957714fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:36.093887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e87787-143d-4a5f-82d3-246475df9b27 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:36.102302 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372c34b-72e8-466a-9d93-7be0d72917d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:36.103942 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372c34b-72e8-466a-9d93-7be0d72917d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:36.104926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372c34b-72e8-466a-9d93-7be0d72917d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:36.105426 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372c34b-72e8-466a-9d93-7be0d72917d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:36.106523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372c34b-72e8-466a-9d93-7be0d72917d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:36.108766 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372c34b-72e8-466a-9d93-7be0d72917d1 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:36.148517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 829/1645] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:36.148517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ead1c3-7afa-474c-8cdb-ed1f957714fd None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:36.148517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a7ead1c3-7afa-474c-8cdb-ed1f957714fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:36.172255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 817/1646] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:36.173931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372c34b-72e8-466a-9d93-7be0d72917d1 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:36.191287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372c34b-72e8-466a-9d93-7be0d72917d1 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:36.201982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8796a2c-d330-4744-b627-4304849e48b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:36.205156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8796a2c-d330-4744-b627-4304849e48b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:36.205458 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8796a2c-d330-4744-b627-4304849e48b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:36.205895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8796a2c-d330-4744-b627-4304849e48b8 admin admin] PATH_INFO: `/v3/projects/98b839ccbdd54efbb709b7b8339034d5/users/fe36943e8e9e4c069bde8eca5428fc89/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:36.208523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8796a2c-d330-4744-b627-4304849e48b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b839ccbdd54efbb709b7b8339034d5, user_id=fe36943e8e9e4c069bde8eca5428fc89, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:36.213804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8796a2c-d330-4744-b627-4304849e48b8 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:36.234101 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 818/1647] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:36 2022] PUT /identity/v3/projects/98b839ccbdd54efbb709b7b8339034d5/users/fe36943e8e9e4c069bde8eca5428fc89/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:36.240765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8796a2c-d330-4744-b627-4304849e48b8 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:36.243180 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f8796a2c-d330-4744-b627-4304849e48b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:36.275372 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ead1c3-7afa-474c-8cdb-ed1f957714fd None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:36.400467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835e794-380d-46da-b9bf-d1fe2428ffa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:36.401183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835e794-380d-46da-b9bf-d1fe2428ffa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:36.401468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835e794-380d-46da-b9bf-d1fe2428ffa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:36.401750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835e794-380d-46da-b9bf-d1fe2428ffa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:36.413080 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8796a2c-d330-4744-b627-4304849e48b8 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:36.423396 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566e670-abf5-40c3-910f-f7402d305185 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:36.424071 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566e670-abf5-40c3-910f-f7402d305185 service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:36.424355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566e670-abf5-40c3-910f-f7402d305185 service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:36.424632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566e670-abf5-40c3-910f-f7402d305185 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:36.539245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835e794-380d-46da-b9bf-d1fe2428ffa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:36.541715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566e670-abf5-40c3-910f-f7402d305185 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:36.543732 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566e670-abf5-40c3-910f-f7402d305185 service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:36.543853 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835e794-380d-46da-b9bf-d1fe2428ffa3 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:36.567032 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 830/1649] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:36.567312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 819/1649] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:37.533603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98a96a-d225-48e1-adf5-0edc41026539 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:37.534129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98a96a-d225-48e1-adf5-0edc41026539 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:37.534129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98a96a-d225-48e1-adf5-0edc41026539 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:37.535743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 831/1650] 10.222.0.76 () {54 vars in 912 bytes} [Thu May 12 17:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:42:37.542297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09edda-2719-4ebb-95b4-c6d95bc24c45 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:37.542856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09edda-2719-4ebb-95b4-c6d95bc24c45 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:37.542856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09edda-2719-4ebb-95b4-c6d95bc24c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:37.641671 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-3d09edda-2719-4ebb-95b4-c6d95bc24c45 None None] MFA Rules not processed for user `731d9124a2294b95a7cf1127e5362b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:37.644040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3d09edda-2719-4ebb-95b4-c6d95bc24c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:37.683438 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 820/1651] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:42:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:37.758216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98a96a-d225-48e1-adf5-0edc41026539 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:37.786637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98a96a-d225-48e1-adf5-0edc41026539 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:37.791844 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bcf38-d040-4058-a2fa-0ca15562bab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:37.792679 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bcf38-d040-4058-a2fa-0ca15562bab2 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:37.792907 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bcf38-d040-4058-a2fa-0ca15562bab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:37.793410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bcf38-d040-4058-a2fa-0ca15562bab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:37.819362 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bcf38-d040-4058-a2fa-0ca15562bab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:37.824477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bcf38-d040-4058-a2fa-0ca15562bab2 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:37.853349 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 832/1652] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:37.901264 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09edda-2719-4ebb-95b4-c6d95bc24c45 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:37.901264 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3d09edda-2719-4ebb-95b4-c6d95bc24c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:37.928700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09edda-2719-4ebb-95b4-c6d95bc24c45 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:37.946172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c618c4-66c1-481d-94de-04c98cdc8ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:37.947139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c618c4-66c1-481d-94de-04c98cdc8ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:37.947434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c618c4-66c1-481d-94de-04c98cdc8ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:37.947718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c618c4-66c1-481d-94de-04c98cdc8ff9 admin admin] PATH_INFO: `/v3/users/248fdba5632b4c0f87d66fada5d3c5b3` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:37.949991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c618c4-66c1-481d-94de-04c98cdc8ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=248fdba5632b4c0f87d66fada5d3c5b3)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:37.952039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c618c4-66c1-481d-94de-04c98cdc8ff9 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:38.048739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-58c618c4-66c1-481d-94de-04c98cdc8ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248fdba5632b4c0f87d66fada5d3c5b3'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:38.050046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-58c618c4-66c1-481d-94de-04c98cdc8ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248fdba5632b4c0f87d66fada5d3c5b3'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:38.050440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-58c618c4-66c1-481d-94de-04c98cdc8ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248fdba5632b4c0f87d66fada5d3c5b3'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:38.077772 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-58c618c4-66c1-481d-94de-04c98cdc8ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248fdba5632b4c0f87d66fada5d3c5b3'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:38.091834 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-58c618c4-66c1-481d-94de-04c98cdc8ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248fdba5632b4c0f87d66fada5d3c5b3'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:38.119462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 821/1653] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:42:37 2022] DELETE /identity/v3/users/248fdba5632b4c0f87d66fada5d3c5b3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:38.124025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67b21d-d1dc-4a66-804e-58c10865ff15 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:38.124315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67b21d-d1dc-4a66-804e-58c10865ff15 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:38.124640 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67b21d-d1dc-4a66-804e-58c10865ff15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:38.182324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-5d67b21d-d1dc-4a66-804e-58c10865ff15 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:38.205269 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5d67b21d-d1dc-4a66-804e-58c10865ff15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:38.231025 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c618c4-66c1-481d-94de-04c98cdc8ff9 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:38.232749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-58c618c4-66c1-481d-94de-04c98cdc8ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:38.346650 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 833/1654] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:42:38.374960 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67b21d-d1dc-4a66-804e-58c10865ff15 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:38.385102 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5d67b21d-d1dc-4a66-804e-58c10865ff15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:38.423538 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c618c4-66c1-481d-94de-04c98cdc8ff9 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:38.436483 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:38.438991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:38.440431 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:38.441479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f admin admin] PATH_INFO: `/v3/projects/5b9fc19853b84a7da47009ee4a59fb80` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:38.445207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b9fc19853b84a7da47009ee4a59fb80)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:38.449886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: WARNING py.warnings [None req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:42:38.449886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: warnings.warn(msg) May 12 17:42:38.449886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: May 12 17:42:38.451981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:38.569606 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67b21d-d1dc-4a66-804e-58c10865ff15 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:38.590190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b9fc19853b84a7da47009ee4a59fb80', 'request_id': 'req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:38.607911 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b9fc19853b84a7da47009ee4a59fb80', 'request_id': 'req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:38.624319 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b9fc19853b84a7da47009ee4a59fb80', 'request_id': 'req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:38.657669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f admin admin] The token cache is being invalidate because project 5b9fc19853b84a7da47009ee4a59fb80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:42:38.658166 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:38.659767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9af1dbea-6d2f-43ba-8fc6-be48973e9c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:38.661489 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 822/1655] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:42:38 2022] DELETE /identity/v3/projects/5b9fc19853b84a7da47009ee4a59fb80 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:38.667725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69339ca-16aa-45ef-9ebc-751dd5745521 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:38.668343 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69339ca-16aa-45ef-9ebc-751dd5745521 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:38.668928 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69339ca-16aa-45ef-9ebc-751dd5745521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:38.718125 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-d69339ca-16aa-45ef-9ebc-751dd5745521 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:38.720231 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d69339ca-16aa-45ef-9ebc-751dd5745521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:38.747480 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0f667-021b-4f11-a59b-f94285768fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:38.748640 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0f667-021b-4f11-a59b-f94285768fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:38.749088 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0f667-021b-4f11-a59b-f94285768fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:38.750314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0f667-021b-4f11-a59b-f94285768fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:38.757073 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9ff0f667-021b-4f11-a59b-f94285768fe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:38.882537 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 823/1656] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:38.890188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512935f2-1b52-4d8b-8f34-88d129a2df9b None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:38.891027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512935f2-1b52-4d8b-8f34-88d129a2df9b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:38.891931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512935f2-1b52-4d8b-8f34-88d129a2df9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:38.922773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-512935f2-1b52-4d8b-8f34-88d129a2df9b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:38.927467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-512935f2-1b52-4d8b-8f34-88d129a2df9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:38.939942 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 824/1657] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:38.948524 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512935f2-1b52-4d8b-8f34-88d129a2df9b None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:38.949614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0f667-021b-4f11-a59b-f94285768fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:38.953617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0f667-021b-4f11-a59b-f94285768fe9 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:38.965193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512935f2-1b52-4d8b-8f34-88d129a2df9b None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:39.034477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 834/1658] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:39.034557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb38d93-9585-49b2-a414-95f15746b044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:39.034557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb38d93-9585-49b2-a414-95f15746b044 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:39.034557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb38d93-9585-49b2-a414-95f15746b044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:39.034557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb38d93-9585-49b2-a414-95f15746b044 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:39.035024 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb38d93-9585-49b2-a414-95f15746b044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:42:39.035024 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb38d93-9585-49b2-a414-95f15746b044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:39.035024 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb38d93-9585-49b2-a414-95f15746b044 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:39.035284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6134d8-fff9-43db-b7f7-633eb8b80271 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:39.035284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6134d8-fff9-43db-b7f7-633eb8b80271 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:39.035284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6134d8-fff9-43db-b7f7-633eb8b80271 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:39.035284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 835/1659] 10.222.0.76 () {54 vars in 960 bytes} [Thu May 12 17:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:42:39.035284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f898738-8797-436b-a019-afc8a088f227 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:39.035284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f898738-8797-436b-a019-afc8a088f227 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:39.036686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f898738-8797-436b-a019-afc8a088f227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:39.036746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 825/1660] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:42:39.039268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb38d93-9585-49b2-a414-95f15746b044 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:39.070197 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb38d93-9585-49b2-a414-95f15746b044 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:39.076144 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-8f898738-8797-436b-a019-afc8a088f227 None None] MFA Rules not processed for user `a01fa037b14c456eb533b5a86da0a370`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:39.077600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8f898738-8797-436b-a019-afc8a088f227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:39.116936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670d061-fd42-4be0-9ef3-bb60f197c97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:39.117633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670d061-fd42-4be0-9ef3-bb60f197c97b admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:39.117920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670d061-fd42-4be0-9ef3-bb60f197c97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:39.119288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670d061-fd42-4be0-9ef3-bb60f197c97b admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:39.120741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670d061-fd42-4be0-9ef3-bb60f197c97b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:39.137940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670d061-fd42-4be0-9ef3-bb60f197c97b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:39.216709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 826/1661] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:39 2022] POST /identity/v3/projects => generated 405 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:42:39.218290 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670d061-fd42-4be0-9ef3-bb60f197c97b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:39.219286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 836/1662] 10.222.0.76 () {58 vars in 1057 bytes} [Thu May 12 17:42:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 12 17:42:39.231805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f898738-8797-436b-a019-afc8a088f227 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:39.250241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f898738-8797-436b-a019-afc8a088f227 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:39.385653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc01c95-6317-4721-ba9c-5dd9062e3a57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01fa037b14c456eb533b5a86da0a370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:39.386335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc01c95-6317-4721-ba9c-5dd9062e3a57 service placement] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:39.386620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc01c95-6317-4721-ba9c-5dd9062e3a57 service placement] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:39.386924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc01c95-6317-4721-ba9c-5dd9062e3a57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:39.389964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670d061-fd42-4be0-9ef3-bb60f197c97b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:39.394117 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6fc01c95-6317-4721-ba9c-5dd9062e3a57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:39.404182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22e8e4-ceaf-465f-ba6c-bacebad0a0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:39.404182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22e8e4-ceaf-465f-ba6c-bacebad0a0a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:39.404488 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22e8e4-ceaf-465f-ba6c-bacebad0a0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:39.404606 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22e8e4-ceaf-465f-ba6c-bacebad0a0a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:39.405465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22e8e4-ceaf-465f-ba6c-bacebad0a0a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:39.407475 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22e8e4-ceaf-465f-ba6c-bacebad0a0a0 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:39.415753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc01c95-6317-4721-ba9c-5dd9062e3a57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:39.419049 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc01c95-6317-4721-ba9c-5dd9062e3a57 service placement] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:39.452185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 837/1663] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:39.458424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 827/1664] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:39 2022] POST /identity/v3/users => generated 303 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:39.458585 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2a7dd-d95c-4e3b-abd7-cf87af9c485b None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:39.459603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22e8e4-ceaf-465f-ba6c-bacebad0a0a0 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:39.461298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2a7dd-d95c-4e3b-abd7-cf87af9c485b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:39.462626 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2a7dd-d95c-4e3b-abd7-cf87af9c485b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:39.484934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22e8e4-ceaf-465f-ba6c-bacebad0a0a0 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:39.495901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c53da9-061a-419a-88eb-e8dbcc849e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:39.496797 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c53da9-061a-419a-88eb-e8dbcc849e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:39.497150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c53da9-061a-419a-88eb-e8dbcc849e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:39.497470 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c53da9-061a-419a-88eb-e8dbcc849e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:39.498215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c53da9-061a-419a-88eb-e8dbcc849e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:39.500311 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c53da9-061a-419a-88eb-e8dbcc849e00 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:39.529759 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 828/1665] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:39.534603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c53da9-061a-419a-88eb-e8dbcc849e00 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:39.548397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c53da9-061a-419a-88eb-e8dbcc849e00 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:39.556617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-e3e2a7dd-d95c-4e3b-abd7-cf87af9c485b None None] MFA Rules not processed for user `fe36943e8e9e4c069bde8eca5428fc89`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:39.558376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e3e2a7dd-d95c-4e3b-abd7-cf87af9c485b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:39.570327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b92a28-3e89-4b81-87b5-9d7e7c022bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:39.570944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b92a28-3e89-4b81-87b5-9d7e7c022bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:39.571228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b92a28-3e89-4b81-87b5-9d7e7c022bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:39.572077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b92a28-3e89-4b81-87b5-9d7e7c022bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:39.572820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b92a28-3e89-4b81-87b5-9d7e7c022bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:39.578908 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b92a28-3e89-4b81-87b5-9d7e7c022bf0 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:39.609681 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 829/1666] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:39.611254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b92a28-3e89-4b81-87b5-9d7e7c022bf0 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:39.633215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b92a28-3e89-4b81-87b5-9d7e7c022bf0 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:39.648078 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980ccee-5f0e-45a9-83a1-94cdb4178e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:39.648921 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980ccee-5f0e-45a9-83a1-94cdb4178e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:39.650783 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980ccee-5f0e-45a9-83a1-94cdb4178e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:39.658811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980ccee-5f0e-45a9-83a1-94cdb4178e96 admin admin] PATH_INFO: `/v3/projects/768ff66cccb9433f8559badf8dc2eac1/users/ae255fb3c2404a3cbcf85494a58336ec/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:39.692541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980ccee-5f0e-45a9-83a1-94cdb4178e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=768ff66cccb9433f8559badf8dc2eac1, user_id=ae255fb3c2404a3cbcf85494a58336ec, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:39.695299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980ccee-5f0e-45a9-83a1-94cdb4178e96 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:39.726716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 830/1667] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:39 2022] PUT /identity/v3/projects/768ff66cccb9433f8559badf8dc2eac1/users/ae255fb3c2404a3cbcf85494a58336ec/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:39.728543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 838/1668] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:39 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:39.731348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76b43-f882-43b3-8ff0-0c2912aa7764 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:39.731648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76b43-f882-43b3-8ff0-0c2912aa7764 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:39.731930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76b43-f882-43b3-8ff0-0c2912aa7764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:39.814293 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-dca76b43-f882-43b3-8ff0-0c2912aa7764 None None] MFA Rules not processed for user `ae255fb3c2404a3cbcf85494a58336ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:39.816045 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-dca76b43-f882-43b3-8ff0-0c2912aa7764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:39.948371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 831/1669] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:39.953101 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2a7dd-d95c-4e3b-abd7-cf87af9c485b None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:39.972528 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2a7dd-d95c-4e3b-abd7-cf87af9c485b None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:40.089468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c22e5-5895-4dd7-b89b-98411174506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:40.091335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c22e5-5895-4dd7-b89b-98411174506b admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:40.091616 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c22e5-5895-4dd7-b89b-98411174506b admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:40.091909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c22e5-5895-4dd7-b89b-98411174506b admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:40.092703 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c22e5-5895-4dd7-b89b-98411174506b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:40.094712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c22e5-5895-4dd7-b89b-98411174506b admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:40.165288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 839/1670] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:39 2022] POST /identity/v3/projects => generated 403 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:40.170168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca76b43-f882-43b3-8ff0-0c2912aa7764 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:40.192689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca76b43-f882-43b3-8ff0-0c2912aa7764 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:40.632380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c22e5-5895-4dd7-b89b-98411174506b admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:40.635873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a71c22e5-5895-4dd7-b89b-98411174506b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:40.698107 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb7d68-81db-40c3-bf3f-b62dbd128834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:40.698898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb7d68-81db-40c3-bf3f-b62dbd128834 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:40.699113 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb7d68-81db-40c3-bf3f-b62dbd128834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:40.699389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb7d68-81db-40c3-bf3f-b62dbd128834 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:40.700097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb7d68-81db-40c3-bf3f-b62dbd128834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:40.702255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb7d68-81db-40c3-bf3f-b62dbd128834 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:40.739543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 832/1671] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:40 2022] POST /identity/v3/users => generated 308 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:40.746716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb7d68-81db-40c3-bf3f-b62dbd128834 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:40.781194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb7d68-81db-40c3-bf3f-b62dbd128834 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:40.794348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430deb6-4121-40d6-ac5b-e771ff5a37c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:40.796907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430deb6-4121-40d6-ac5b-e771ff5a37c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:40.797210 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430deb6-4121-40d6-ac5b-e771ff5a37c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:40.797468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430deb6-4121-40d6-ac5b-e771ff5a37c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:40.799546 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c22e5-5895-4dd7-b89b-98411174506b admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:40.800643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430deb6-4121-40d6-ac5b-e771ff5a37c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:40.805493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de18ab-cba2-4a87-97f3-742f0376dcb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:40.805861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430deb6-4121-40d6-ac5b-e771ff5a37c7 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:40.806945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de18ab-cba2-4a87-97f3-742f0376dcb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:40.807419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de18ab-cba2-4a87-97f3-742f0376dcb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:40.807946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de18ab-cba2-4a87-97f3-742f0376dcb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:40.811927 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-48de18ab-cba2-4a87-97f3-742f0376dcb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:40.862962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 833/1672] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:40.865527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430deb6-4121-40d6-ac5b-e771ff5a37c7 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:40.896885 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430deb6-4121-40d6-ac5b-e771ff5a37c7 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:40.919918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61131411-c082-4e0f-be2e-c1b6c5690871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:40.921102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61131411-c082-4e0f-be2e-c1b6c5690871 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:40.921232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61131411-c082-4e0f-be2e-c1b6c5690871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:40.921516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61131411-c082-4e0f-be2e-c1b6c5690871 admin admin] PATH_INFO: `/v3/projects/50c14d2ebada4d98aae5a6674537b3d8/users/6aeed6710d7d4e229c12434e9a91ea73/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:40.947312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61131411-c082-4e0f-be2e-c1b6c5690871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c14d2ebada4d98aae5a6674537b3d8, user_id=6aeed6710d7d4e229c12434e9a91ea73, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:40.950194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61131411-c082-4e0f-be2e-c1b6c5690871 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:40.976618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 834/1673] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:40 2022] PUT /identity/v3/projects/50c14d2ebada4d98aae5a6674537b3d8/users/6aeed6710d7d4e229c12434e9a91ea73/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:40.983048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61131411-c082-4e0f-be2e-c1b6c5690871 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:41.048389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de18ab-cba2-4a87-97f3-742f0376dcb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:41.054610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de18ab-cba2-4a87-97f3-742f0376dcb3 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:41.099816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 840/1674] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:41.112764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61131411-c082-4e0f-be2e-c1b6c5690871 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:41.120816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cbca9-7fc9-4659-9b92-3db017a8ef10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:41.121564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cbca9-7fc9-4659-9b92-3db017a8ef10 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:41.121856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cbca9-7fc9-4659-9b92-3db017a8ef10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:41.122136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cbca9-7fc9-4659-9b92-3db017a8ef10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:41.123070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cbca9-7fc9-4659-9b92-3db017a8ef10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:41.125487 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cbca9-7fc9-4659-9b92-3db017a8ef10 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:41.140987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 835/1675] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:41.144581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de18ab-cba2-4a87-97f3-742f0376dcb3 service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:41.159862 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de18ab-cba2-4a87-97f3-742f0376dcb3 service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:41.180077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59018349-d5f5-4c51-bc9e-bd5e1caa797c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:41.190598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59018349-d5f5-4c51-bc9e-bd5e1caa797c admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:41.194835 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59018349-d5f5-4c51-bc9e-bd5e1caa797c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:41.197213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59018349-d5f5-4c51-bc9e-bd5e1caa797c admin admin] PATH_INFO: `/v3/projects/50c14d2ebada4d98aae5a6674537b3d8/users/6aeed6710d7d4e229c12434e9a91ea73/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:41.204114 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59018349-d5f5-4c51-bc9e-bd5e1caa797c admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c14d2ebada4d98aae5a6674537b3d8, user_id=6aeed6710d7d4e229c12434e9a91ea73, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:41.227200 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59018349-d5f5-4c51-bc9e-bd5e1caa797c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:41.263941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 841/1676] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:41 2022] PUT /identity/v3/projects/50c14d2ebada4d98aae5a6674537b3d8/users/6aeed6710d7d4e229c12434e9a91ea73/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:41.274866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e514-b208-47f6-8861-b9b6042dd5b6 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:41.277311 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e514-b208-47f6-8861-b9b6042dd5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:41.277724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922e514-b208-47f6-8861-b9b6042dd5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:41.328386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c922e514-b208-47f6-8861-b9b6042dd5b6 None None] MFA Rules not processed for user `6aeed6710d7d4e229c12434e9a91ea73`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:41.329614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c922e514-b208-47f6-8861-b9b6042dd5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:41.437622 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59018349-d5f5-4c51-bc9e-bd5e1caa797c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:41.439381 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-59018349-d5f5-4c51-bc9e-bd5e1caa797c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:41.557895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 836/1677] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:41.570017 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e514-b208-47f6-8861-b9b6042dd5b6 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:41.575080 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c922e514-b208-47f6-8861-b9b6042dd5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:41.737922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59018349-d5f5-4c51-bc9e-bd5e1caa797c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:41.792703 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6da8-5345-4153-b41b-733606837334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:41.793806 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6da8-5345-4153-b41b-733606837334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:41.794232 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6da8-5345-4153-b41b-733606837334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:41.797669 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6da8-5345-4153-b41b-733606837334 admin admin] PATH_INFO: `/v3/projects/602bab993c484805a00eca75f117ca3d` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:41.801310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6da8-5345-4153-b41b-733606837334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=602bab993c484805a00eca75f117ca3d)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:41.806862 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6da8-5345-4153-b41b-733606837334 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:41.849644 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922e514-b208-47f6-8861-b9b6042dd5b6 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:41.865178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998fb6e-1a71-46db-b228-ace7cdbf272e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:41.866059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998fb6e-1a71-46db-b228-ace7cdbf272e service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:41.873164 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998fb6e-1a71-46db-b228-ace7cdbf272e service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:41.873697 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998fb6e-1a71-46db-b228-ace7cdbf272e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:41.901781 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998fb6e-1a71-46db-b228-ace7cdbf272e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:41.903669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998fb6e-1a71-46db-b228-ace7cdbf272e service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:41.931899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 837/1678] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:41 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:42:41.936531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-976e6da8-5345-4153-b41b-733606837334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602bab993c484805a00eca75f117ca3d', 'request_id': 'req-976e6da8-5345-4153-b41b-733606837334'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:41.950356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-976e6da8-5345-4153-b41b-733606837334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602bab993c484805a00eca75f117ca3d', 'request_id': 'req-976e6da8-5345-4153-b41b-733606837334'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:41.979069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-976e6da8-5345-4153-b41b-733606837334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602bab993c484805a00eca75f117ca3d', 'request_id': 'req-976e6da8-5345-4153-b41b-733606837334'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:42.003999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-976e6da8-5345-4153-b41b-733606837334 admin admin] The token cache is being invalidate because project 602bab993c484805a00eca75f117ca3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:42:42.004294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-976e6da8-5345-4153-b41b-733606837334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:42.010977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-976e6da8-5345-4153-b41b-733606837334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:42.013216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 842/1679] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:42:41 2022] DELETE /identity/v3/projects/602bab993c484805a00eca75f117ca3d => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:42:42.018941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c52179-21c1-4561-bb0f-7e26e23be511 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:42.019409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c52179-21c1-4561-bb0f-7e26e23be511 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:42.019826 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c52179-21c1-4561-bb0f-7e26e23be511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:42.063049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-d7c52179-21c1-4561-bb0f-7e26e23be511 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:42.064805 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d7c52179-21c1-4561-bb0f-7e26e23be511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:42.217340 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4001a8b-0d08-4370-8a00-b444fa570c32 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:42.217884 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4001a8b-0d08-4370-8a00-b444fa570c32 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:42.218404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4001a8b-0d08-4370-8a00-b444fa570c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:42.221665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 838/1680] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:42.266547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-e4001a8b-0d08-4370-8a00-b444fa570c32 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:42.271318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e4001a8b-0d08-4370-8a00-b444fa570c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:42.300716 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 843/1681] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:42.305193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c52179-21c1-4561-bb0f-7e26e23be511 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:42.328573 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c52179-21c1-4561-bb0f-7e26e23be511 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:42.334871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44c6e5-da90-49f0-8208-a9404e6ac635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:42.336009 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44c6e5-da90-49f0-8208-a9404e6ac635 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:42.336549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44c6e5-da90-49f0-8208-a9404e6ac635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:42.337764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44c6e5-da90-49f0-8208-a9404e6ac635 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:42.338808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44c6e5-da90-49f0-8208-a9404e6ac635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:42:42.339219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44c6e5-da90-49f0-8208-a9404e6ac635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:42.341203 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44c6e5-da90-49f0-8208-a9404e6ac635 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:42.362173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 839/1682] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:42:42.364148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4001a8b-0d08-4370-8a00-b444fa570c32 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:42.377022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4001a8b-0d08-4370-8a00-b444fa570c32 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:42.393977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7bc29-d96b-4d6f-aac3-77251422c9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:42.394645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7bc29-d96b-4d6f-aac3-77251422c9ca admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:42.395021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7bc29-d96b-4d6f-aac3-77251422c9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:42.395466 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7bc29-d96b-4d6f-aac3-77251422c9ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:42.396335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7bc29-d96b-4d6f-aac3-77251422c9ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:42.398370 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7bc29-d96b-4d6f-aac3-77251422c9ca admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:42.432376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 844/1683] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:42 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:42.436211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44c6e5-da90-49f0-8208-a9404e6ac635 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:42.448886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44c6e5-da90-49f0-8208-a9404e6ac635 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:42.521665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a72827-c360-43f9-887c-9eb567730f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:42.522395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72827-c360-43f9-887c-9eb567730f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:42.522693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72827-c360-43f9-887c-9eb567730f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:42.522973 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72827-c360-43f9-887c-9eb567730f8f admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:42.523731 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a72827-c360-43f9-887c-9eb567730f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:42.526910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a72827-c360-43f9-887c-9eb567730f8f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:42.559651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 840/1684] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:42 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:42:42.563653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7bc29-d96b-4d6f-aac3-77251422c9ca admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:42.579106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7bc29-d96b-4d6f-aac3-77251422c9ca admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:42.589402 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b79d5-6671-4315-889e-733c9540ffae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:42.590609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b79d5-6671-4315-889e-733c9540ffae admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:42.591680 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b79d5-6671-4315-889e-733c9540ffae admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:42.592153 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b79d5-6671-4315-889e-733c9540ffae admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:42.595322 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b79d5-6671-4315-889e-733c9540ffae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:42.601850 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b79d5-6671-4315-889e-733c9540ffae admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:42.623054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a72827-c360-43f9-887c-9eb567730f8f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:42.624389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 845/1685] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:42:42.638313 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a72827-c360-43f9-887c-9eb567730f8f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:42.655701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2293c1d-ad3a-445c-ab8d-c7c90adc46ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:42.656878 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2293c1d-ad3a-445c-ab8d-c7c90adc46ac admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:42.657043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2293c1d-ad3a-445c-ab8d-c7c90adc46ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:42.657314 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2293c1d-ad3a-445c-ab8d-c7c90adc46ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:42.658567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2293c1d-ad3a-445c-ab8d-c7c90adc46ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:42.661879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2293c1d-ad3a-445c-ab8d-c7c90adc46ac admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:42.690569 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 841/1686] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:42:42.693785 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b79d5-6671-4315-889e-733c9540ffae admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:42.714562 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b79d5-6671-4315-889e-733c9540ffae admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:42.722485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd679dbc-8c86-45a2-b29c-e2eb6d41983c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:42.724148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd679dbc-8c86-45a2-b29c-e2eb6d41983c admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:42.724571 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd679dbc-8c86-45a2-b29c-e2eb6d41983c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:42.724985 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd679dbc-8c86-45a2-b29c-e2eb6d41983c admin admin] PATH_INFO: `/v3/projects/e9ae77622e5d4b78997d4b1994d1380c/users/2c259e0c1bd84b4b80b20aad95e91b7b/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:42.750953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd679dbc-8c86-45a2-b29c-e2eb6d41983c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ae77622e5d4b78997d4b1994d1380c, user_id=2c259e0c1bd84b4b80b20aad95e91b7b, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:42.756710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd679dbc-8c86-45a2-b29c-e2eb6d41983c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:42.799666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1b83-5d77-4a29-a890-c5abe6daf900 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:42.799958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1b83-5d77-4a29-a890-c5abe6daf900 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:42.800055 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 846/1687] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:42 2022] PUT /identity/v3/projects/e9ae77622e5d4b78997d4b1994d1380c/users/2c259e0c1bd84b4b80b20aad95e91b7b/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:42.800231 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a1b83-5d77-4a29-a890-c5abe6daf900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:42.870282 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-4a1a1b83-5d77-4a29-a890-c5abe6daf900 None None] MFA Rules not processed for user `2c259e0c1bd84b4b80b20aad95e91b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:42.871593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4a1a1b83-5d77-4a29-a890-c5abe6daf900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:43.018287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 842/1688] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:42:43.022974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd679dbc-8c86-45a2-b29c-e2eb6d41983c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:43.150450 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd679dbc-8c86-45a2-b29c-e2eb6d41983c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:43.166522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261b415-76ba-4335-91cb-d6860af21190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:43.167482 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261b415-76ba-4335-91cb-d6860af21190 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:43.167928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261b415-76ba-4335-91cb-d6860af21190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:43.168343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261b415-76ba-4335-91cb-d6860af21190 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:43.169183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261b415-76ba-4335-91cb-d6860af21190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:43.171660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261b415-76ba-4335-91cb-d6860af21190 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:43.220998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 847/1689] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:43 2022] POST /identity/v3/projects => generated 361 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:43.224833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a1b83-5d77-4a29-a890-c5abe6daf900 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:43.243267 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a1b83-5d77-4a29-a890-c5abe6daf900 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:43.367577 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebda4c-ae0b-4af4-ad4c-d664d20a353a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:43.368424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebda4c-ae0b-4af4-ad4c-d664d20a353a admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:43.368710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebda4c-ae0b-4af4-ad4c-d664d20a353a admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:43.368992 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebda4c-ae0b-4af4-ad4c-d664d20a353a admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:43.369701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebda4c-ae0b-4af4-ad4c-d664d20a353a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:43.371679 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebda4c-ae0b-4af4-ad4c-d664d20a353a admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:43.408254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 843/1690] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:43 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:43.412315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261b415-76ba-4335-91cb-d6860af21190 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:43.428535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261b415-76ba-4335-91cb-d6860af21190 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:43.445784 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c293c-c9d5-4e91-9855-962f938af8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:43.447323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c293c-c9d5-4e91-9855-962f938af8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:43.447714 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c293c-c9d5-4e91-9855-962f938af8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:43.448208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c293c-c9d5-4e91-9855-962f938af8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:43.449105 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c293c-c9d5-4e91-9855-962f938af8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:43.450658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c293c-c9d5-4e91-9855-962f938af8b1 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:43.473819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 848/1691] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:43.482395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebda4c-ae0b-4af4-ad4c-d664d20a353a admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:43.494929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebda4c-ae0b-4af4-ad4c-d664d20a353a admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:43.543601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620bac2-443f-45c9-9563-cbf6539c9e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:43.544521 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620bac2-443f-45c9-9563-cbf6539c9e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:43.544800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620bac2-443f-45c9-9563-cbf6539c9e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:43.545074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620bac2-443f-45c9-9563-cbf6539c9e0d admin admin] PATH_INFO: `/v3/projects/8603419ca6b54fa891a596b427d52f9f/users/a41fd195abea43238e5653e30918ae68/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:43.592732 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620bac2-443f-45c9-9563-cbf6539c9e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8603419ca6b54fa891a596b427d52f9f, user_id=a41fd195abea43238e5653e30918ae68, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:43.595051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620bac2-443f-45c9-9563-cbf6539c9e0d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:43.617040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 844/1692] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:43 2022] PUT /identity/v3/projects/8603419ca6b54fa891a596b427d52f9f/users/a41fd195abea43238e5653e30918ae68/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:43.622130 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c293c-c9d5-4e91-9855-962f938af8b1 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:43.635082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c293c-c9d5-4e91-9855-962f938af8b1 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:43.762222 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620bac2-443f-45c9-9563-cbf6539c9e0d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:43.763974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4620bac2-443f-45c9-9563-cbf6539c9e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:43.855657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be89aaa-c499-4cc7-8921-cad34daf6919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:43.856631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be89aaa-c499-4cc7-8921-cad34daf6919 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:43.858454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be89aaa-c499-4cc7-8921-cad34daf6919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:43.859372 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be89aaa-c499-4cc7-8921-cad34daf6919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:43.860534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be89aaa-c499-4cc7-8921-cad34daf6919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:43.865586 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be89aaa-c499-4cc7-8921-cad34daf6919 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:43.902560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 849/1693] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:43.908780 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be89aaa-c499-4cc7-8921-cad34daf6919 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:43.958651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be89aaa-c499-4cc7-8921-cad34daf6919 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:43.980591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf8590-5697-45f1-a0b0-2e1cf48edc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:43.981871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf8590-5697-45f1-a0b0-2e1cf48edc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:43.982346 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf8590-5697-45f1-a0b0-2e1cf48edc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:43.982875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf8590-5697-45f1-a0b0-2e1cf48edc3a admin admin] PATH_INFO: `/v3/projects/8603419ca6b54fa891a596b427d52f9f/users/a41fd195abea43238e5653e30918ae68/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:43.985574 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf8590-5697-45f1-a0b0-2e1cf48edc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8603419ca6b54fa891a596b427d52f9f, user_id=a41fd195abea43238e5653e30918ae68, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:43.988769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf8590-5697-45f1-a0b0-2e1cf48edc3a admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:44.012325 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 850/1694] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:43 2022] PUT /identity/v3/projects/8603419ca6b54fa891a596b427d52f9f/users/a41fd195abea43238e5653e30918ae68/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:44.014350 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620bac2-443f-45c9-9563-cbf6539c9e0d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:44.023118 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e4eb-bb42-4cb5-9de5-653ce5006491 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:44.024617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e4eb-bb42-4cb5-9de5-653ce5006491 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:44.025322 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e4eb-bb42-4cb5-9de5-653ce5006491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:44.081446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-1959e4eb-bb42-4cb5-9de5-653ce5006491 None None] MFA Rules not processed for user `a41fd195abea43238e5653e30918ae68`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:44.087594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-1959e4eb-bb42-4cb5-9de5-653ce5006491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:44.155529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934f8dc-b3fe-4a29-8b17-bffb0eb68bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:44.156427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934f8dc-b3fe-4a29-8b17-bffb0eb68bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:44.156707 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934f8dc-b3fe-4a29-8b17-bffb0eb68bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:44.156984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934f8dc-b3fe-4a29-8b17-bffb0eb68bd8 admin admin] PATH_INFO: `/v3/users/ae255fb3c2404a3cbcf85494a58336ec` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:44.163569 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934f8dc-b3fe-4a29-8b17-bffb0eb68bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae255fb3c2404a3cbcf85494a58336ec)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:44.166097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934f8dc-b3fe-4a29-8b17-bffb0eb68bd8 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:44.255593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 851/1695] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:44 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:44.274601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959e4eb-bb42-4cb5-9de5-653ce5006491 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:44.277082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-1959e4eb-bb42-4cb5-9de5-653ce5006491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:44.304524 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-e934f8dc-b3fe-4a29-8b17-bffb0eb68bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae255fb3c2404a3cbcf85494a58336ec'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:44.305212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-e934f8dc-b3fe-4a29-8b17-bffb0eb68bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae255fb3c2404a3cbcf85494a58336ec'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:44.311163 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-e934f8dc-b3fe-4a29-8b17-bffb0eb68bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae255fb3c2404a3cbcf85494a58336ec'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:44.335919 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-e934f8dc-b3fe-4a29-8b17-bffb0eb68bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae255fb3c2404a3cbcf85494a58336ec'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:44.344387 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-e934f8dc-b3fe-4a29-8b17-bffb0eb68bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae255fb3c2404a3cbcf85494a58336ec'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:44.387767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 845/1696] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:42:43 2022] DELETE /identity/v3/users/ae255fb3c2404a3cbcf85494a58336ec => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:44.389381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920735e4-938c-411c-9655-684ca08d4816 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:44.389610 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920735e4-938c-411c-9655-684ca08d4816 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:44.389882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920735e4-938c-411c-9655-684ca08d4816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:44.402821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959e4eb-bb42-4cb5-9de5-653ce5006491 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:44.438212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-920735e4-938c-411c-9655-684ca08d4816 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:44.443151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-920735e4-938c-411c-9655-684ca08d4816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:44.520492 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b8bb9-6a3d-4be5-836f-f7c01b8ae92a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:44.521168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b8bb9-6a3d-4be5-836f-f7c01b8ae92a service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:44.521451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b8bb9-6a3d-4be5-836f-f7c01b8ae92a service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:44.521722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b8bb9-6a3d-4be5-836f-f7c01b8ae92a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:44.534462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-2b8b8bb9-6a3d-4be5-836f-f7c01b8ae92a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:44.671927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 846/1697] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:42:44.730208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920735e4-938c-411c-9655-684ca08d4816 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:44.731848 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-920735e4-938c-411c-9655-684ca08d4816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:44.772141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b8bb9-6a3d-4be5-836f-f7c01b8ae92a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:44.773611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b8bb9-6a3d-4be5-836f-f7c01b8ae92a service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:44.803128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 852/1698] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:44 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:42:44.931473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920735e4-938c-411c-9655-684ca08d4816 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:44.949961 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e2c90-425a-452e-8e83-eba11bb1a96f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:44.950640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2c90-425a-452e-8e83-eba11bb1a96f service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:44.952052 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2c90-425a-452e-8e83-eba11bb1a96f service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:44.952052 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e2c90-425a-452e-8e83-eba11bb1a96f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:44.987409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e2c90-425a-452e-8e83-eba11bb1a96f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:44.988867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e2c90-425a-452e-8e83-eba11bb1a96f service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:45.017943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 847/1699] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:45.064495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b8bb9-6a3d-4be5-836f-f7c01b8ae92a service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:45.066037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-2b8b8bb9-6a3d-4be5-836f-f7c01b8ae92a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:45.083381 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b8bb9-6a3d-4be5-836f-f7c01b8ae92a service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:45.089890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0a80c-a1ad-4a30-9247-9cd4f4c6f467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:45.090864 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0a80c-a1ad-4a30-9247-9cd4f4c6f467 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:45.091728 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0a80c-a1ad-4a30-9247-9cd4f4c6f467 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:45.092055 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0a80c-a1ad-4a30-9247-9cd4f4c6f467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:45.094463 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-afa0a80c-a1ad-4a30-9247-9cd4f4c6f467 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:45.356210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0a80c-a1ad-4a30-9247-9cd4f4c6f467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:45.362498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0a80c-a1ad-4a30-9247-9cd4f4c6f467 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:45.384867 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 853/1700] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:45.849695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d0c9-0f43-4d4a-b482-323047e07d59 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:45.849826 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d0c9-0f43-4d4a-b482-323047e07d59 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:45.850266 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d0c9-0f43-4d4a-b482-323047e07d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:45.882340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-a6c9d0c9-0f43-4d4a-b482-323047e07d59 None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:45.885992 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a6c9d0c9-0f43-4d4a-b482-323047e07d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:45.937747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0a80c-a1ad-4a30-9247-9cd4f4c6f467 service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:45.941039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-afa0a80c-a1ad-4a30-9247-9cd4f4c6f467 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:45.974304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0a80c-a1ad-4a30-9247-9cd4f4c6f467 service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:45.983957 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 848/1701] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:42:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:45.991450 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:45.992636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:45.993220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:45.994529 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] PATH_INFO: `/v3/users/58b1cc1cc14f4ef99fab65cb70fac01b` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:45.996264 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b1cc1cc14f4ef99fab65cb70fac01b)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:45.997415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: WARNING py.warnings [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:42:45.997415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: warnings.warn(msg) May 12 17:42:45.997415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: May 12 17:42:45.999332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:46.131269 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b1cc1cc14f4ef99fab65cb70fac01b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:46.132807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b1cc1cc14f4ef99fab65cb70fac01b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:46.198541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b1cc1cc14f4ef99fab65cb70fac01b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:46.199806 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b1cc1cc14f4ef99fab65cb70fac01b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:46.217234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b1cc1cc14f4ef99fab65cb70fac01b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:46.242718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 854/1702] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:42:45 2022] DELETE /identity/v3/users/58b1cc1cc14f4ef99fab65cb70fac01b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:46.322949 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9d0c9-0f43-4d4a-b482-323047e07d59 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:46.324525 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a6c9d0c9-0f43-4d4a-b482-323047e07d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:46.487682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9d0c9-0f43-4d4a-b482-323047e07d59 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:46.630038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eae94f-7b41-48fe-952f-6be2b7b6f217 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:46.631072 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eae94f-7b41-48fe-952f-6be2b7b6f217 service swift] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:46.631559 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eae94f-7b41-48fe-952f-6be2b7b6f217 service swift] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:46.632288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eae94f-7b41-48fe-952f-6be2b7b6f217 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:46.638722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-90eae94f-7b41-48fe-952f-6be2b7b6f217 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:46.793375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eae94f-7b41-48fe-952f-6be2b7b6f217 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:46.799618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eae94f-7b41-48fe-952f-6be2b7b6f217 service swift] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:46.823748 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 849/1703] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:42:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:42:47.705735 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:47.707900 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:47.968879 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c92e58-d255-40b4-8061-cc07190c5ba6 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:47.983024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:47.984213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:47.985902 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:47.986664 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] PATH_INFO: `/v3/projects/cc12aaf43fbf477997a42bb50359afd4` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:47.988845 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc12aaf43fbf477997a42bb50359afd4)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:47.991529 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:48.392623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eae94f-7b41-48fe-952f-6be2b7b6f217 service swift] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:48.395459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-90eae94f-7b41-48fe-952f-6be2b7b6f217 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:48.439885 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eae94f-7b41-48fe-952f-6be2b7b6f217 service swift] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:48.464643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:48.467178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:48.471700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:48.472785 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] PATH_INFO: `/v3/projects/768ff66cccb9433f8559badf8dc2eac1` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:48.489145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=768ff66cccb9433f8559badf8dc2eac1)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:48.494448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:48.526222 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc12aaf43fbf477997a42bb50359afd4', 'request_id': 'req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:48.554232 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc12aaf43fbf477997a42bb50359afd4', 'request_id': 'req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:48.573327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc12aaf43fbf477997a42bb50359afd4', 'request_id': 'req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:48.608264 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] The token cache is being invalidate because project cc12aaf43fbf477997a42bb50359afd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:42:48.608563 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:48.609989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:48.612928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 855/1704] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:42:47 2022] DELETE /identity/v3/projects/cc12aaf43fbf477997a42bb50359afd4 => generated 0 bytes in 908 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:48.625111 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:48.631247 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:48.723490 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768ff66cccb9433f8559badf8dc2eac1', 'request_id': 'req-7d1e552b-3bed-4040-a20f-a0f601a8da40'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:48.763438 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768ff66cccb9433f8559badf8dc2eac1', 'request_id': 'req-7d1e552b-3bed-4040-a20f-a0f601a8da40'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:48.781117 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768ff66cccb9433f8559badf8dc2eac1', 'request_id': 'req-7d1e552b-3bed-4040-a20f-a0f601a8da40'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:48.823743 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] The token cache is being invalidate because project 768ff66cccb9433f8559badf8dc2eac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:42:48.828185 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:48.831546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:48.836382 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 850/1705] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:42:48 2022] DELETE /identity/v3/projects/768ff66cccb9433f8559badf8dc2eac1 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:42:48.837958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:48.846974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:48.949543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98cb55-54d7-4d70-aacc-1b5f1410e0ed admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:49.128860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e552b-3bed-4040-a20f-a0f601a8da40 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:49.160084 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ac55b-e4a3-4541-b172-fa725a58b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:49.160997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ac55b-e4a3-4541-b172-fa725a58b3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:49.165536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ac55b-e4a3-4541-b172-fa725a58b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:49.169603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ac55b-e4a3-4541-b172-fa725a58b3a0 admin admin] PATH_INFO: `/v3/users/6aeed6710d7d4e229c12434e9a91ea73` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:49.171244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ac55b-e4a3-4541-b172-fa725a58b3a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aeed6710d7d4e229c12434e9a91ea73)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:49.182456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ac55b-e4a3-4541-b172-fa725a58b3a0 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:49.192799 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e72d13-c327-478c-9438-fc65fe3b4d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:49.193710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e72d13-c327-478c-9438-fc65fe3b4d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:49.193992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e72d13-c327-478c-9438-fc65fe3b4d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:49.194270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e72d13-c327-478c-9438-fc65fe3b4d35 admin admin] PATH_INFO: `/v3/users/fe36943e8e9e4c069bde8eca5428fc89` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:49.195904 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e72d13-c327-478c-9438-fc65fe3b4d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe36943e8e9e4c069bde8eca5428fc89)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:49.201751 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e72d13-c327-478c-9438-fc65fe3b4d35 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:49.348800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a80ac55b-e4a3-4541-b172-fa725a58b3a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aeed6710d7d4e229c12434e9a91ea73'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:49.352285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a80ac55b-e4a3-4541-b172-fa725a58b3a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aeed6710d7d4e229c12434e9a91ea73'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:49.354708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a80ac55b-e4a3-4541-b172-fa725a58b3a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aeed6710d7d4e229c12434e9a91ea73'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:49.364871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-29e72d13-c327-478c-9438-fc65fe3b4d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe36943e8e9e4c069bde8eca5428fc89'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:49.373635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-29e72d13-c327-478c-9438-fc65fe3b4d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe36943e8e9e4c069bde8eca5428fc89'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:49.396179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a80ac55b-e4a3-4541-b172-fa725a58b3a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aeed6710d7d4e229c12434e9a91ea73'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:49.407314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-29e72d13-c327-478c-9438-fc65fe3b4d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe36943e8e9e4c069bde8eca5428fc89'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:49.408152 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-29e72d13-c327-478c-9438-fc65fe3b4d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe36943e8e9e4c069bde8eca5428fc89'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:49.423977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-29e72d13-c327-478c-9438-fc65fe3b4d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe36943e8e9e4c069bde8eca5428fc89'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:49.425070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a80ac55b-e4a3-4541-b172-fa725a58b3a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aeed6710d7d4e229c12434e9a91ea73'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:49.456539 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 856/1706] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:42:48 2022] DELETE /identity/v3/users/fe36943e8e9e4c069bde8eca5428fc89 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:49.458425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa221400-c213-4bde-a28a-dad2c6b5e695 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:49.458886 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa221400-c213-4bde-a28a-dad2c6b5e695 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:49.459339 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa221400-c213-4bde-a28a-dad2c6b5e695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:49.511231 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 851/1707] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:42:48 2022] DELETE /identity/v3/users/6aeed6710d7d4e229c12434e9a91ea73 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:49.551420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-fa221400-c213-4bde-a28a-dad2c6b5e695 None None] MFA Rules not processed for user `10626535b6874ef58b63d259f059cd15`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:49.552738 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-fa221400-c213-4bde-a28a-dad2c6b5e695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:49.740532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 857/1708] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:49.756320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ac55b-e4a3-4541-b172-fa725a58b3a0 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:49.757822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a80ac55b-e4a3-4541-b172-fa725a58b3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:49.987339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ac55b-e4a3-4541-b172-fa725a58b3a0 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:50.012278 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a95d00-2307-44a1-beb2-df6eebfd93da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:50.013070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a95d00-2307-44a1-beb2-df6eebfd93da service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:50.013835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a95d00-2307-44a1-beb2-df6eebfd93da service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:50.013835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a95d00-2307-44a1-beb2-df6eebfd93da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:50.035845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a95d00-2307-44a1-beb2-df6eebfd93da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:50.037462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a95d00-2307-44a1-beb2-df6eebfd93da service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:50.069307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 852/1709] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:50.461869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa221400-c213-4bde-a28a-dad2c6b5e695 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:50.463964 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-fa221400-c213-4bde-a28a-dad2c6b5e695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:50.597289 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa221400-c213-4bde-a28a-dad2c6b5e695 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:50.611490 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8107e7d-bf29-4af2-bc77-c351e9362478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:50.614761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107e7d-bf29-4af2-bc77-c351e9362478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:50.615053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107e7d-bf29-4af2-bc77-c351e9362478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:50.615338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107e7d-bf29-4af2-bc77-c351e9362478 admin admin] PATH_INFO: `/v3/projects/98b839ccbdd54efbb709b7b8339034d5` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:50.624501 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8107e7d-bf29-4af2-bc77-c351e9362478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b839ccbdd54efbb709b7b8339034d5)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:50.629056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8107e7d-bf29-4af2-bc77-c351e9362478 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:50.733072 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a8107e7d-bf29-4af2-bc77-c351e9362478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b839ccbdd54efbb709b7b8339034d5', 'request_id': 'req-a8107e7d-bf29-4af2-bc77-c351e9362478'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:50.753136 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a8107e7d-bf29-4af2-bc77-c351e9362478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b839ccbdd54efbb709b7b8339034d5', 'request_id': 'req-a8107e7d-bf29-4af2-bc77-c351e9362478'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:50.769342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a8107e7d-bf29-4af2-bc77-c351e9362478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b839ccbdd54efbb709b7b8339034d5', 'request_id': 'req-a8107e7d-bf29-4af2-bc77-c351e9362478'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:50.791604 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a8107e7d-bf29-4af2-bc77-c351e9362478 admin admin] The token cache is being invalidate because project 98b839ccbdd54efbb709b7b8339034d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:42:50.792056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a8107e7d-bf29-4af2-bc77-c351e9362478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:50.793043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a8107e7d-bf29-4af2-bc77-c351e9362478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:50.795269 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 858/1710] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:42:50 2022] DELETE /identity/v3/projects/98b839ccbdd54efbb709b7b8339034d5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:50.800388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb24b8-166b-4158-be6f-4e79adeec8b2 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:50.800945 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb24b8-166b-4158-be6f-4e79adeec8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:50.800945 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb24b8-166b-4158-be6f-4e79adeec8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:50.851297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-12bb24b8-166b-4158-be6f-4e79adeec8b2 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:50.855796 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-12bb24b8-166b-4158-be6f-4e79adeec8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:50.965650 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c363ec-6444-438f-83f0-dfd1292b997f None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:50.966161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c363ec-6444-438f-83f0-dfd1292b997f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:50.966592 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c363ec-6444-438f-83f0-dfd1292b997f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:50.975135 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 853/1711] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:50.996161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-f3c363ec-6444-438f-83f0-dfd1292b997f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:51.000301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f3c363ec-6444-438f-83f0-dfd1292b997f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:51.069702 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 859/1712] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:51.074579 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb24b8-166b-4158-be6f-4e79adeec8b2 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:51.083537 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c363ec-6444-438f-83f0-dfd1292b997f None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:51.087747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f3c363ec-6444-438f-83f0-dfd1292b997f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:51.094134 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb24b8-166b-4158-be6f-4e79adeec8b2 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:51.112182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461c87b-d57c-435d-a4e5-beed975600aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:51.113131 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461c87b-d57c-435d-a4e5-beed975600aa admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:51.113852 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461c87b-d57c-435d-a4e5-beed975600aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:51.114287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461c87b-d57c-435d-a4e5-beed975600aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:51.115414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461c87b-d57c-435d-a4e5-beed975600aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:42:51.116054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461c87b-d57c-435d-a4e5-beed975600aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:51.117931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461c87b-d57c-435d-a4e5-beed975600aa admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:51.131325 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c363ec-6444-438f-83f0-dfd1292b997f None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:51.146156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333592df-5aaf-48bd-bd05-2a406f9c927d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:51.147610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333592df-5aaf-48bd-bd05-2a406f9c927d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:51.148092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333592df-5aaf-48bd-bd05-2a406f9c927d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:51.148712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333592df-5aaf-48bd-bd05-2a406f9c927d admin admin] PATH_INFO: `/v3/projects/50c14d2ebada4d98aae5a6674537b3d8` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:51.151551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 854/1713] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:42:51.155856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333592df-5aaf-48bd-bd05-2a406f9c927d admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c14d2ebada4d98aae5a6674537b3d8)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:51.156394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461c87b-d57c-435d-a4e5-beed975600aa admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:51.157858 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333592df-5aaf-48bd-bd05-2a406f9c927d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:51.174525 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461c87b-d57c-435d-a4e5-beed975600aa admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:51.195920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407e87b-e3bb-4e1f-affa-5aeaaa58f2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:51.196952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407e87b-e3bb-4e1f-affa-5aeaaa58f2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:51.197416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407e87b-e3bb-4e1f-affa-5aeaaa58f2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:51.202915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407e87b-e3bb-4e1f-affa-5aeaaa58f2e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:51.203775 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407e87b-e3bb-4e1f-affa-5aeaaa58f2e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:51.207288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407e87b-e3bb-4e1f-affa-5aeaaa58f2e5 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:51.256978 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-333592df-5aaf-48bd-bd05-2a406f9c927d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c14d2ebada4d98aae5a6674537b3d8', 'request_id': 'req-333592df-5aaf-48bd-bd05-2a406f9c927d'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:51.273135 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-333592df-5aaf-48bd-bd05-2a406f9c927d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c14d2ebada4d98aae5a6674537b3d8', 'request_id': 'req-333592df-5aaf-48bd-bd05-2a406f9c927d'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:51.294274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 855/1714] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:51 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:51.297502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-333592df-5aaf-48bd-bd05-2a406f9c927d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c14d2ebada4d98aae5a6674537b3d8', 'request_id': 'req-333592df-5aaf-48bd-bd05-2a406f9c927d'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:51.298600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407e87b-e3bb-4e1f-affa-5aeaaa58f2e5 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:51.314224 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-333592df-5aaf-48bd-bd05-2a406f9c927d admin admin] The token cache is being invalidate because project 50c14d2ebada4d98aae5a6674537b3d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:42:51.314522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-333592df-5aaf-48bd-bd05-2a406f9c927d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:51.315354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-333592df-5aaf-48bd-bd05-2a406f9c927d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:51.320627 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 860/1715] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:42:51 2022] DELETE /identity/v3/projects/50c14d2ebada4d98aae5a6674537b3d8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:51.324037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bae6b1-b019-4c3a-a28c-91ab71e19751 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:51.324616 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bae6b1-b019-4c3a-a28c-91ab71e19751 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:51.325067 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bae6b1-b019-4c3a-a28c-91ab71e19751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:51.381333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-52bae6b1-b019-4c3a-a28c-91ab71e19751 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:51.382628 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-52bae6b1-b019-4c3a-a28c-91ab71e19751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:51.570005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407e87b-e3bb-4e1f-affa-5aeaaa58f2e5 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:51.574969 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 861/1716] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:51.576422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42027-3f4e-47ab-a340-d0279bb5ea6d None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:51.576715 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42027-3f4e-47ab-a340-d0279bb5ea6d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:51.577030 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42027-3f4e-47ab-a340-d0279bb5ea6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:51.604038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c371414-0c25-40ff-8a34-945330a03b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:51.605407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c371414-0c25-40ff-8a34-945330a03b7b admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:51.605996 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c371414-0c25-40ff-8a34-945330a03b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:51.606424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c371414-0c25-40ff-8a34-945330a03b7b admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:51.607423 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c371414-0c25-40ff-8a34-945330a03b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:51.610939 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c371414-0c25-40ff-8a34-945330a03b7b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:51.685136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 856/1717] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:51 2022] POST /identity/v3/users => generated 287 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:42:51.689277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eea62-b158-4b7a-b452-27a3ad8cbbd8 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:51.689653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eea62-b158-4b7a-b452-27a3ad8cbbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:51.690016 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eea62-b158-4b7a-b452-27a3ad8cbbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:51.703853 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-08c42027-3f4e-47ab-a340-d0279bb5ea6d None None] MFA Rules not processed for user `d8866c723166455a9711559eb7f125c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:51.705498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-08c42027-3f4e-47ab-a340-d0279bb5ea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:51.827070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c09eea62-b158-4b7a-b452-27a3ad8cbbd8 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:51.834247 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c09eea62-b158-4b7a-b452-27a3ad8cbbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:51.848493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 857/1718] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:51.850320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579a048-fb85-4c5a-90cf-ef88ca017bef None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:51.851598 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579a048-fb85-4c5a-90cf-ef88ca017bef None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:51.852040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579a048-fb85-4c5a-90cf-ef88ca017bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:51.887152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-1579a048-fb85-4c5a-90cf-ef88ca017bef None None] MFA Rules not processed for user `731d9124a2294b95a7cf1127e5362b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:51.889910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1579a048-fb85-4c5a-90cf-ef88ca017bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:51.983662 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 862/1719] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:51.999265 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c42027-3f4e-47ab-a340-d0279bb5ea6d None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:52.002330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-08c42027-3f4e-47ab-a340-d0279bb5ea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:52.054072 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c42027-3f4e-47ab-a340-d0279bb5ea6d None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:52.062831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82cc12-4744-435c-9f42-bf640da05dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:52.064739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82cc12-4744-435c-9f42-bf640da05dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:52.073527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 858/1720] 10.222.0.89 () {58 vars in 1015 bytes} [Thu May 12 17:42:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:52.073733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82cc12-4744-435c-9f42-bf640da05dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:52.074060 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82cc12-4744-435c-9f42-bf640da05dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:52.074448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579a048-fb85-4c5a-90cf-ef88ca017bef None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:52.075421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82cc12-4744-435c-9f42-bf640da05dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:52.079721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82cc12-4744-435c-9f42-bf640da05dd0 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:52.101420 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579a048-fb85-4c5a-90cf-ef88ca017bef None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:52.108552 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 863/1721] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:52.109486 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82cc12-4744-435c-9f42-bf640da05dd0 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:52.112112 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ba82cc12-4744-435c-9f42-bf640da05dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:52.114789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39313d87-6e43-4ccf-b8a8-fd8d8af87098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:52.115567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39313d87-6e43-4ccf-b8a8-fd8d8af87098 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:52.115915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39313d87-6e43-4ccf-b8a8-fd8d8af87098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:52.116273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39313d87-6e43-4ccf-b8a8-fd8d8af87098 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:52.117132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39313d87-6e43-4ccf-b8a8-fd8d8af87098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:42:52.117513 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39313d87-6e43-4ccf-b8a8-fd8d8af87098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:52.123135 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39313d87-6e43-4ccf-b8a8-fd8d8af87098 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:52.151540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 859/1722] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:42:52.156367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39313d87-6e43-4ccf-b8a8-fd8d8af87098 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:52.178746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39313d87-6e43-4ccf-b8a8-fd8d8af87098 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:52.200774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aad6c-10ac-4cfc-a659-5636846b509b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:52.201617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aad6c-10ac-4cfc-a659-5636846b509b admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:52.206342 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aad6c-10ac-4cfc-a659-5636846b509b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:52.206861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aad6c-10ac-4cfc-a659-5636846b509b admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:52.207754 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6aad6c-10ac-4cfc-a659-5636846b509b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:52.211340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6aad6c-10ac-4cfc-a659-5636846b509b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:52.264648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 860/1723] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:52.266067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aad6c-10ac-4cfc-a659-5636846b509b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:52.273227 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-fd6aad6c-10ac-4cfc-a659-5636846b509b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:52.317982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aad6c-10ac-4cfc-a659-5636846b509b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:52.335023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a086b-5aa0-4c6b-826e-dc0736fbd8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:52.335892 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a086b-5aa0-4c6b-826e-dc0736fbd8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:52.336328 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a086b-5aa0-4c6b-826e-dc0736fbd8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:52.336780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a086b-5aa0-4c6b-826e-dc0736fbd8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:52.364205 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82cc12-4744-435c-9f42-bf640da05dd0 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:52.365593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a086b-5aa0-4c6b-826e-dc0736fbd8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:52.367719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a086b-5aa0-4c6b-826e-dc0736fbd8f0 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:52.373418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe941a4-c89f-463f-8f72-31d8017b75b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:52.374092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe941a4-c89f-463f-8f72-31d8017b75b7 service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:52.374374 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe941a4-c89f-463f-8f72-31d8017b75b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:52.374651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe941a4-c89f-463f-8f72-31d8017b75b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:52.395082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe941a4-c89f-463f-8f72-31d8017b75b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:52.396709 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe941a4-c89f-463f-8f72-31d8017b75b7 service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:52.403904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 861/1724] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:52.405021 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a086b-5aa0-4c6b-826e-dc0736fbd8f0 service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:52.447036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a086b-5aa0-4c6b-826e-dc0736fbd8f0 service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:52.450508 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 864/1725] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:52.451402 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe941a4-c89f-463f-8f72-31d8017b75b7 service nova] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:52.476306 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf65b1-159a-4c45-baff-e33d059c0ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:52.477087 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf65b1-159a-4c45-baff-e33d059c0ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:52.477952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf65b1-159a-4c45-baff-e33d059c0ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:52.478235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf65b1-159a-4c45-baff-e33d059c0ba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:52.479094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf65b1-159a-4c45-baff-e33d059c0ba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:52.481027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf65b1-159a-4c45-baff-e33d059c0ba3 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:52.486038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe941a4-c89f-463f-8f72-31d8017b75b7 service nova] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:52.501644 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63685c95-4b0b-4b04-86da-2e6980188f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:52.504908 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63685c95-4b0b-4b04-86da-2e6980188f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:52.506501 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63685c95-4b0b-4b04-86da-2e6980188f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:52.506999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63685c95-4b0b-4b04-86da-2e6980188f84 admin admin] PATH_INFO: `/v3/projects/177e5c059587422a8aa837870c4edfa3/users/6f2d13d1e20e413e926fd20bb63e6f7c/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:52.553000 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63685c95-4b0b-4b04-86da-2e6980188f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177e5c059587422a8aa837870c4edfa3, user_id=6f2d13d1e20e413e926fd20bb63e6f7c, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:52.564483 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63685c95-4b0b-4b04-86da-2e6980188f84 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:52.599727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 862/1727] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:52 2022] POST /identity/v3/projects => generated 357 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:52.604786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf65b1-159a-4c45-baff-e33d059c0ba3 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:52.608673 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 865/1727] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:52 2022] PUT /identity/v3/projects/177e5c059587422a8aa837870c4edfa3/users/6f2d13d1e20e413e926fd20bb63e6f7c/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:52.612774 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8304-2fae-4dec-b43d-cecdf031f8b9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:52.614423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8304-2fae-4dec-b43d-cecdf031f8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:52.615132 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8304-2fae-4dec-b43d-cecdf031f8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:52.712854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-b1ac8304-2fae-4dec-b43d-cecdf031f8b9 None None] MFA Rules not processed for user `6f2d13d1e20e413e926fd20bb63e6f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:52.714641 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b1ac8304-2fae-4dec-b43d-cecdf031f8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:52.821532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 866/1728] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:52.823116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac8304-2fae-4dec-b43d-cecdf031f8b9 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:52.823723 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf65b1-159a-4c45-baff-e33d059c0ba3 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:52.843920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac8304-2fae-4dec-b43d-cecdf031f8b9 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:52.848362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb8450-91e1-4f9f-823e-bfc042d572cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:52.849171 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb8450-91e1-4f9f-823e-bfc042d572cb admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:52.849534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb8450-91e1-4f9f-823e-bfc042d572cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:52.849819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb8450-91e1-4f9f-823e-bfc042d572cb admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:52.850533 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb8450-91e1-4f9f-823e-bfc042d572cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:52.851604 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c58e7-25c8-476c-854c-b00357929375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:52.853126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb8450-91e1-4f9f-823e-bfc042d572cb admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:52.853563 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c58e7-25c8-476c-854c-b00357929375 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:52.854331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c58e7-25c8-476c-854c-b00357929375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:52.854868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c58e7-25c8-476c-854c-b00357929375 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:52.855791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c58e7-25c8-476c-854c-b00357929375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:52.858577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c58e7-25c8-476c-854c-b00357929375 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:52.905563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 863/1729] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:52 2022] POST /identity/v3/users => generated 279 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:42:52.914656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb8450-91e1-4f9f-823e-bfc042d572cb admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:52.936468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 867/1730] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:52 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:52.943551 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c58e7-25c8-476c-854c-b00357929375 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:52.948878 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb8450-91e1-4f9f-823e-bfc042d572cb admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:53.139760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c58e7-25c8-476c-854c-b00357929375 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:53.150169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dc712-dccc-4122-ada4-6803fd422f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:53.151779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dc712-dccc-4122-ada4-6803fd422f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:53.152501 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dc712-dccc-4122-ada4-6803fd422f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:53.152990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dc712-dccc-4122-ada4-6803fd422f8f admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:53.153946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dc712-dccc-4122-ada4-6803fd422f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:53.155251 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27313c4-07eb-4d0f-bac5-a894cf6ee694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:53.156479 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dc712-dccc-4122-ada4-6803fd422f8f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:53.163391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27313c4-07eb-4d0f-bac5-a894cf6ee694 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:53.169057 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27313c4-07eb-4d0f-bac5-a894cf6ee694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:53.169971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27313c4-07eb-4d0f-bac5-a894cf6ee694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:53.171113 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27313c4-07eb-4d0f-bac5-a894cf6ee694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:53.173077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27313c4-07eb-4d0f-bac5-a894cf6ee694 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:53.208277 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 868/1732] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:52 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:53.212394 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dc712-dccc-4122-ada4-6803fd422f8f admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:53.215777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 864/1732] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:53.216811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27313c4-07eb-4d0f-bac5-a894cf6ee694 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:53.236971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27313c4-07eb-4d0f-bac5-a894cf6ee694 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:53.241678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dc712-dccc-4122-ada4-6803fd422f8f admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:53.261890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290934c-7441-45ad-bfdb-155b412a2825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:53.263048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290934c-7441-45ad-bfdb-155b412a2825 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:53.263671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290934c-7441-45ad-bfdb-155b412a2825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:53.264184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290934c-7441-45ad-bfdb-155b412a2825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:53.269126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cde3e8-d68a-4612-83ec-8512ddb2d956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:53.269723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290934c-7441-45ad-bfdb-155b412a2825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:53.270218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde3e8-d68a-4612-83ec-8512ddb2d956 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:53.270791 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde3e8-d68a-4612-83ec-8512ddb2d956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:53.271284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde3e8-d68a-4612-83ec-8512ddb2d956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:53.272069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290934c-7441-45ad-bfdb-155b412a2825 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:53.273681 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cde3e8-d68a-4612-83ec-8512ddb2d956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:53.276271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cde3e8-d68a-4612-83ec-8512ddb2d956 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:53.307782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 869/1733] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:53.312516 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290934c-7441-45ad-bfdb-155b412a2825 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:53.324911 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 865/1734] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:53.329196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cde3e8-d68a-4612-83ec-8512ddb2d956 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:53.343162 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290934c-7441-45ad-bfdb-155b412a2825 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:53.362207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d7980-17ec-42a2-b267-9ef4cf990ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:53.363452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d7980-17ec-42a2-b267-9ef4cf990ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:53.364371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cde3e8-d68a-4612-83ec-8512ddb2d956 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:53.364939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d7980-17ec-42a2-b267-9ef4cf990ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:53.367728 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d7980-17ec-42a2-b267-9ef4cf990ffa admin admin] PATH_INFO: `/v3/projects/ecb7dcd2aa854eeda35e09d95262c8d3/users/23c95b9ab0254976a2ad79fcd0dbd13f/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:53.389196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fc5f7-5bc8-45cd-a490-d22ad76cd76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:53.390391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fc5f7-5bc8-45cd-a490-d22ad76cd76f admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:53.391106 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fc5f7-5bc8-45cd-a490-d22ad76cd76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:53.391529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fc5f7-5bc8-45cd-a490-d22ad76cd76f admin admin] PATH_INFO: `/v3/projects/9facea94899244c9bffe4899721d88e7/users/304b9ad83f07411282543c72b7059fda/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:53.409357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d7980-17ec-42a2-b267-9ef4cf990ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb7dcd2aa854eeda35e09d95262c8d3, user_id=23c95b9ab0254976a2ad79fcd0dbd13f, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:53.412593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d7980-17ec-42a2-b267-9ef4cf990ffa admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:53.440695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fc5f7-5bc8-45cd-a490-d22ad76cd76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9facea94899244c9bffe4899721d88e7, user_id=304b9ad83f07411282543c72b7059fda, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:53.449370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fc5f7-5bc8-45cd-a490-d22ad76cd76f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:53.450215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 870/1735] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:53 2022] PUT /identity/v3/projects/ecb7dcd2aa854eeda35e09d95262c8d3/users/23c95b9ab0254976a2ad79fcd0dbd13f/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:42:53.461119 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c5659-68a5-4931-9585-a61ecda8311d None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:53.461510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c5659-68a5-4931-9585-a61ecda8311d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:53.462517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c5659-68a5-4931-9585-a61ecda8311d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:53.489498 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 866/1736] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:53 2022] PUT /identity/v3/projects/9facea94899244c9bffe4899721d88e7/users/304b9ad83f07411282543c72b7059fda/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:53.491283 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fc5f7-5bc8-45cd-a490-d22ad76cd76f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:53.528663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-078c5659-68a5-4931-9585-a61ecda8311d None None] MFA Rules not processed for user `23c95b9ab0254976a2ad79fcd0dbd13f`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:53.532173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-078c5659-68a5-4931-9585-a61ecda8311d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:53.655857 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fc5f7-5bc8-45cd-a490-d22ad76cd76f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:53.666581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd05caa-eea2-460c-b0a8-c5e2b07a347c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:53.667649 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd05caa-eea2-460c-b0a8-c5e2b07a347c admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:53.667809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd05caa-eea2-460c-b0a8-c5e2b07a347c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:53.669338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd05caa-eea2-460c-b0a8-c5e2b07a347c admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:53.670616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd05caa-eea2-460c-b0a8-c5e2b07a347c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:53.676306 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd05caa-eea2-460c-b0a8-c5e2b07a347c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:53.698969 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 871/1737] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:53 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:42:53.703120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 867/1738] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:53.706873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c5659-68a5-4931-9585-a61ecda8311d None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:53.709584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd05caa-eea2-460c-b0a8-c5e2b07a347c admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:53.732874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c5659-68a5-4931-9585-a61ecda8311d None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:53.733357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd05caa-eea2-460c-b0a8-c5e2b07a347c admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:53.743512 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2c74b-4b81-42fd-9e19-58edd4de12bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:53.744048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bced64-4502-4180-9fc7-e473468aa2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:53.744871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bced64-4502-4180-9fc7-e473468aa2cd admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:53.745217 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bced64-4502-4180-9fc7-e473468aa2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:53.746067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2c74b-4b81-42fd-9e19-58edd4de12bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:53.746421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bced64-4502-4180-9fc7-e473468aa2cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:53.747272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bced64-4502-4180-9fc7-e473468aa2cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:53.747981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2c74b-4b81-42fd-9e19-58edd4de12bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:53.748394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2c74b-4b81-42fd-9e19-58edd4de12bc admin admin] PATH_INFO: `/v3/projects/9facea94899244c9bffe4899721d88e7/users/304b9ad83f07411282543c72b7059fda/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:53.752453 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bced64-4502-4180-9fc7-e473468aa2cd admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:53.752993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2c74b-4b81-42fd-9e19-58edd4de12bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9facea94899244c9bffe4899721d88e7, user_id=304b9ad83f07411282543c72b7059fda, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:53.757026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2c74b-4b81-42fd-9e19-58edd4de12bc admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:53.798873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 868/1739] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:53 2022] PUT /identity/v3/projects/9facea94899244c9bffe4899721d88e7/users/304b9ad83f07411282543c72b7059fda/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:53.804841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2bae9-57bf-4b56-8b9b-ba8139ce2ec3 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:53.804841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2bae9-57bf-4b56-8b9b-ba8139ce2ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:53.806365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2bae9-57bf-4b56-8b9b-ba8139ce2ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:53.820735 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 872/1740] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:42:53 2022] POST /identity/v3/projects => generated 357 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:42:53.822929 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bced64-4502-4180-9fc7-e473468aa2cd admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:53.877479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-2db2bae9-57bf-4b56-8b9b-ba8139ce2ec3 None None] MFA Rules not processed for user `304b9ad83f07411282543c72b7059fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:53.881280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2db2bae9-57bf-4b56-8b9b-ba8139ce2ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:53.979871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bced64-4502-4180-9fc7-e473468aa2cd admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:53.994136 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973252df-0ad2-422b-8b35-4abcbdc3c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:53.997600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973252df-0ad2-422b-8b35-4abcbdc3c6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:53.998022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973252df-0ad2-422b-8b35-4abcbdc3c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:53.998710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973252df-0ad2-422b-8b35-4abcbdc3c6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:54.000280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973252df-0ad2-422b-8b35-4abcbdc3c6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:54.005988 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973252df-0ad2-422b-8b35-4abcbdc3c6b4 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:54.057220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 873/1741] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:42:53 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:42:54.059293 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973252df-0ad2-422b-8b35-4abcbdc3c6b4 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:54.074987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 869/1742] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:54.083409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2bae9-57bf-4b56-8b9b-ba8139ce2ec3 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:54.085445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2db2bae9-57bf-4b56-8b9b-ba8139ce2ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:54.093635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973252df-0ad2-422b-8b35-4abcbdc3c6b4 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:54.111863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834101b-169a-4f8a-b2ca-0396236f8db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:54.112969 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834101b-169a-4f8a-b2ca-0396236f8db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:54.113342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834101b-169a-4f8a-b2ca-0396236f8db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:54.113706 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834101b-169a-4f8a-b2ca-0396236f8db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:54.114558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834101b-169a-4f8a-b2ca-0396236f8db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:54.121353 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834101b-169a-4f8a-b2ca-0396236f8db8 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:54.161557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 874/1743] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:54.161557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834101b-169a-4f8a-b2ca-0396236f8db8 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:54.185226 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834101b-169a-4f8a-b2ca-0396236f8db8 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:54.198995 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc384bc-cf21-4b06-8e5e-d10232310850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:54.199929 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc384bc-cf21-4b06-8e5e-d10232310850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:54.200206 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc384bc-cf21-4b06-8e5e-d10232310850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:54.200501 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc384bc-cf21-4b06-8e5e-d10232310850 admin admin] PATH_INFO: `/v3/projects/634e623acb884359b2d579658464f081/users/059da31ef67e48858d9226f0106cb0ce/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:54.239108 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2bae9-57bf-4b56-8b9b-ba8139ce2ec3 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:54.249952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d96ac5-206c-4ea9-8c63-17ec01eeb538 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:54.250713 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d96ac5-206c-4ea9-8c63-17ec01eeb538 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:54.251007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d96ac5-206c-4ea9-8c63-17ec01eeb538 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:54.251286 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d96ac5-206c-4ea9-8c63-17ec01eeb538 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:54.256000 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc384bc-cf21-4b06-8e5e-d10232310850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634e623acb884359b2d579658464f081, user_id=059da31ef67e48858d9226f0106cb0ce, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:54.275860 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc384bc-cf21-4b06-8e5e-d10232310850 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:54.276082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d96ac5-206c-4ea9-8c63-17ec01eeb538 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:54.278733 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d96ac5-206c-4ea9-8c63-17ec01eeb538 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:54.311639 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 870/1744] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:54.326483 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 875/1745] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:54 2022] PUT /identity/v3/projects/634e623acb884359b2d579658464f081/users/059da31ef67e48858d9226f0106cb0ce/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:54.330548 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d96ac5-206c-4ea9-8c63-17ec01eeb538 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:54.348413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d96ac5-206c-4ea9-8c63-17ec01eeb538 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:54.548834 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358e02b-6e1c-432c-9884-ac129a5b7b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:54.549527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e02b-6e1c-432c-9884-ac129a5b7b82 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:54.549862 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e02b-6e1c-432c-9884-ac129a5b7b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:54.550148 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358e02b-6e1c-432c-9884-ac129a5b7b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:54.552803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358e02b-6e1c-432c-9884-ac129a5b7b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:54.554473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358e02b-6e1c-432c-9884-ac129a5b7b82 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:54.580551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 871/1746] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:42:54.585730 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc384bc-cf21-4b06-8e5e-d10232310850 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:54.605372 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc384bc-cf21-4b06-8e5e-d10232310850 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:54.653277 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68782440-b93e-43b4-a6c1-a9da1e94634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:54.654880 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68782440-b93e-43b4-a6c1-a9da1e94634b admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:54.655155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68782440-b93e-43b4-a6c1-a9da1e94634b admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:54.655435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68782440-b93e-43b4-a6c1-a9da1e94634b admin admin] PATH_INFO: `/v3/projects/634e623acb884359b2d579658464f081/users/059da31ef67e48858d9226f0106cb0ce/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:54.678070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f0b3-a6d1-4026-9084-4fb410450502 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:54.678406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f0b3-a6d1-4026-9084-4fb410450502 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:54.678776 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f0b3-a6d1-4026-9084-4fb410450502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:54.682198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68782440-b93e-43b4-a6c1-a9da1e94634b admin admin] RBAC: Authorizing `identity:create_grant(project_id=634e623acb884359b2d579658464f081, user_id=059da31ef67e48858d9226f0106cb0ce, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:54.684987 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68782440-b93e-43b4-a6c1-a9da1e94634b admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:54.732243 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 876/1747] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:42:54 2022] PUT /identity/v3/projects/634e623acb884359b2d579658464f081/users/059da31ef67e48858d9226f0106cb0ce/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:54.746104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00cca5-ec2a-40d1-9a22-fd60711aaf59 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:54.746445 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00cca5-ec2a-40d1-9a22-fd60711aaf59 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:54.746687 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00cca5-ec2a-40d1-9a22-fd60711aaf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:54.751940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c838f0b3-a6d1-4026-9084-4fb410450502 None None] MFA Rules not processed for user `ac1708b4ee7e43afaac75452be3b195e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:54.753178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c838f0b3-a6d1-4026-9084-4fb410450502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:54.818136 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-bb00cca5-ec2a-40d1-9a22-fd60711aaf59 None None] MFA Rules not processed for user `059da31ef67e48858d9226f0106cb0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:54.819428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-bb00cca5-ec2a-40d1-9a22-fd60711aaf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:54.917300 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 872/1748] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:42:54.933097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838f0b3-a6d1-4026-9084-4fb410450502 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:55.005771 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 877/1749] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:54 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:42:55.020213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00cca5-ec2a-40d1-9a22-fd60711aaf59 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:55.168645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00cca5-ec2a-40d1-9a22-fd60711aaf59 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:55.178071 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838f0b3-a6d1-4026-9084-4fb410450502 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:55.178300 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49044fe8-4014-4847-b3a5-e4eecda87c7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:55.178930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49044fe8-4014-4847-b3a5-e4eecda87c7e service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:55.179218 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49044fe8-4014-4847-b3a5-e4eecda87c7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:55.179497 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49044fe8-4014-4847-b3a5-e4eecda87c7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:55.197000 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a53972-e265-43c8-bce2-8be9428df82d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:55.205291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49044fe8-4014-4847-b3a5-e4eecda87c7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:55.205952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a53972-e265-43c8-bce2-8be9428df82d service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:55.206256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a53972-e265-43c8-bce2-8be9428df82d service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:55.206539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a53972-e265-43c8-bce2-8be9428df82d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:55.206903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49044fe8-4014-4847-b3a5-e4eecda87c7e service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:55.234142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a53972-e265-43c8-bce2-8be9428df82d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:55.234335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 878/1750] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:55 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:42:55.235503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49044fe8-4014-4847-b3a5-e4eecda87c7e service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:55.241468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a53972-e265-43c8-bce2-8be9428df82d service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:55.275398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 873/1751] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:55.408554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49044fe8-4014-4847-b3a5-e4eecda87c7e service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:55.424725 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae78bf-521b-4368-aa00-cded5feec11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:55.427896 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae78bf-521b-4368-aa00-cded5feec11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:55.428199 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae78bf-521b-4368-aa00-cded5feec11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:55.428477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae78bf-521b-4368-aa00-cded5feec11b admin admin] PATH_INFO: `/v3/users/6f2d13d1e20e413e926fd20bb63e6f7c` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:55.431960 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae78bf-521b-4368-aa00-cded5feec11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2d13d1e20e413e926fd20bb63e6f7c)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:55.436469 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae78bf-521b-4368-aa00-cded5feec11b admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:55.465425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a53972-e265-43c8-bce2-8be9428df82d service nova] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:55.480091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a53972-e265-43c8-bce2-8be9428df82d service nova] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:55.504523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde64773-9706-426d-bafe-8e51dcb5240b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:55.505301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde64773-9706-426d-bafe-8e51dcb5240b service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:55.505593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde64773-9706-426d-bafe-8e51dcb5240b service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:55.506018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde64773-9706-426d-bafe-8e51dcb5240b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:55.581510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-56ae78bf-521b-4368-aa00-cded5feec11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2d13d1e20e413e926fd20bb63e6f7c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:55.583693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-56ae78bf-521b-4368-aa00-cded5feec11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2d13d1e20e413e926fd20bb63e6f7c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:55.615588 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-56ae78bf-521b-4368-aa00-cded5feec11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2d13d1e20e413e926fd20bb63e6f7c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:55.623095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-56ae78bf-521b-4368-aa00-cded5feec11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2d13d1e20e413e926fd20bb63e6f7c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:55.630869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-56ae78bf-521b-4368-aa00-cded5feec11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2d13d1e20e413e926fd20bb63e6f7c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:55.656552 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 879/1752] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:42:55 2022] DELETE /identity/v3/users/6f2d13d1e20e413e926fd20bb63e6f7c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:55.657608 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7b803-ec00-48f1-91a5-98f0d8fcddd4 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:55.657903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7b803-ec00-48f1-91a5-98f0d8fcddd4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:55.658191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7b803-ec00-48f1-91a5-98f0d8fcddd4 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:55.664019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 880/1753] 10.222.0.76 () {54 vars in 921 bytes} [Thu May 12 17:42:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:42:55.665932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cbfcb-e7f5-49bb-b710-3c8cf2bebf8a None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:55.666206 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cbfcb-e7f5-49bb-b710-3c8cf2bebf8a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:55.666472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cbfcb-e7f5-49bb-b710-3c8cf2bebf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:55.703330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-087cbfcb-e7f5-49bb-b710-3c8cf2bebf8a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:55.704362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde64773-9706-426d-bafe-8e51dcb5240b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:55.704736 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-087cbfcb-e7f5-49bb-b710-3c8cf2bebf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:55.709383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde64773-9706-426d-bafe-8e51dcb5240b service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:55.732171 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 874/1754] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:55 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:42:55.733541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ee23-c9f3-4555-a68d-afdaf328652c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:55.733830 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ee23-c9f3-4555-a68d-afdaf328652c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:55.741956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ee23-c9f3-4555-a68d-afdaf328652c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:55.780157 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-46b6ee23-c9f3-4555-a68d-afdaf328652c None None] MFA Rules not processed for user `04ad234318ad47589b844351cd3bb3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:55.781422 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-46b6ee23-c9f3-4555-a68d-afdaf328652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:55.962396 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 881/1755] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:55.972558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 875/1756] 10.222.0.76 () {58 vars in 1018 bytes} [Thu May 12 17:42:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:56.019786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cbfcb-e7f5-49bb-b710-3c8cf2bebf8a None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:56.021266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-087cbfcb-e7f5-49bb-b710-3c8cf2bebf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:56.042321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6ee23-c9f3-4555-a68d-afdaf328652c None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:56.044062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-46b6ee23-c9f3-4555-a68d-afdaf328652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:56.068099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cbfcb-e7f5-49bb-b710-3c8cf2bebf8a None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:56.088736 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c995ebb-e734-4383-b1cc-d691544cd4a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:56.089431 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995ebb-e734-4383-b1cc-d691544cd4a9 service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:56.089745 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995ebb-e734-4383-b1cc-d691544cd4a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:56.090069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995ebb-e734-4383-b1cc-d691544cd4a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:56.182241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c995ebb-e734-4383-b1cc-d691544cd4a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:56.183877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c995ebb-e734-4383-b1cc-d691544cd4a9 service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:56.219595 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6ee23-c9f3-4555-a68d-afdaf328652c None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:56.228139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12eedf-f593-4d43-9d5e-a574174ff95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:56.229196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12eedf-f593-4d43-9d5e-a574174ff95b service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:56.230253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12eedf-f593-4d43-9d5e-a574174ff95b service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:56.230937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12eedf-f593-4d43-9d5e-a574174ff95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:56.243646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12eedf-f593-4d43-9d5e-a574174ff95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:56.245541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12eedf-f593-4d43-9d5e-a574174ff95b service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:56.250256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 882/1757] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:42:56.315044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 876/1758] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:42:56.904234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c779c7b-ac03-4703-87fc-86e92e7ff7e0 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:56.905258 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c779c7b-ac03-4703-87fc-86e92e7ff7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:56.905591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c779c7b-ac03-4703-87fc-86e92e7ff7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:56.939167 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-9c779c7b-ac03-4703-87fc-86e92e7ff7e0 None None] MFA Rules not processed for user `10626535b6874ef58b63d259f059cd15`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:56.942832 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9c779c7b-ac03-4703-87fc-86e92e7ff7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:57.026748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 883/1759] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:57.441116 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12eedf-f593-4d43-9d5e-a574174ff95b service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:57.442890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4e12eedf-f593-4d43-9d5e-a574174ff95b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:57.476604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12eedf-f593-4d43-9d5e-a574174ff95b service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:57.496745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d9183-69dd-4d81-bc89-e4023ec58c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:57.497648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d9183-69dd-4d81-bc89-e4023ec58c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:57.497975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d9183-69dd-4d81-bc89-e4023ec58c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:57.498255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d9183-69dd-4d81-bc89-e4023ec58c67 admin admin] PATH_INFO: `/v3/projects/177e5c059587422a8aa837870c4edfa3` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:57.514220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d9183-69dd-4d81-bc89-e4023ec58c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=177e5c059587422a8aa837870c4edfa3)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:57.516835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d9183-69dd-4d81-bc89-e4023ec58c67 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:57.642908 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3c3d9183-69dd-4d81-bc89-e4023ec58c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177e5c059587422a8aa837870c4edfa3', 'request_id': 'req-3c3d9183-69dd-4d81-bc89-e4023ec58c67'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:57.656536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3c3d9183-69dd-4d81-bc89-e4023ec58c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177e5c059587422a8aa837870c4edfa3', 'request_id': 'req-3c3d9183-69dd-4d81-bc89-e4023ec58c67'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:57.665000 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3c3d9183-69dd-4d81-bc89-e4023ec58c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177e5c059587422a8aa837870c4edfa3', 'request_id': 'req-3c3d9183-69dd-4d81-bc89-e4023ec58c67'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:57.683118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3c3d9183-69dd-4d81-bc89-e4023ec58c67 admin admin] The token cache is being invalidate because project 177e5c059587422a8aa837870c4edfa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:42:57.683249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3c3d9183-69dd-4d81-bc89-e4023ec58c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:57.684664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3c3d9183-69dd-4d81-bc89-e4023ec58c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:57.687161 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 877/1760] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:42:57 2022] DELETE /identity/v3/projects/177e5c059587422a8aa837870c4edfa3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:57.691246 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c779c7b-ac03-4703-87fc-86e92e7ff7e0 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:57.730116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c779c7b-ac03-4703-87fc-86e92e7ff7e0 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:42:57.836481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd36dd-6cff-45b7-a4c8-c81beea7edc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:42:57.838201 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd36dd-6cff-45b7-a4c8-c81beea7edc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:57.838594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd36dd-6cff-45b7-a4c8-c81beea7edc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:57.838992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd36dd-6cff-45b7-a4c8-c81beea7edc8 admin admin] PATH_INFO: `/v3/users/304b9ad83f07411282543c72b7059fda` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:57.841033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd36dd-6cff-45b7-a4c8-c81beea7edc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=304b9ad83f07411282543c72b7059fda)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:42:57.844210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd36dd-6cff-45b7-a4c8-c81beea7edc8 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:42:57.944775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-17fd36dd-6cff-45b7-a4c8-c81beea7edc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304b9ad83f07411282543c72b7059fda'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:57.945811 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-17fd36dd-6cff-45b7-a4c8-c81beea7edc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304b9ad83f07411282543c72b7059fda'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:57.959858 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-17fd36dd-6cff-45b7-a4c8-c81beea7edc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304b9ad83f07411282543c72b7059fda'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:57.960874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-17fd36dd-6cff-45b7-a4c8-c81beea7edc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304b9ad83f07411282543c72b7059fda'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:57.969825 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-17fd36dd-6cff-45b7-a4c8-c81beea7edc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304b9ad83f07411282543c72b7059fda'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:42:57.997021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 884/1761] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:42:57 2022] DELETE /identity/v3/users/304b9ad83f07411282543c72b7059fda => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:42:58.816520 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac869da0-85e9-416f-90be-c7d90976e011 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:58.817243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac869da0-85e9-416f-90be-c7d90976e011 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:58.817882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac869da0-85e9-416f-90be-c7d90976e011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:58.858375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ac869da0-85e9-416f-90be-c7d90976e011 None None] MFA Rules not processed for user `d8866c723166455a9711559eb7f125c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:58.859652 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ac869da0-85e9-416f-90be-c7d90976e011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:59.033184 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 878/1762] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:42:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:42:59.906591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6284db-b01e-43c1-a957-0e2673cb4340 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:59.907154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6284db-b01e-43c1-a957-0e2673cb4340 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:59.907258 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6284db-b01e-43c1-a957-0e2673cb4340 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:59.908679 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac869da0-85e9-416f-90be-c7d90976e011 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:42:59.911078 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ac869da0-85e9-416f-90be-c7d90976e011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:42:59.912455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 885/1763] 10.222.0.76 () {54 vars in 912 bytes} [Thu May 12 17:42:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:42:59.938836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769403e-775a-43ae-947c-6aa2bfc0dcbe None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:42:59.939320 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769403e-775a-43ae-947c-6aa2bfc0dcbe None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:42:59.939609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769403e-775a-43ae-947c-6aa2bfc0dcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:42:59.992147 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-2769403e-775a-43ae-947c-6aa2bfc0dcbe None None] MFA Rules not processed for user `731d9124a2294b95a7cf1127e5362b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:42:59.998650 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-2769403e-775a-43ae-947c-6aa2bfc0dcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:00.158250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 886/1764] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:42:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:00.192094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac869da0-85e9-416f-90be-c7d90976e011 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:00.216099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b8223-5a02-43b4-a908-2e6d8525250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:00.229705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b8223-5a02-43b4-a908-2e6d8525250e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:00.230144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b8223-5a02-43b4-a908-2e6d8525250e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:00.230437 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b8223-5a02-43b4-a908-2e6d8525250e admin admin] PATH_INFO: `/v3/projects/9facea94899244c9bffe4899721d88e7` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:00.240914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b8223-5a02-43b4-a908-2e6d8525250e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9facea94899244c9bffe4899721d88e7)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:00.246854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b8223-5a02-43b4-a908-2e6d8525250e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:00.283785 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769403e-775a-43ae-947c-6aa2bfc0dcbe None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:00.294647 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-2769403e-775a-43ae-947c-6aa2bfc0dcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:00.319737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769403e-775a-43ae-947c-6aa2bfc0dcbe None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:00.345169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29626e-c32a-4497-b475-a93141375d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:00.345840 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29626e-c32a-4497-b475-a93141375d64 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:00.346115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29626e-c32a-4497-b475-a93141375d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:00.346384 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29626e-c32a-4497-b475-a93141375d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:00.377993 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29626e-c32a-4497-b475-a93141375d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:00.394932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29626e-c32a-4497-b475-a93141375d64 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:00.417525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 887/1765] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:00.452467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a63b8223-5a02-43b4-a908-2e6d8525250e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9facea94899244c9bffe4899721d88e7', 'request_id': 'req-a63b8223-5a02-43b4-a908-2e6d8525250e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:00.467676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a63b8223-5a02-43b4-a908-2e6d8525250e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9facea94899244c9bffe4899721d88e7', 'request_id': 'req-a63b8223-5a02-43b4-a908-2e6d8525250e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:00.481392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a63b8223-5a02-43b4-a908-2e6d8525250e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9facea94899244c9bffe4899721d88e7', 'request_id': 'req-a63b8223-5a02-43b4-a908-2e6d8525250e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:00.494980 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a63b8223-5a02-43b4-a908-2e6d8525250e admin admin] The token cache is being invalidate because project 9facea94899244c9bffe4899721d88e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:00.495648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a63b8223-5a02-43b4-a908-2e6d8525250e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:00.505444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a63b8223-5a02-43b4-a908-2e6d8525250e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:00.520614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 879/1766] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:42:59 2022] DELETE /identity/v3/projects/9facea94899244c9bffe4899721d88e7 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:00.528967 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8088d-faa9-4277-9b20-7b79eb8b8478 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:00.530773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8088d-faa9-4277-9b20-7b79eb8b8478 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:00.532912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8088d-faa9-4277-9b20-7b79eb8b8478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:00.596588 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-2fb8088d-faa9-4277-9b20-7b79eb8b8478 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:00.598085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-2fb8088d-faa9-4277-9b20-7b79eb8b8478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:00.763281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 888/1767] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:00.772534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c71a-b754-4f4a-b55b-d15c2df330fc None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:00.773007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c71a-b754-4f4a-b55b-d15c2df330fc None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:00.773394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c71a-b754-4f4a-b55b-d15c2df330fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:00.816973 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-7262c71a-b754-4f4a-b55b-d15c2df330fc None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:00.819363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-7262c71a-b754-4f4a-b55b-d15c2df330fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:00.834103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 880/1768] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:00.838479 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8088d-faa9-4277-9b20-7b79eb8b8478 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:00.860136 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8088d-faa9-4277-9b20-7b79eb8b8478 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:00.885002 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a964b-ec7d-427e-8a0d-15a192fc5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:00.887256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a964b-ec7d-427e-8a0d-15a192fc5313 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:00.889256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a964b-ec7d-427e-8a0d-15a192fc5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:00.889666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a964b-ec7d-427e-8a0d-15a192fc5313 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:00.891764 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a964b-ec7d-427e-8a0d-15a192fc5313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:00.893537 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a964b-ec7d-427e-8a0d-15a192fc5313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:00.898561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a964b-ec7d-427e-8a0d-15a192fc5313 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:00.919677 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 889/1769] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:00.934254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262c71a-b754-4f4a-b55b-d15c2df330fc None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:00.966065 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262c71a-b754-4f4a-b55b-d15c2df330fc None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:00.970061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606186c-b92f-4d9f-a29b-8e6483a34290 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:00.970526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606186c-b92f-4d9f-a29b-8e6483a34290 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:00.971274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606186c-b92f-4d9f-a29b-8e6483a34290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:01.008865 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf38a5-3684-4f2b-8cfd-f6a46b265207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:01.016399 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf38a5-3684-4f2b-8cfd-f6a46b265207 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:01.017539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf38a5-3684-4f2b-8cfd-f6a46b265207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:01.017539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf38a5-3684-4f2b-8cfd-f6a46b265207 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:01.024696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf38a5-3684-4f2b-8cfd-f6a46b265207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:01.038699 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf38a5-3684-4f2b-8cfd-f6a46b265207 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:01.064484 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-d606186c-b92f-4d9f-a29b-8e6483a34290 None None] MFA Rules not processed for user `ac1708b4ee7e43afaac75452be3b195e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:01.068132 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d606186c-b92f-4d9f-a29b-8e6483a34290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:01.203021 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 881/1770] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:00 2022] POST /identity/v3/projects => generated 365 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:01.205188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf38a5-3684-4f2b-8cfd-f6a46b265207 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:01.380816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 890/1771] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:01.495054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf38a5-3684-4f2b-8cfd-f6a46b265207 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:01.510249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3076-048c-4061-8f8d-e301358e5a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:01.511756 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3076-048c-4061-8f8d-e301358e5a1a admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:01.512556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3076-048c-4061-8f8d-e301358e5a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:01.513646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a3076-048c-4061-8f8d-e301358e5a1a admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:01.516538 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a3076-048c-4061-8f8d-e301358e5a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:01.522557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a3076-048c-4061-8f8d-e301358e5a1a admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:01.578009 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 882/1772] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:01 2022] POST /identity/v3/users => generated 283 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:01.580987 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606186c-b92f-4d9f-a29b-8e6483a34290 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:01.621532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606186c-b92f-4d9f-a29b-8e6483a34290 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:01.634184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3340704-cb8b-4bea-9bad-4c8ceddcb07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:01.635108 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3340704-cb8b-4bea-9bad-4c8ceddcb07d admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:01.635552 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3340704-cb8b-4bea-9bad-4c8ceddcb07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:01.635989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3340704-cb8b-4bea-9bad-4c8ceddcb07d admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:01.636872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3340704-cb8b-4bea-9bad-4c8ceddcb07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:01.650755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3340704-cb8b-4bea-9bad-4c8ceddcb07d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:01.678990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 891/1773] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:01.683479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3076-048c-4061-8f8d-e301358e5a1a admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:01.709733 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a3076-048c-4061-8f8d-e301358e5a1a admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:01.747221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3629a74-9ef6-4746-957f-2902b067361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:01.753563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629a74-9ef6-4746-957f-2902b067361d admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:01.754960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629a74-9ef6-4746-957f-2902b067361d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:01.756468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629a74-9ef6-4746-957f-2902b067361d admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:01.761879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3629a74-9ef6-4746-957f-2902b067361d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:01.772096 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3629a74-9ef6-4746-957f-2902b067361d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:01.853083 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 883/1774] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:43:01.858288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3340704-cb8b-4bea-9bad-4c8ceddcb07d admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:01.878988 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3340704-cb8b-4bea-9bad-4c8ceddcb07d admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:01.896292 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7603a5-049f-4259-ad72-ef22ad0a29a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:01.897397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7603a5-049f-4259-ad72-ef22ad0a29a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:01.897843 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7603a5-049f-4259-ad72-ef22ad0a29a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:01.898665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7603a5-049f-4259-ad72-ef22ad0a29a7 admin admin] PATH_INFO: `/v3/projects/e4b4d93a583a4b988cbc60893cf642cd/users/c5547f0a119b4974aff79bf58859a3d7/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:01.987672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7603a5-049f-4259-ad72-ef22ad0a29a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b4d93a583a4b988cbc60893cf642cd, user_id=c5547f0a119b4974aff79bf58859a3d7, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:01.990465 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7603a5-049f-4259-ad72-ef22ad0a29a7 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:02.056022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 892/1775] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:01 2022] PUT /identity/v3/projects/e4b4d93a583a4b988cbc60893cf642cd/users/c5547f0a119b4974aff79bf58859a3d7/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:02.062218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f2972-106c-4072-a1f6-41ada0485132 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:02.063162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f2972-106c-4072-a1f6-41ada0485132 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:02.063162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f2972-106c-4072-a1f6-41ada0485132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:02.183117 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-3a5f2972-106c-4072-a1f6-41ada0485132 None None] MFA Rules not processed for user `c5547f0a119b4974aff79bf58859a3d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:02.189894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3a5f2972-106c-4072-a1f6-41ada0485132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:02.437857 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 884/1776] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:02.442929 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7603a5-049f-4259-ad72-ef22ad0a29a7 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:02.629887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7603a5-049f-4259-ad72-ef22ad0a29a7 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:02.661883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d4df3-0848-4faa-af1e-c2f10688d474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:02.666721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d4df3-0848-4faa-af1e-c2f10688d474 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:02.666721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d4df3-0848-4faa-af1e-c2f10688d474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:02.667147 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d4df3-0848-4faa-af1e-c2f10688d474 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:02.668036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d4df3-0848-4faa-af1e-c2f10688d474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:02.671057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d4df3-0848-4faa-af1e-c2f10688d474 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:02.833938 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f2972-106c-4072-a1f6-41ada0485132 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:02.856560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 893/1777] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:02 2022] POST /identity/v3/projects => generated 363 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:02.913149 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f2972-106c-4072-a1f6-41ada0485132 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:03.087244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41119e82-c3d8-48de-b61c-6398521c650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:03.089789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41119e82-c3d8-48de-b61c-6398521c650c admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:03.090230 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41119e82-c3d8-48de-b61c-6398521c650c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:03.091848 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41119e82-c3d8-48de-b61c-6398521c650c admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:03.092752 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41119e82-c3d8-48de-b61c-6398521c650c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:03.097353 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41119e82-c3d8-48de-b61c-6398521c650c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:03.170630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 885/1778] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:02 2022] POST /identity/v3/users => generated 288 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:03.175663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d4df3-0848-4faa-af1e-c2f10688d474 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:03.195615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d4df3-0848-4faa-af1e-c2f10688d474 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:03.224222 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c17ec-595f-4ef6-8022-7a9531951096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:03.225837 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c17ec-595f-4ef6-8022-7a9531951096 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:03.228340 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c17ec-595f-4ef6-8022-7a9531951096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:03.228704 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c17ec-595f-4ef6-8022-7a9531951096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:03.229511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c17ec-595f-4ef6-8022-7a9531951096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:03.231218 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c17ec-595f-4ef6-8022-7a9531951096 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:03.321694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 894/1779] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:03.322991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41119e82-c3d8-48de-b61c-6398521c650c admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:03.350907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41119e82-c3d8-48de-b61c-6398521c650c admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:03.358127 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efa174-5a7f-4928-912f-8b67761df70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:03.359477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa174-5a7f-4928-912f-8b67761df70f admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:03.359977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa174-5a7f-4928-912f-8b67761df70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:03.381976 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa174-5a7f-4928-912f-8b67761df70f admin admin] PATH_INFO: `/v3/projects/1f4458be5b4a4bd89f15605060849dfa/users/3868295ba69a48faa34282a5a9c0a2e3/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:03.458964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efa174-5a7f-4928-912f-8b67761df70f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4458be5b4a4bd89f15605060849dfa, user_id=3868295ba69a48faa34282a5a9c0a2e3, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:03.478907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efa174-5a7f-4928-912f-8b67761df70f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:03.511741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 886/1780] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:03 2022] PUT /identity/v3/projects/1f4458be5b4a4bd89f15605060849dfa/users/3868295ba69a48faa34282a5a9c0a2e3/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:03.515777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c17ec-595f-4ef6-8022-7a9531951096 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:03.530009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c17ec-595f-4ef6-8022-7a9531951096 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:03.720046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fc509-d79c-4989-b2b5-e10e274af72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:03.721413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fc509-d79c-4989-b2b5-e10e274af72e admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:03.721701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fc509-d79c-4989-b2b5-e10e274af72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:03.721983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fc509-d79c-4989-b2b5-e10e274af72e admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:03.723533 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fc509-d79c-4989-b2b5-e10e274af72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:03.727174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fc509-d79c-4989-b2b5-e10e274af72e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:03.757665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efa174-5a7f-4928-912f-8b67761df70f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:03.783372 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 895/1781] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:03.790387 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efa174-5a7f-4928-912f-8b67761df70f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:03.814918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06565e-32ed-4716-aae2-17b186b7290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:03.815823 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06565e-32ed-4716-aae2-17b186b7290e admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:03.816102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06565e-32ed-4716-aae2-17b186b7290e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:03.816692 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06565e-32ed-4716-aae2-17b186b7290e admin admin] PATH_INFO: `/v3/projects/1f4458be5b4a4bd89f15605060849dfa/users/3868295ba69a48faa34282a5a9c0a2e3/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:03.819362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06565e-32ed-4716-aae2-17b186b7290e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4458be5b4a4bd89f15605060849dfa, user_id=3868295ba69a48faa34282a5a9c0a2e3, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:03.822703 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06565e-32ed-4716-aae2-17b186b7290e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:03.853821 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 887/1782] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:03 2022] PUT /identity/v3/projects/1f4458be5b4a4bd89f15605060849dfa/users/3868295ba69a48faa34282a5a9c0a2e3/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:03.865444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e7eb0-c53a-4844-9ad7-fcd578bca0fa None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:03.865996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e7eb0-c53a-4844-9ad7-fcd578bca0fa None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:03.866425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e7eb0-c53a-4844-9ad7-fcd578bca0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:03.920091 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-4f5e7eb0-c53a-4844-9ad7-fcd578bca0fa None None] MFA Rules not processed for user `3868295ba69a48faa34282a5a9c0a2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:03.921523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4f5e7eb0-c53a-4844-9ad7-fcd578bca0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:04.064982 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 896/1783] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:03 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:04.087785 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06565e-32ed-4716-aae2-17b186b7290e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:04.089785 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ed06565e-32ed-4716-aae2-17b186b7290e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:04.181005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06565e-32ed-4716-aae2-17b186b7290e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:04.185686 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df99d0-a37a-472d-b4ee-d4826a5c5574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:04.186431 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df99d0-a37a-472d-b4ee-d4826a5c5574 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:04.186845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df99d0-a37a-472d-b4ee-d4826a5c5574 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:04.187197 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df99d0-a37a-472d-b4ee-d4826a5c5574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:04.198013 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df99d0-a37a-472d-b4ee-d4826a5c5574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:04.199408 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df99d0-a37a-472d-b4ee-d4826a5c5574 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:04.216651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 888/1784] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:04 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:04.717117 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e7eb0-c53a-4844-9ad7-fcd578bca0fa None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:04.788972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e7eb0-c53a-4844-9ad7-fcd578bca0fa None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:04.796163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f2c21-e5c5-428b-be73-4d56ceb19ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:04.797034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f2c21-e5c5-428b-be73-4d56ceb19ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:04.797316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f2c21-e5c5-428b-be73-4d56ceb19ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:04.797589 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f2c21-e5c5-428b-be73-4d56ceb19ba8 admin admin] PATH_INFO: `/v3/users/c5547f0a119b4974aff79bf58859a3d7` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:04.798844 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f2c21-e5c5-428b-be73-4d56ceb19ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5547f0a119b4974aff79bf58859a3d7)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:04.800777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f2c21-e5c5-428b-be73-4d56ceb19ba8 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:04.866518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-551f2c21-e5c5-428b-be73-4d56ceb19ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5547f0a119b4974aff79bf58859a3d7'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:04.867389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-551f2c21-e5c5-428b-be73-4d56ceb19ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5547f0a119b4974aff79bf58859a3d7'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:04.880862 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-551f2c21-e5c5-428b-be73-4d56ceb19ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5547f0a119b4974aff79bf58859a3d7'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:04.881590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-551f2c21-e5c5-428b-be73-4d56ceb19ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5547f0a119b4974aff79bf58859a3d7'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:04.895698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-551f2c21-e5c5-428b-be73-4d56ceb19ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5547f0a119b4974aff79bf58859a3d7'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:04.918736 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 897/1785] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:04 2022] DELETE /identity/v3/users/c5547f0a119b4974aff79bf58859a3d7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:04.923236 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c4af-87a8-4f08-afe6-9d198e6cc8c2 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:04.923782 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c4af-87a8-4f08-afe6-9d198e6cc8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:04.924157 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c4af-87a8-4f08-afe6-9d198e6cc8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:04.947353 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-cf95c4af-87a8-4f08-afe6-9d198e6cc8c2 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:04.948561 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-cf95c4af-87a8-4f08-afe6-9d198e6cc8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:05.027255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 889/1786] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:05.036580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f2c21-e5c5-428b-be73-4d56ceb19ba8 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:05.037954 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-551f2c21-e5c5-428b-be73-4d56ceb19ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:05.094087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f2c21-e5c5-428b-be73-4d56ceb19ba8 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:05.097597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937b435-9343-4b03-ba6f-458e71034e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:05.098227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b435-9343-4b03-ba6f-458e71034e31 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:05.098505 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b435-9343-4b03-ba6f-458e71034e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:05.098800 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b435-9343-4b03-ba6f-458e71034e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:05.108005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937b435-9343-4b03-ba6f-458e71034e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:05.109452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937b435-9343-4b03-ba6f-458e71034e31 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:05.119073 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 898/1787] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:05.425227 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95c4af-87a8-4f08-afe6-9d198e6cc8c2 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:05.426762 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-cf95c4af-87a8-4f08-afe6-9d198e6cc8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:05.441990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95c4af-87a8-4f08-afe6-9d198e6cc8c2 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:05.447520 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:05.448761 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:05.449347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:05.449836 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] PATH_INFO: `/v3/projects/e4b4d93a583a4b988cbc60893cf642cd` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:05.451488 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b4d93a583a4b988cbc60893cf642cd)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:05.453550 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:05.512926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b4d93a583a4b988cbc60893cf642cd', 'request_id': 'req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:05.520419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b4d93a583a4b988cbc60893cf642cd', 'request_id': 'req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:05.526585 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b4d93a583a4b988cbc60893cf642cd', 'request_id': 'req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:05.538622 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] The token cache is being invalidate because project e4b4d93a583a4b988cbc60893cf642cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:05.538947 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:05.540245 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:05.542584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 890/1788] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:05 2022] DELETE /identity/v3/projects/e4b4d93a583a4b988cbc60893cf642cd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:05.546585 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937b435-9343-4b03-ba6f-458e71034e31 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:05.558298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937b435-9343-4b03-ba6f-458e71034e31 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:05.621894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaea0d-a572-472e-a01e-5fcf96ea4820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:05.622861 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaea0d-a572-472e-a01e-5fcf96ea4820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:05.623140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaea0d-a572-472e-a01e-5fcf96ea4820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:05.623409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaea0d-a572-472e-a01e-5fcf96ea4820 admin admin] PATH_INFO: `/v3/users/3868295ba69a48faa34282a5a9c0a2e3` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:05.624734 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaea0d-a572-472e-a01e-5fcf96ea4820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3868295ba69a48faa34282a5a9c0a2e3)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:05.626637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaea0d-a572-472e-a01e-5fcf96ea4820 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:05.681833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6ceaea0d-a572-472e-a01e-5fcf96ea4820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3868295ba69a48faa34282a5a9c0a2e3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:05.682557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6ceaea0d-a572-472e-a01e-5fcf96ea4820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3868295ba69a48faa34282a5a9c0a2e3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:05.699359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6ceaea0d-a572-472e-a01e-5fcf96ea4820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3868295ba69a48faa34282a5a9c0a2e3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:05.700103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6ceaea0d-a572-472e-a01e-5fcf96ea4820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3868295ba69a48faa34282a5a9c0a2e3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:05.707819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6ceaea0d-a572-472e-a01e-5fcf96ea4820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3868295ba69a48faa34282a5a9c0a2e3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:05.724271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 899/1789] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:05 2022] DELETE /identity/v3/users/3868295ba69a48faa34282a5a9c0a2e3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:06.115570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:06.116974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:06.130377 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23eb17-bdb0-4f4c-8396-8af0103f8bb8 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:06.194772 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55530d7a-73a6-4ac1-bfa4-b96836c72b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:06.195629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55530d7a-73a6-4ac1-bfa4-b96836c72b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:06.195983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55530d7a-73a6-4ac1-bfa4-b96836c72b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:06.196309 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55530d7a-73a6-4ac1-bfa4-b96836c72b56 admin admin] PATH_INFO: `/v3/projects/1f4458be5b4a4bd89f15605060849dfa` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:06.197547 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55530d7a-73a6-4ac1-bfa4-b96836c72b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4458be5b4a4bd89f15605060849dfa)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:06.199469 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55530d7a-73a6-4ac1-bfa4-b96836c72b56 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:06.244373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-55530d7a-73a6-4ac1-bfa4-b96836c72b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4458be5b4a4bd89f15605060849dfa', 'request_id': 'req-55530d7a-73a6-4ac1-bfa4-b96836c72b56'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:06.251654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-55530d7a-73a6-4ac1-bfa4-b96836c72b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4458be5b4a4bd89f15605060849dfa', 'request_id': 'req-55530d7a-73a6-4ac1-bfa4-b96836c72b56'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:06.257172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-55530d7a-73a6-4ac1-bfa4-b96836c72b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4458be5b4a4bd89f15605060849dfa', 'request_id': 'req-55530d7a-73a6-4ac1-bfa4-b96836c72b56'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:06.268576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-55530d7a-73a6-4ac1-bfa4-b96836c72b56 admin admin] The token cache is being invalidate because project 1f4458be5b4a4bd89f15605060849dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:06.268856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-55530d7a-73a6-4ac1-bfa4-b96836c72b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:06.269482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-55530d7a-73a6-4ac1-bfa4-b96836c72b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:06.271062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 891/1790] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:06 2022] DELETE /identity/v3/projects/1f4458be5b4a4bd89f15605060849dfa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:06.277528 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9eaf7-f192-45fd-9406-21b01d1ce1f2 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:06.277820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9eaf7-f192-45fd-9406-21b01d1ce1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:06.278103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9eaf7-f192-45fd-9406-21b01d1ce1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:06.297199 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ded9eaf7-f192-45fd-9406-21b01d1ce1f2 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:06.298380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ded9eaf7-f192-45fd-9406-21b01d1ce1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:06.356155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 900/1791] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:06.363944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ca998-22ce-4dd7-9d28-2252b7333223 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:06.364235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ca998-22ce-4dd7-9d28-2252b7333223 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:06.364513 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ca998-22ce-4dd7-9d28-2252b7333223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:06.382511 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-2c2ca998-22ce-4dd7-9d28-2252b7333223 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:06.383965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2c2ca998-22ce-4dd7-9d28-2252b7333223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:06.392573 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 892/1792] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:06.396798 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9eaf7-f192-45fd-9406-21b01d1ce1f2 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:06.407715 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9eaf7-f192-45fd-9406-21b01d1ce1f2 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:06.412500 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bc228-b47e-476d-a9cc-0ff95581f720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:06.413231 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bc228-b47e-476d-a9cc-0ff95581f720 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:06.413681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bc228-b47e-476d-a9cc-0ff95581f720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:06.413956 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bc228-b47e-476d-a9cc-0ff95581f720 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:06.415476 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bc228-b47e-476d-a9cc-0ff95581f720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:06.416102 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bc228-b47e-476d-a9cc-0ff95581f720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:06.417722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bc228-b47e-476d-a9cc-0ff95581f720 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:06.430364 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 901/1793] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:43:06.435297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ca998-22ce-4dd7-9d28-2252b7333223 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:06.487176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ca998-22ce-4dd7-9d28-2252b7333223 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:06.506757 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1567a4-43b8-4085-b055-f90da42c335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:06.507710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1567a4-43b8-4085-b055-f90da42c335c admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:06.508151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1567a4-43b8-4085-b055-f90da42c335c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:06.509139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1567a4-43b8-4085-b055-f90da42c335c admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:06.510095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1567a4-43b8-4085-b055-f90da42c335c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:06.512272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1567a4-43b8-4085-b055-f90da42c335c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:06.552605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 893/1794] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:06 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:06.557511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bc228-b47e-476d-a9cc-0ff95581f720 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:06.578377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bc228-b47e-476d-a9cc-0ff95581f720 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:06.658429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ee149-3e97-4afd-a02b-b0effec0d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:06.660007 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ee149-3e97-4afd-a02b-b0effec0d978 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:06.661020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ee149-3e97-4afd-a02b-b0effec0d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:06.661469 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ee149-3e97-4afd-a02b-b0effec0d978 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:06.663139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ee149-3e97-4afd-a02b-b0effec0d978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:06.667383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ee149-3e97-4afd-a02b-b0effec0d978 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:06.694145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 902/1795] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:06 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:06.698514 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1567a4-43b8-4085-b055-f90da42c335c admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:06.708772 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1567a4-43b8-4085-b055-f90da42c335c admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:06.714786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f54900-a202-4086-9478-0d28223c0257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:06.715453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54900-a202-4086-9478-0d28223c0257 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:06.715727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54900-a202-4086-9478-0d28223c0257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:06.715993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54900-a202-4086-9478-0d28223c0257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:06.716708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f54900-a202-4086-9478-0d28223c0257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:06.718289 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f54900-a202-4086-9478-0d28223c0257 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:06.729160 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 894/1796] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:06.733176 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ee149-3e97-4afd-a02b-b0effec0d978 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:06.743498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ee149-3e97-4afd-a02b-b0effec0d978 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:06.747911 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dabd4-595c-4992-895b-0e65921a7517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:06.748618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dabd4-595c-4992-895b-0e65921a7517 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:06.749049 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dabd4-595c-4992-895b-0e65921a7517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:06.749230 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dabd4-595c-4992-895b-0e65921a7517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:06.749941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dabd4-595c-4992-895b-0e65921a7517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:06.751595 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dabd4-595c-4992-895b-0e65921a7517 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:06.763914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 903/1797] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:06.774259 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f54900-a202-4086-9478-0d28223c0257 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:06.785590 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f54900-a202-4086-9478-0d28223c0257 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:06.792155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153523ce-bd93-422c-8f14-6a5ff22f8858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:06.793039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153523ce-bd93-422c-8f14-6a5ff22f8858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:06.793315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153523ce-bd93-422c-8f14-6a5ff22f8858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:06.793584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153523ce-bd93-422c-8f14-6a5ff22f8858 admin admin] PATH_INFO: `/v3/projects/d1fc4ca2db2a4fae9fc81e718a0257e9/users/e0df512b6192466aabd17673741fddfa/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:06.810933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153523ce-bd93-422c-8f14-6a5ff22f8858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1fc4ca2db2a4fae9fc81e718a0257e9, user_id=e0df512b6192466aabd17673741fddfa, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:06.813667 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153523ce-bd93-422c-8f14-6a5ff22f8858 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:06.828406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 895/1798] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:06 2022] PUT /identity/v3/projects/d1fc4ca2db2a4fae9fc81e718a0257e9/users/e0df512b6192466aabd17673741fddfa/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:06.840061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c33d32-6af9-4d12-8890-971cb7f680e9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:06.840438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c33d32-6af9-4d12-8890-971cb7f680e9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:06.840722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c33d32-6af9-4d12-8890-971cb7f680e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:06.867330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-03c33d32-6af9-4d12-8890-971cb7f680e9 None None] MFA Rules not processed for user `e0df512b6192466aabd17673741fddfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:06.869107 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-03c33d32-6af9-4d12-8890-971cb7f680e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:06.940307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 904/1799] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:06.945099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153523ce-bd93-422c-8f14-6a5ff22f8858 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:07.017022 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153523ce-bd93-422c-8f14-6a5ff22f8858 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:07.022737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefa8f9-9d39-4195-b88f-8506cef53ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:07.023653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa8f9-9d39-4195-b88f-8506cef53ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:07.024723 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa8f9-9d39-4195-b88f-8506cef53ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:07.025199 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefa8f9-9d39-4195-b88f-8506cef53ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:07.026467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefa8f9-9d39-4195-b88f-8506cef53ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:07.029005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefa8f9-9d39-4195-b88f-8506cef53ba9 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:07.074217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 896/1800] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:06 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:07.077908 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c33d32-6af9-4d12-8890-971cb7f680e9 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:07.091205 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c33d32-6af9-4d12-8890-971cb7f680e9 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:07.179741 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04d32e-601a-4431-9864-e24c167b00df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:07.181305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04d32e-601a-4431-9864-e24c167b00df admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:07.181594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04d32e-601a-4431-9864-e24c167b00df admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:07.181877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04d32e-601a-4431-9864-e24c167b00df admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:07.182840 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04d32e-601a-4431-9864-e24c167b00df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:07.184984 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04d32e-601a-4431-9864-e24c167b00df admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:07.207685 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 905/1801] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:07 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:07.214778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefa8f9-9d39-4195-b88f-8506cef53ba9 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:07.225827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefa8f9-9d39-4195-b88f-8506cef53ba9 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:07.231481 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7eca3-8c70-45cb-bf31-98747606761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:07.232190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7eca3-8c70-45cb-bf31-98747606761b admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:07.232481 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7eca3-8c70-45cb-bf31-98747606761b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:07.232760 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7eca3-8c70-45cb-bf31-98747606761b admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:07.233509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7eca3-8c70-45cb-bf31-98747606761b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:07.235163 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7eca3-8c70-45cb-bf31-98747606761b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:07.251394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 897/1802] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:07.254434 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04d32e-601a-4431-9864-e24c167b00df admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:07.266425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04d32e-601a-4431-9864-e24c167b00df admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:07.271235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b710db9-fafa-4719-a8eb-63244004e96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:07.272262 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710db9-fafa-4719-a8eb-63244004e96c admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:07.272631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710db9-fafa-4719-a8eb-63244004e96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:07.272999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710db9-fafa-4719-a8eb-63244004e96c admin admin] PATH_INFO: `/v3/projects/31bb397de9444c6383cd0cdda6248a9d/users/31c4bb7ddc104bc2b6c1791b1bca3316/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:07.289755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b710db9-fafa-4719-a8eb-63244004e96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=31bb397de9444c6383cd0cdda6248a9d, user_id=31c4bb7ddc104bc2b6c1791b1bca3316, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:07.292572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b710db9-fafa-4719-a8eb-63244004e96c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:07.307978 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 906/1803] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:07 2022] PUT /identity/v3/projects/31bb397de9444c6383cd0cdda6248a9d/users/31c4bb7ddc104bc2b6c1791b1bca3316/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:07.311994 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7eca3-8c70-45cb-bf31-98747606761b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:07.323616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7eca3-8c70-45cb-bf31-98747606761b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:07.379739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49336bb5-7246-45d4-873e-95c8ec00fc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:07.380434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49336bb5-7246-45d4-873e-95c8ec00fc75 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:07.380718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49336bb5-7246-45d4-873e-95c8ec00fc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:07.380993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49336bb5-7246-45d4-873e-95c8ec00fc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:07.381713 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49336bb5-7246-45d4-873e-95c8ec00fc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:07.383885 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49336bb5-7246-45d4-873e-95c8ec00fc75 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:07.394625 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 898/1804] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:07.398250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b710db9-fafa-4719-a8eb-63244004e96c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:07.409185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b710db9-fafa-4719-a8eb-63244004e96c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:07.413858 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7bf56-ba90-4c4c-95a3-3c220586b3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:07.414891 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7bf56-ba90-4c4c-95a3-3c220586b3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:07.415239 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7bf56-ba90-4c4c-95a3-3c220586b3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:07.415576 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7bf56-ba90-4c4c-95a3-3c220586b3fa admin admin] PATH_INFO: `/v3/projects/31bb397de9444c6383cd0cdda6248a9d/users/31c4bb7ddc104bc2b6c1791b1bca3316/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:07.417695 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7bf56-ba90-4c4c-95a3-3c220586b3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=31bb397de9444c6383cd0cdda6248a9d, user_id=31c4bb7ddc104bc2b6c1791b1bca3316, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:07.420579 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7bf56-ba90-4c4c-95a3-3c220586b3fa admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:07.432422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 907/1805] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:07 2022] PUT /identity/v3/projects/31bb397de9444c6383cd0cdda6248a9d/users/31c4bb7ddc104bc2b6c1791b1bca3316/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:07.444374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3c32-cbab-4c4e-a647-f26bed5a2a25 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:07.444898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3c32-cbab-4c4e-a647-f26bed5a2a25 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:07.445092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3c32-cbab-4c4e-a647-f26bed5a2a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:07.473769 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-f58e3c32-cbab-4c4e-a647-f26bed5a2a25 None None] MFA Rules not processed for user `31c4bb7ddc104bc2b6c1791b1bca3316`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:07.475086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f58e3c32-cbab-4c4e-a647-f26bed5a2a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:07.551060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 899/1806] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:07.563736 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7bf56-ba90-4c4c-95a3-3c220586b3fa admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:07.565457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-00b7bf56-ba90-4c4c-95a3-3c220586b3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:07.635606 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7bf56-ba90-4c4c-95a3-3c220586b3fa admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:07.639280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ca165-7303-41fe-9756-2c47ccc798f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:07.639922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ca165-7303-41fe-9756-2c47ccc798f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:07.640203 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ca165-7303-41fe-9756-2c47ccc798f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:07.640477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ca165-7303-41fe-9756-2c47ccc798f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:07.649866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ca165-7303-41fe-9756-2c47ccc798f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:07.651359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ca165-7303-41fe-9756-2c47ccc798f7 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:07.660963 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 908/1807] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:07.713409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e3c32-cbab-4c4e-a647-f26bed5a2a25 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:07.715498 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f58e3c32-cbab-4c4e-a647-f26bed5a2a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:07.769151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ca165-7303-41fe-9756-2c47ccc798f7 service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:07.777818 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ca165-7303-41fe-9756-2c47ccc798f7 service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:07.781703 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4a300-4e47-4b2e-95ec-f143757974d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:07.782424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4a300-4e47-4b2e-95ec-f143757974d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:07.782798 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4a300-4e47-4b2e-95ec-f143757974d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:07.783083 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4a300-4e47-4b2e-95ec-f143757974d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:07.788641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e3c32-cbab-4c4e-a647-f26bed5a2a25 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:07.793425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826a330-1807-4d6b-83a8-c356fa79b6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:07.794285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826a330-1807-4d6b-83a8-c356fa79b6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:07.794563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826a330-1807-4d6b-83a8-c356fa79b6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:07.794865 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826a330-1807-4d6b-83a8-c356fa79b6ac admin admin] PATH_INFO: `/v3/users/2c259e0c1bd84b4b80b20aad95e91b7b` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:07.796063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826a330-1807-4d6b-83a8-c356fa79b6ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c259e0c1bd84b4b80b20aad95e91b7b)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:07.797986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826a330-1807-4d6b-83a8-c356fa79b6ac admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:07.840098 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4a300-4e47-4b2e-95ec-f143757974d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:07.841544 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4a300-4e47-4b2e-95ec-f143757974d4 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:07.843195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2826a330-1807-4d6b-83a8-c356fa79b6ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c259e0c1bd84b4b80b20aad95e91b7b'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:07.843839 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2826a330-1807-4d6b-83a8-c356fa79b6ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c259e0c1bd84b4b80b20aad95e91b7b'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:07.844437 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2826a330-1807-4d6b-83a8-c356fa79b6ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c259e0c1bd84b4b80b20aad95e91b7b'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:07.850473 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 909/1808] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:07.856225 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2826a330-1807-4d6b-83a8-c356fa79b6ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c259e0c1bd84b4b80b20aad95e91b7b'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:07.863116 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2826a330-1807-4d6b-83a8-c356fa79b6ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c259e0c1bd84b4b80b20aad95e91b7b'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:07.876483 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 900/1809] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:07 2022] DELETE /identity/v3/users/2c259e0c1bd84b4b80b20aad95e91b7b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:07.881049 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d452dfe-6dd0-4995-b5b2-8d5e0bdc35e1 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:07.881344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d452dfe-6dd0-4995-b5b2-8d5e0bdc35e1 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:07.881623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d452dfe-6dd0-4995-b5b2-8d5e0bdc35e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:07.899674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-0d452dfe-6dd0-4995-b5b2-8d5e0bdc35e1 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:07.900885 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-0d452dfe-6dd0-4995-b5b2-8d5e0bdc35e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:07.959007 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 910/1810] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:07.969834 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826a330-1807-4d6b-83a8-c356fa79b6ac admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:07.971969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2826a330-1807-4d6b-83a8-c356fa79b6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:08.119249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826a330-1807-4d6b-83a8-c356fa79b6ac admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:08.123794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b4650-d174-43d3-8fac-fc71bf2f4197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:08.124382 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b4650-d174-43d3-8fac-fc71bf2f4197 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:08.124803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b4650-d174-43d3-8fac-fc71bf2f4197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:08.125167 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b4650-d174-43d3-8fac-fc71bf2f4197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:08.136970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b4650-d174-43d3-8fac-fc71bf2f4197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:08.138576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b4650-d174-43d3-8fac-fc71bf2f4197 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:08.152456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 901/1811] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:09.512224 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d452dfe-6dd0-4995-b5b2-8d5e0bdc35e1 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:09.514244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-0d452dfe-6dd0-4995-b5b2-8d5e0bdc35e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:09.549391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d452dfe-6dd0-4995-b5b2-8d5e0bdc35e1 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:09.557152 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60729483-b287-489e-810d-b148d35f3901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:09.558454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60729483-b287-489e-810d-b148d35f3901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:09.560310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60729483-b287-489e-810d-b148d35f3901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:09.561299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60729483-b287-489e-810d-b148d35f3901 admin admin] PATH_INFO: `/v3/projects/e9ae77622e5d4b78997d4b1994d1380c` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:09.564505 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60729483-b287-489e-810d-b148d35f3901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ae77622e5d4b78997d4b1994d1380c)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:09.567368 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60729483-b287-489e-810d-b148d35f3901 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:09.647097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-60729483-b287-489e-810d-b148d35f3901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ae77622e5d4b78997d4b1994d1380c', 'request_id': 'req-60729483-b287-489e-810d-b148d35f3901'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:09.661070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-60729483-b287-489e-810d-b148d35f3901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ae77622e5d4b78997d4b1994d1380c', 'request_id': 'req-60729483-b287-489e-810d-b148d35f3901'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:09.672209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-60729483-b287-489e-810d-b148d35f3901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ae77622e5d4b78997d4b1994d1380c', 'request_id': 'req-60729483-b287-489e-810d-b148d35f3901'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:09.690719 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-60729483-b287-489e-810d-b148d35f3901 admin admin] The token cache is being invalidate because project e9ae77622e5d4b78997d4b1994d1380c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:09.691009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-60729483-b287-489e-810d-b148d35f3901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:09.692459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-60729483-b287-489e-810d-b148d35f3901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:09.700283 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b4650-d174-43d3-8fac-fc71bf2f4197 service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:09.713572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 911/1812] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:09 2022] DELETE /identity/v3/projects/e9ae77622e5d4b78997d4b1994d1380c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:09.716338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b4650-d174-43d3-8fac-fc71bf2f4197 service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:09.809977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca6bd9-c830-4234-9e26-7ca6024fea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:09.811032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca6bd9-c830-4234-9e26-7ca6024fea3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:09.811443 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca6bd9-c830-4234-9e26-7ca6024fea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:09.811902 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca6bd9-c830-4234-9e26-7ca6024fea3e admin admin] PATH_INFO: `/v3/users/a41fd195abea43238e5653e30918ae68` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:09.814158 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca6bd9-c830-4234-9e26-7ca6024fea3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41fd195abea43238e5653e30918ae68)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:09.816329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca6bd9-c830-4234-9e26-7ca6024fea3e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:09.877078 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-16ca6bd9-c830-4234-9e26-7ca6024fea3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41fd195abea43238e5653e30918ae68'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:09.879172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-16ca6bd9-c830-4234-9e26-7ca6024fea3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41fd195abea43238e5653e30918ae68'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:09.879841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-16ca6bd9-c830-4234-9e26-7ca6024fea3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41fd195abea43238e5653e30918ae68'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:09.928013 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-16ca6bd9-c830-4234-9e26-7ca6024fea3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41fd195abea43238e5653e30918ae68'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:09.938185 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-16ca6bd9-c830-4234-9e26-7ca6024fea3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41fd195abea43238e5653e30918ae68'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:09.960768 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 902/1813] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:09 2022] DELETE /identity/v3/users/a41fd195abea43238e5653e30918ae68 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:10.784924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faed5f7-58ee-43d0-8875-f38005246df4 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:10.785721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faed5f7-58ee-43d0-8875-f38005246df4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:10.785721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faed5f7-58ee-43d0-8875-f38005246df4 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:10.786315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca6bd9-c830-4234-9e26-7ca6024fea3e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:10.788141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 912/1814] 10.222.0.76 () {54 vars in 921 bytes} [Thu May 12 17:43:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:43:10.789296 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-16ca6bd9-c830-4234-9e26-7ca6024fea3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:10.831190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf31f56-b254-405b-b279-9788b8d0a7d4 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:10.831478 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf31f56-b254-405b-b279-9788b8d0a7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:10.832019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf31f56-b254-405b-b279-9788b8d0a7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:10.870530 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-bdf31f56-b254-405b-b279-9788b8d0a7d4 None None] MFA Rules not processed for user `04ad234318ad47589b844351cd3bb3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:10.874151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-bdf31f56-b254-405b-b279-9788b8d0a7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:10.899975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca6bd9-c830-4234-9e26-7ca6024fea3e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:10.907868 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b20b7-cea0-4ab6-8036-94a45dd290e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:10.908887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b20b7-cea0-4ab6-8036-94a45dd290e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:10.909172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b20b7-cea0-4ab6-8036-94a45dd290e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:10.909566 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b20b7-cea0-4ab6-8036-94a45dd290e0 admin admin] PATH_INFO: `/v3/users/e0df512b6192466aabd17673741fddfa` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:10.911298 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b20b7-cea0-4ab6-8036-94a45dd290e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0df512b6192466aabd17673741fddfa)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:10.913507 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b20b7-cea0-4ab6-8036-94a45dd290e0 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:11.013903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 913/1815] 10.222.0.76 () {58 vars in 1018 bytes} [Thu May 12 17:43:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:11.016405 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf31f56-b254-405b-b279-9788b8d0a7d4 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:11.018787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-bdf31f56-b254-405b-b279-9788b8d0a7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:11.022041 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-621b20b7-cea0-4ab6-8036-94a45dd290e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0df512b6192466aabd17673741fddfa'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:11.023012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-621b20b7-cea0-4ab6-8036-94a45dd290e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0df512b6192466aabd17673741fddfa'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:11.024660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-621b20b7-cea0-4ab6-8036-94a45dd290e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0df512b6192466aabd17673741fddfa'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:11.036471 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf31f56-b254-405b-b279-9788b8d0a7d4 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:11.051369 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299fab0-3501-4426-aa4b-9625fc708c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:11.052765 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299fab0-3501-4426-aa4b-9625fc708c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:11.053052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299fab0-3501-4426-aa4b-9625fc708c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:11.053330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299fab0-3501-4426-aa4b-9625fc708c78 admin admin] PATH_INFO: `/v3/projects/8603419ca6b54fa891a596b427d52f9f` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:11.054616 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299fab0-3501-4426-aa4b-9625fc708c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8603419ca6b54fa891a596b427d52f9f)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:11.058028 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299fab0-3501-4426-aa4b-9625fc708c78 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:11.058424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-621b20b7-cea0-4ab6-8036-94a45dd290e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0df512b6192466aabd17673741fddfa'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:11.086627 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-621b20b7-cea0-4ab6-8036-94a45dd290e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0df512b6192466aabd17673741fddfa'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:11.112389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 903/1816] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:10 2022] DELETE /identity/v3/users/e0df512b6192466aabd17673741fddfa => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:11.113854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b20b7-cea0-4ab6-8036-94a45dd290e0 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:11.115744 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-621b20b7-cea0-4ab6-8036-94a45dd290e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:11.131953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-c299fab0-3501-4426-aa4b-9625fc708c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8603419ca6b54fa891a596b427d52f9f', 'request_id': 'req-c299fab0-3501-4426-aa4b-9625fc708c78'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:11.147046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-c299fab0-3501-4426-aa4b-9625fc708c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8603419ca6b54fa891a596b427d52f9f', 'request_id': 'req-c299fab0-3501-4426-aa4b-9625fc708c78'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:11.172793 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-c299fab0-3501-4426-aa4b-9625fc708c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8603419ca6b54fa891a596b427d52f9f', 'request_id': 'req-c299fab0-3501-4426-aa4b-9625fc708c78'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:11.199502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-c299fab0-3501-4426-aa4b-9625fc708c78 admin admin] The token cache is being invalidate because project 8603419ca6b54fa891a596b427d52f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:11.199802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-c299fab0-3501-4426-aa4b-9625fc708c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:11.203021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-c299fab0-3501-4426-aa4b-9625fc708c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:11.209067 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 914/1817] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:11 2022] DELETE /identity/v3/projects/8603419ca6b54fa891a596b427d52f9f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:11.210421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1fbb5-8bf3-4b4f-9d90-372af43b3672 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:11.210775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1fbb5-8bf3-4b4f-9d90-372af43b3672 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:11.211235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1fbb5-8bf3-4b4f-9d90-372af43b3672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:11.251067 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-3bf1fbb5-8bf3-4b4f-9d90-372af43b3672 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:11.253358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3bf1fbb5-8bf3-4b4f-9d90-372af43b3672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:11.294112 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b20b7-cea0-4ab6-8036-94a45dd290e0 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:11.308523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc1235-5cc1-43fd-8a77-77a0d78bc037 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:11.309201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc1235-5cc1-43fd-8a77-77a0d78bc037 service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:11.309479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc1235-5cc1-43fd-8a77-77a0d78bc037 service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:11.309762 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc1235-5cc1-43fd-8a77-77a0d78bc037 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:11.321679 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f1bc1235-5cc1-43fd-8a77-77a0d78bc037 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:11.347756 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc1235-5cc1-43fd-8a77-77a0d78bc037 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:11.349398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc1235-5cc1-43fd-8a77-77a0d78bc037 service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:11.375138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 904/1818] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:11.378284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a9898-5b4e-43b1-828c-6038e5a4149f None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:11.378576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a9898-5b4e-43b1-828c-6038e5a4149f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:11.378883 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a9898-5b4e-43b1-828c-6038e5a4149f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:11.388924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 915/1819] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:11.412937 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1fbb5-8bf3-4b4f-9d90-372af43b3672 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:11.415194 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3bf1fbb5-8bf3-4b4f-9d90-372af43b3672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:11.427084 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-2d0a9898-5b4e-43b1-828c-6038e5a4149f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:11.428467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2d0a9898-5b4e-43b1-828c-6038e5a4149f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:11.446361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 905/1820] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:11.459288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c956-d4cc-4259-b347-2d899cfc8127 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:11.459581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c956-d4cc-4259-b347-2d899cfc8127 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:11.459867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c956-d4cc-4259-b347-2d899cfc8127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:11.503978 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-0e20c956-d4cc-4259-b347-2d899cfc8127 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:11.505228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0e20c956-d4cc-4259-b347-2d899cfc8127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:11.533079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 906/1821] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:11.535830 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20c956-d4cc-4259-b347-2d899cfc8127 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:11.553954 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1fbb5-8bf3-4b4f-9d90-372af43b3672 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:11.561515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20c956-d4cc-4259-b347-2d899cfc8127 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:11.564476 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97e022-4434-43ba-b1f2-58a2a3b8520a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:11.565800 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97e022-4434-43ba-b1f2-58a2a3b8520a service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:11.568703 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97e022-4434-43ba-b1f2-58a2a3b8520a service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:11.569815 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97e022-4434-43ba-b1f2-58a2a3b8520a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:11.573774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf37a0-f65f-4053-984a-0884e199728d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:11.576325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf37a0-f65f-4053-984a-0884e199728d admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:11.576614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf37a0-f65f-4053-984a-0884e199728d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:11.577441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf37a0-f65f-4053-984a-0884e199728d admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:11.578743 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf37a0-f65f-4053-984a-0884e199728d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:11.579063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf37a0-f65f-4053-984a-0884e199728d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:11.580694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf37a0-f65f-4053-984a-0884e199728d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:11.595225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97e022-4434-43ba-b1f2-58a2a3b8520a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:11.596919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97e022-4434-43ba-b1f2-58a2a3b8520a service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:11.615074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 907/1822] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:11.617059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf37a0-f65f-4053-984a-0884e199728d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:11.630131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 916/1823] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:11.639730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf37a0-f65f-4053-984a-0884e199728d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:11.651434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1caf98-9c44-40c9-8c26-212a6733af75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:11.653474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1caf98-9c44-40c9-8c26-212a6733af75 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:11.654399 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1caf98-9c44-40c9-8c26-212a6733af75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:11.658160 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1caf98-9c44-40c9-8c26-212a6733af75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:11.659395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1caf98-9c44-40c9-8c26-212a6733af75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:11.666121 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1caf98-9c44-40c9-8c26-212a6733af75 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:11.706874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 908/1824] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:11 2022] POST /identity/v3/projects => generated 401 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:11.712337 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97e022-4434-43ba-b1f2-58a2a3b8520a service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:11.729362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1caf98-9c44-40c9-8c26-212a6733af75 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:11.731116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97e022-4434-43ba-b1f2-58a2a3b8520a service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:11.731790 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4d1caf98-9c44-40c9-8c26-212a6733af75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:11.853488 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1caf98-9c44-40c9-8c26-212a6733af75 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:11.875338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75045539-a62f-48fd-a46d-12ad647b12ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:11.876140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75045539-a62f-48fd-a46d-12ad647b12ef admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:11.876290 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83955501-762d-4cf2-88d0-2fc46f704fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:11.876607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75045539-a62f-48fd-a46d-12ad647b12ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:11.877510 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83955501-762d-4cf2-88d0-2fc46f704fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:11.877767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75045539-a62f-48fd-a46d-12ad647b12ef admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:11.878127 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83955501-762d-4cf2-88d0-2fc46f704fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:11.878817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75045539-a62f-48fd-a46d-12ad647b12ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:11.879097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83955501-762d-4cf2-88d0-2fc46f704fb3 admin admin] PATH_INFO: `/v3/users/50a489bfc4094a22a8cdb9b85411a3e0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:11.880926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83955501-762d-4cf2-88d0-2fc46f704fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a489bfc4094a22a8cdb9b85411a3e0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:11.881051 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75045539-a62f-48fd-a46d-12ad647b12ef admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:11.883519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83955501-762d-4cf2-88d0-2fc46f704fb3 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:11.911812 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 917/1825] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:11 2022] POST /identity/v3/users => generated 301 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:11.913261 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75045539-a62f-48fd-a46d-12ad647b12ef admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:11.925104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75045539-a62f-48fd-a46d-12ad647b12ef admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:11.932066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86792a16-9da8-4510-8b38-7e9545121321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:11.933195 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792a16-9da8-4510-8b38-7e9545121321 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:11.933491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792a16-9da8-4510-8b38-7e9545121321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:11.933902 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792a16-9da8-4510-8b38-7e9545121321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:11.942401 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86792a16-9da8-4510-8b38-7e9545121321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:11.944712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86792a16-9da8-4510-8b38-7e9545121321 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:11.961399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 918/1826] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:11.964794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86792a16-9da8-4510-8b38-7e9545121321 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:11.977419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86792a16-9da8-4510-8b38-7e9545121321 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:11.981736 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-83955501-762d-4cf2-88d0-2fc46f704fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a489bfc4094a22a8cdb9b85411a3e0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:11.984892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b447daf-452e-491c-94a2-f6cd80186e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:11.986599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b447daf-452e-491c-94a2-f6cd80186e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:11.987025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b447daf-452e-491c-94a2-f6cd80186e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:11.987485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b447daf-452e-491c-94a2-f6cd80186e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:11.988678 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-83955501-762d-4cf2-88d0-2fc46f704fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a489bfc4094a22a8cdb9b85411a3e0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:11.989143 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b447daf-452e-491c-94a2-f6cd80186e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:11.989740 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-83955501-762d-4cf2-88d0-2fc46f704fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a489bfc4094a22a8cdb9b85411a3e0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:11.999710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b447daf-452e-491c-94a2-f6cd80186e52 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:12.009196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-83955501-762d-4cf2-88d0-2fc46f704fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a489bfc4094a22a8cdb9b85411a3e0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:12.019223 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-83955501-762d-4cf2-88d0-2fc46f704fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a489bfc4094a22a8cdb9b85411a3e0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:12.021103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 919/1827] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:12.025807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b447daf-452e-491c-94a2-f6cd80186e52 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:12.028594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-0b447daf-452e-491c-94a2-f6cd80186e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:12.052780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 909/1828] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:11 2022] DELETE /identity/v3/users/50a489bfc4094a22a8cdb9b85411a3e0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:12.061296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b447daf-452e-491c-94a2-f6cd80186e52 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:12.068977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141488e4-4645-48d5-a894-295c5d1fa929 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:12.069544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141488e4-4645-48d5-a894-295c5d1fa929 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:12.070178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141488e4-4645-48d5-a894-295c5d1fa929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:12.099037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-141488e4-4645-48d5-a894-295c5d1fa929 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:12.100511 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-141488e4-4645-48d5-a894-295c5d1fa929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:12.220282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c1cc9-2802-43d9-b5c7-c041d3eed738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:12.221199 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c1cc9-2802-43d9-b5c7-c041d3eed738 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:12.221509 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c1cc9-2802-43d9-b5c7-c041d3eed738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:12.221768 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c1cc9-2802-43d9-b5c7-c041d3eed738 admin admin] PATH_INFO: `/v3/projects/98ad4940f31941ceb69cf30594c021fa/users/b14dfd7e4d6b45b69592d52bde0f0d8a/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:12.252488 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 910/1829] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:12.261941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c1cc9-2802-43d9-b5c7-c041d3eed738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ad4940f31941ceb69cf30594c021fa, user_id=b14dfd7e4d6b45b69592d52bde0f0d8a, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:12.265523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c1cc9-2802-43d9-b5c7-c041d3eed738 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:12.284806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141488e4-4645-48d5-a894-295c5d1fa929 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:12.286362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-141488e4-4645-48d5-a894-295c5d1fa929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:12.286593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 920/1830] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:12 2022] PUT /identity/v3/projects/98ad4940f31941ceb69cf30594c021fa/users/b14dfd7e4d6b45b69592d52bde0f0d8a/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:12.297348 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f2fa0-2e3b-4754-b2b3-eb8c2da8ceb5 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:12.297874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f2fa0-2e3b-4754-b2b3-eb8c2da8ceb5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:12.298392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f2fa0-2e3b-4754-b2b3-eb8c2da8ceb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:12.334888 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-280f2fa0-2e3b-4754-b2b3-eb8c2da8ceb5 None None] MFA Rules not processed for user `b14dfd7e4d6b45b69592d52bde0f0d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:12.337788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-280f2fa0-2e3b-4754-b2b3-eb8c2da8ceb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:12.443482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141488e4-4645-48d5-a894-295c5d1fa929 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:12.472441 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 921/1831] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:12.477171 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f2fa0-2e3b-4754-b2b3-eb8c2da8ceb5 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:12.543815 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca1a98-0bc2-467f-a2b4-86a27157d31a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:12.545254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca1a98-0bc2-467f-a2b4-86a27157d31a service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:12.546035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca1a98-0bc2-467f-a2b4-86a27157d31a service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:12.546968 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca1a98-0bc2-467f-a2b4-86a27157d31a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:12.588983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f2fa0-2e3b-4754-b2b3-eb8c2da8ceb5 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:12.596120 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae95bd-3ec4-4c5d-bbed-06ced8aed0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:12.596826 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae95bd-3ec4-4c5d-bbed-06ced8aed0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:12.597172 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae95bd-3ec4-4c5d-bbed-06ced8aed0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:12.597668 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae95bd-3ec4-4c5d-bbed-06ced8aed0d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:12.598390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae95bd-3ec4-4c5d-bbed-06ced8aed0d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:12.600787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae95bd-3ec4-4c5d-bbed-06ced8aed0d6 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:12.638511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 922/1832] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:12 2022] POST /identity/v3/projects => generated 399 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:12.644203 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae95bd-3ec4-4c5d-bbed-06ced8aed0d6 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:12.658199 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca1a98-0bc2-467f-a2b4-86a27157d31a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:12.660162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca1a98-0bc2-467f-a2b4-86a27157d31a service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:12.675875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 911/1833] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:12.746199 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae95bd-3ec4-4c5d-bbed-06ced8aed0d6 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:12.752758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278daf8-ffdc-4e1d-a3a5-7fe689cd12c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:12.753502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278daf8-ffdc-4e1d-a3a5-7fe689cd12c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:12.755010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278daf8-ffdc-4e1d-a3a5-7fe689cd12c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:12.755010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278daf8-ffdc-4e1d-a3a5-7fe689cd12c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:12.755166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278daf8-ffdc-4e1d-a3a5-7fe689cd12c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:12.757509 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278daf8-ffdc-4e1d-a3a5-7fe689cd12c8 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:12.827069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 923/1834] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:12 2022] POST /identity/v3/users => generated 306 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:12.831791 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca1a98-0bc2-467f-a2b4-86a27157d31a service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:12.845021 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca1a98-0bc2-467f-a2b4-86a27157d31a service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:12.857532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa52b8-d9bd-4a25-8990-444f49b5bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:12.858509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa52b8-d9bd-4a25-8990-444f49b5bf59 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:12.859255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa52b8-d9bd-4a25-8990-444f49b5bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:12.860576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa52b8-d9bd-4a25-8990-444f49b5bf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:12.861824 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa52b8-d9bd-4a25-8990-444f49b5bf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:12.864249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa52b8-d9bd-4a25-8990-444f49b5bf59 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:12.891676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 912/1835] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:12.896251 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278daf8-ffdc-4e1d-a3a5-7fe689cd12c8 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:12.932785 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278daf8-ffdc-4e1d-a3a5-7fe689cd12c8 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:12.946896 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8e170-2ed6-4b5e-934c-b401e853dada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:12.948468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e170-2ed6-4b5e-934c-b401e853dada admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:12.948975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e170-2ed6-4b5e-934c-b401e853dada admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:12.949329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e170-2ed6-4b5e-934c-b401e853dada admin admin] PATH_INFO: `/v3/projects/b25373f1ddb44bea83e6069c4a2a2b7e/users/2fcd6617ab1c40a6aebda871b4643937/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:12.998331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8e170-2ed6-4b5e-934c-b401e853dada admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25373f1ddb44bea83e6069c4a2a2b7e, user_id=2fcd6617ab1c40a6aebda871b4643937, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:13.001997 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8e170-2ed6-4b5e-934c-b401e853dada admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:13.025294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 924/1836] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:12 2022] PUT /identity/v3/projects/b25373f1ddb44bea83e6069c4a2a2b7e/users/2fcd6617ab1c40a6aebda871b4643937/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:13.029538 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa52b8-d9bd-4a25-8990-444f49b5bf59 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:13.043467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa52b8-d9bd-4a25-8990-444f49b5bf59 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:13.155297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05237a9f-c32e-4bdf-bebd-a92bad7ab42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:13.155999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05237a9f-c32e-4bdf-bebd-a92bad7ab42c admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:13.156250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05237a9f-c32e-4bdf-bebd-a92bad7ab42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:13.156530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05237a9f-c32e-4bdf-bebd-a92bad7ab42c admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:13.157607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05237a9f-c32e-4bdf-bebd-a92bad7ab42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:13.159345 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05237a9f-c32e-4bdf-bebd-a92bad7ab42c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:13.176168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 913/1837] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:43:13.180524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8e170-2ed6-4b5e-934c-b401e853dada admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:13.197401 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8e170-2ed6-4b5e-934c-b401e853dada admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:13.223354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a04a17-94eb-46ab-903e-ad0e0513d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:13.224264 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a04a17-94eb-46ab-903e-ad0e0513d9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:13.224547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a04a17-94eb-46ab-903e-ad0e0513d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:13.224856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a04a17-94eb-46ab-903e-ad0e0513d9d6 admin admin] PATH_INFO: `/v3/projects/b25373f1ddb44bea83e6069c4a2a2b7e/users/2fcd6617ab1c40a6aebda871b4643937/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:13.229933 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a04a17-94eb-46ab-903e-ad0e0513d9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25373f1ddb44bea83e6069c4a2a2b7e, user_id=2fcd6617ab1c40a6aebda871b4643937, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:13.232620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a04a17-94eb-46ab-903e-ad0e0513d9d6 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:13.256746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05237a9f-c32e-4bdf-bebd-a92bad7ab42c admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:13.259052 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-05237a9f-c32e-4bdf-bebd-a92bad7ab42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:13.270246 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 925/1838] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:13 2022] PUT /identity/v3/projects/b25373f1ddb44bea83e6069c4a2a2b7e/users/2fcd6617ab1c40a6aebda871b4643937/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:13.272109 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85723b-8340-490c-8692-4b62a329f25d None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:13.272403 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85723b-8340-490c-8692-4b62a329f25d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:13.272684 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85723b-8340-490c-8692-4b62a329f25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:13.283277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05237a9f-c32e-4bdf-bebd-a92bad7ab42c admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:13.344892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-af85723b-8340-490c-8692-4b62a329f25d None None] MFA Rules not processed for user `2fcd6617ab1c40a6aebda871b4643937`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:13.346434 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-af85723b-8340-490c-8692-4b62a329f25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:13.441525 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:13.442410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:13.442705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:13.442986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] PATH_INFO: `/v3/projects/d1fc4ca2db2a4fae9fc81e718a0257e9` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:13.444901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1fc4ca2db2a4fae9fc81e718a0257e9)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:13.447903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:13.486963 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 926/1839] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:13.501685 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85723b-8340-490c-8692-4b62a329f25d None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:13.503750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-af85723b-8340-490c-8692-4b62a329f25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:13.523658 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1fc4ca2db2a4fae9fc81e718a0257e9', 'request_id': 'req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.532979 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1fc4ca2db2a4fae9fc81e718a0257e9', 'request_id': 'req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.540132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1fc4ca2db2a4fae9fc81e718a0257e9', 'request_id': 'req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.557744 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] The token cache is being invalidate because project d1fc4ca2db2a4fae9fc81e718a0257e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:13.558065 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.558886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.560984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 914/1840] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:13 2022] DELETE /identity/v3/projects/d1fc4ca2db2a4fae9fc81e718a0257e9 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:13.564447 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:13.565784 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:13.576901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85723b-8340-490c-8692-4b62a329f25d None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:13.638545 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63957f53-bb78-4b63-aa7f-f1b479de2e73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:13.639390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63957f53-bb78-4b63-aa7f-f1b479de2e73 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:13.639677 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63957f53-bb78-4b63-aa7f-f1b479de2e73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:13.639956 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63957f53-bb78-4b63-aa7f-f1b479de2e73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:13.643797 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-63957f53-bb78-4b63-aa7f-f1b479de2e73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:13.651929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5beabe-e4d7-4156-93b4-fc69c6249f7b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:13.657994 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825b1a3-d8c0-460c-8e42-213823c3c9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:13.659147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825b1a3-d8c0-460c-8e42-213823c3c9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:13.659628 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825b1a3-d8c0-460c-8e42-213823c3c9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:13.660043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825b1a3-d8c0-460c-8e42-213823c3c9a5 admin admin] PATH_INFO: `/v3/users/31c4bb7ddc104bc2b6c1791b1bca3316` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:13.661718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825b1a3-d8c0-460c-8e42-213823c3c9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c4bb7ddc104bc2b6c1791b1bca3316)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:13.664206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825b1a3-d8c0-460c-8e42-213823c3c9a5 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:13.740012 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63957f53-bb78-4b63-aa7f-f1b479de2e73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:13.740196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a825b1a3-d8c0-460c-8e42-213823c3c9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c4bb7ddc104bc2b6c1791b1bca3316'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.740284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63957f53-bb78-4b63-aa7f-f1b479de2e73 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:13.740931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a825b1a3-d8c0-460c-8e42-213823c3c9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c4bb7ddc104bc2b6c1791b1bca3316'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.742005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a825b1a3-d8c0-460c-8e42-213823c3c9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c4bb7ddc104bc2b6c1791b1bca3316'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.750276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 927/1841] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:13.751240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63957f53-bb78-4b63-aa7f-f1b479de2e73 service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:13.752953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-63957f53-bb78-4b63-aa7f-f1b479de2e73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:13.758184 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a825b1a3-d8c0-460c-8e42-213823c3c9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c4bb7ddc104bc2b6c1791b1bca3316'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.767805 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a825b1a3-d8c0-460c-8e42-213823c3c9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c4bb7ddc104bc2b6c1791b1bca3316'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.772397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63957f53-bb78-4b63-aa7f-f1b479de2e73 service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:13.782099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:13.783802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:13.790123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:13.790123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] PATH_INFO: `/v3/projects/c8a539bdf69e4849bd340749791e6e13` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:13.790123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a539bdf69e4849bd340749791e6e13)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:13.790123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:13.808899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 915/1842] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:13 2022] DELETE /identity/v3/users/31c4bb7ddc104bc2b6c1791b1bca3316 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:13.908778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c99bf-88c3-4509-bf1b-813fd060cd8a None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:13.909295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c99bf-88c3-4509-bf1b-813fd060cd8a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:13.909295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c99bf-88c3-4509-bf1b-813fd060cd8a None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:13.911112 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 916/1843] 10.222.0.76 () {54 vars in 921 bytes} [Thu May 12 17:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:43:13.913119 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a539bdf69e4849bd340749791e6e13', 'request_id': 'req-35797d94-8736-4232-b46d-ecfca7d55809'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.919420 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94021ba1-b3b2-4adf-99de-fc22f99e77c1 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:13.919705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94021ba1-b3b2-4adf-99de-fc22f99e77c1 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:13.920067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94021ba1-b3b2-4adf-99de-fc22f99e77c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:13.924953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a539bdf69e4849bd340749791e6e13', 'request_id': 'req-35797d94-8736-4232-b46d-ecfca7d55809'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.934637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a539bdf69e4849bd340749791e6e13', 'request_id': 'req-35797d94-8736-4232-b46d-ecfca7d55809'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.955037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-94021ba1-b3b2-4adf-99de-fc22f99e77c1 None None] MFA Rules not processed for user `04ad234318ad47589b844351cd3bb3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:13.956038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] The token cache is being invalidate because project c8a539bdf69e4849bd340749791e6e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:13.956213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-94021ba1-b3b2-4adf-99de-fc22f99e77c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:13.956826 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.957554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:13.959577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 928/1844] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:13 2022] DELETE /identity/v3/projects/c8a539bdf69e4849bd340749791e6e13 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:13.960310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:13.961939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:14.070511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35797d94-8736-4232-b46d-ecfca7d55809 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:14.075558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75a4f9-792b-44ce-a26d-ad26cb44c9ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:14.076449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75a4f9-792b-44ce-a26d-ad26cb44c9ad service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:14.077061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75a4f9-792b-44ce-a26d-ad26cb44c9ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:14.077497 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75a4f9-792b-44ce-a26d-ad26cb44c9ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:14.081940 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5f75a4f9-792b-44ce-a26d-ad26cb44c9ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:14.121019 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 917/1845] 10.222.0.76 () {58 vars in 1018 bytes} [Thu May 12 17:43:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:14.121912 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94021ba1-b3b2-4adf-99de-fc22f99e77c1 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:14.130169 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-94021ba1-b3b2-4adf-99de-fc22f99e77c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:14.180963 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75a4f9-792b-44ce-a26d-ad26cb44c9ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:14.183424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75a4f9-792b-44ce-a26d-ad26cb44c9ad service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:14.207228 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 929/1846] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:14.218152 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75a4f9-792b-44ce-a26d-ad26cb44c9ad service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:14.224310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5f75a4f9-792b-44ce-a26d-ad26cb44c9ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:14.260717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75a4f9-792b-44ce-a26d-ad26cb44c9ad service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:14.278426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dae403-4ca6-4b2d-aa52-330c29290fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:14.279350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dae403-4ca6-4b2d-aa52-330c29290fab service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:14.284377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dae403-4ca6-4b2d-aa52-330c29290fab service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:14.284868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dae403-4ca6-4b2d-aa52-330c29290fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:14.320178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dae403-4ca6-4b2d-aa52-330c29290fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:14.323733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dae403-4ca6-4b2d-aa52-330c29290fab service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:14.341881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94021ba1-b3b2-4adf-99de-fc22f99e77c1 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:14.363591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 930/1847] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:14.365133 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84385fa1-68f8-4805-a96f-30ea5359986a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:14.366092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84385fa1-68f8-4805-a96f-30ea5359986a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:14.369404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84385fa1-68f8-4805-a96f-30ea5359986a admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:14.369776 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84385fa1-68f8-4805-a96f-30ea5359986a admin admin] PATH_INFO: `/v3/users/693f81ff75674b8c8accc3b5f065d9a4` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:14.371926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84385fa1-68f8-4805-a96f-30ea5359986a admin admin] RBAC: Authorizing `identity:delete_user(user_id=693f81ff75674b8c8accc3b5f065d9a4)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:14.374299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84385fa1-68f8-4805-a96f-30ea5359986a admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:14.495176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-84385fa1-68f8-4805-a96f-30ea5359986a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693f81ff75674b8c8accc3b5f065d9a4'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:14.495956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-84385fa1-68f8-4805-a96f-30ea5359986a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693f81ff75674b8c8accc3b5f065d9a4'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:14.496578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-84385fa1-68f8-4805-a96f-30ea5359986a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693f81ff75674b8c8accc3b5f065d9a4'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:14.514749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-84385fa1-68f8-4805-a96f-30ea5359986a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693f81ff75674b8c8accc3b5f065d9a4'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:14.522991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-84385fa1-68f8-4805-a96f-30ea5359986a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693f81ff75674b8c8accc3b5f065d9a4'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:14.546876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 918/1848] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:14 2022] DELETE /identity/v3/users/693f81ff75674b8c8accc3b5f065d9a4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:15.004923 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dae403-4ca6-4b2d-aa52-330c29290fab service nova] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:15.006422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c4dae403-4ca6-4b2d-aa52-330c29290fab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:15.021429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dae403-4ca6-4b2d-aa52-330c29290fab service nova] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:15.093913 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ed745-e51c-43fe-a9d3-d7008fe069b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:15.094988 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ed745-e51c-43fe-a9d3-d7008fe069b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:15.095283 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ed745-e51c-43fe-a9d3-d7008fe069b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:15.095794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ed745-e51c-43fe-a9d3-d7008fe069b1 admin admin] PATH_INFO: `/v3/users/23c95b9ab0254976a2ad79fcd0dbd13f` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:15.099654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ed745-e51c-43fe-a9d3-d7008fe069b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c95b9ab0254976a2ad79fcd0dbd13f)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:15.104245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ed745-e51c-43fe-a9d3-d7008fe069b1 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:15.167446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fb4ed745-e51c-43fe-a9d3-d7008fe069b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c95b9ab0254976a2ad79fcd0dbd13f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:15.168198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fb4ed745-e51c-43fe-a9d3-d7008fe069b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c95b9ab0254976a2ad79fcd0dbd13f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:15.183416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fb4ed745-e51c-43fe-a9d3-d7008fe069b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c95b9ab0254976a2ad79fcd0dbd13f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:15.184280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fb4ed745-e51c-43fe-a9d3-d7008fe069b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c95b9ab0254976a2ad79fcd0dbd13f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:15.193547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fb4ed745-e51c-43fe-a9d3-d7008fe069b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c95b9ab0254976a2ad79fcd0dbd13f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:15.218221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 931/1849] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:15 2022] DELETE /identity/v3/users/23c95b9ab0254976a2ad79fcd0dbd13f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:15.223272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31186d-4f8b-4cf2-9c84-e45313fa8ac2 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:15.223752 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31186d-4f8b-4cf2-9c84-e45313fa8ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:15.223836 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31186d-4f8b-4cf2-9c84-e45313fa8ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:15.250287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ac31186d-4f8b-4cf2-9c84-e45313fa8ac2 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:15.252389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ac31186d-4f8b-4cf2-9c84-e45313fa8ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:15.359911 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 919/1850] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:15.370070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ed745-e51c-43fe-a9d3-d7008fe069b1 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:15.374174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-fb4ed745-e51c-43fe-a9d3-d7008fe069b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:15.456141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ed745-e51c-43fe-a9d3-d7008fe069b1 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:15.460508 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a2d30-42ba-464f-a756-bb0a7c5b4b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:15.462392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a2d30-42ba-464f-a756-bb0a7c5b4b6e service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:15.462961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a2d30-42ba-464f-a756-bb0a7c5b4b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:15.463511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a2d30-42ba-464f-a756-bb0a7c5b4b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:15.474851 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a2d30-42ba-464f-a756-bb0a7c5b4b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:15.476452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a2d30-42ba-464f-a756-bb0a7c5b4b6e service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:15.488628 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 932/1851] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:15.708612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31186d-4f8b-4cf2-9c84-e45313fa8ac2 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:15.711751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ac31186d-4f8b-4cf2-9c84-e45313fa8ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:15.729033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31186d-4f8b-4cf2-9c84-e45313fa8ac2 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:15.739483 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:15.739483 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:15.739483 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:15.739483 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] PATH_INFO: `/v3/projects/31bb397de9444c6383cd0cdda6248a9d` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:15.741301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31bb397de9444c6383cd0cdda6248a9d)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:15.743929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:15.832456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31bb397de9444c6383cd0cdda6248a9d', 'request_id': 'req-0d40d8be-f563-4fc7-8f76-ff5cdde58582'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:15.847118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31bb397de9444c6383cd0cdda6248a9d', 'request_id': 'req-0d40d8be-f563-4fc7-8f76-ff5cdde58582'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:15.855538 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31bb397de9444c6383cd0cdda6248a9d', 'request_id': 'req-0d40d8be-f563-4fc7-8f76-ff5cdde58582'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:15.869352 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] The token cache is being invalidate because project 31bb397de9444c6383cd0cdda6248a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:15.869645 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:15.870322 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:15.872774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 920/1852] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:15 2022] DELETE /identity/v3/projects/31bb397de9444c6383cd0cdda6248a9d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:15.877388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3ea50-6a48-4263-a5a4-aff801821f1c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:15.877670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3ea50-6a48-4263-a5a4-aff801821f1c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:15.878004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3ea50-6a48-4263-a5a4-aff801821f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:15.903969 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-29b3ea50-6a48-4263-a5a4-aff801821f1c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:15.905345 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-29b3ea50-6a48-4263-a5a4-aff801821f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:15.983862 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:15.985684 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:15.994832 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 933/1853] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:15.997558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3ea50-6a48-4263-a5a4-aff801821f1c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:15.999700 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-29b3ea50-6a48-4263-a5a4-aff801821f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:16.024121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3ea50-6a48-4263-a5a4-aff801821f1c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:16.030482 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5576fc-7d77-4973-a502-0199665b892e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:16.031600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5576fc-7d77-4973-a502-0199665b892e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.032224 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5576fc-7d77-4973-a502-0199665b892e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.032594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5576fc-7d77-4973-a502-0199665b892e admin admin] PATH_INFO: `/v3/projects/ecb7dcd2aa854eeda35e09d95262c8d3` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.034025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5576fc-7d77-4973-a502-0199665b892e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb7dcd2aa854eeda35e09d95262c8d3)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:16.036626 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40d8be-f563-4fc7-8f76-ff5cdde58582 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:16.037146 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5576fc-7d77-4973-a502-0199665b892e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:16.053555 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:16.054803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.054803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.055644 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] PATH_INFO: `/v3/projects/0a1cf08091af4e938452e25e57b21b36` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.057412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a1cf08091af4e938452e25e57b21b36)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:16.060684 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:16.102577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-4a5576fc-7d77-4973-a502-0199665b892e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb7dcd2aa854eeda35e09d95262c8d3', 'request_id': 'req-4a5576fc-7d77-4973-a502-0199665b892e'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.115653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-4a5576fc-7d77-4973-a502-0199665b892e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb7dcd2aa854eeda35e09d95262c8d3', 'request_id': 'req-4a5576fc-7d77-4973-a502-0199665b892e'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.124644 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-4a5576fc-7d77-4973-a502-0199665b892e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb7dcd2aa854eeda35e09d95262c8d3', 'request_id': 'req-4a5576fc-7d77-4973-a502-0199665b892e'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.126632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1cf08091af4e938452e25e57b21b36', 'request_id': 'req-61753990-57e1-4cfb-a58b-38aaf6bf41d8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.136249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1cf08091af4e938452e25e57b21b36', 'request_id': 'req-61753990-57e1-4cfb-a58b-38aaf6bf41d8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.137552 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-4a5576fc-7d77-4973-a502-0199665b892e admin admin] The token cache is being invalidate because project ecb7dcd2aa854eeda35e09d95262c8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:16.138138 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-4a5576fc-7d77-4973-a502-0199665b892e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.139054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-4a5576fc-7d77-4973-a502-0199665b892e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.141994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 934/1854] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:15 2022] DELETE /identity/v3/projects/ecb7dcd2aa854eeda35e09d95262c8d3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:16.144061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c41231-341c-4645-b5fd-de9baafddf04 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.144450 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c41231-341c-4645-b5fd-de9baafddf04 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.144906 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1cf08091af4e938452e25e57b21b36', 'request_id': 'req-61753990-57e1-4cfb-a58b-38aaf6bf41d8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.145033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c41231-341c-4645-b5fd-de9baafddf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.164949 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] The token cache is being invalidate because project 0a1cf08091af4e938452e25e57b21b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:16.165522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.166582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.172032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 921/1855] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:15 2022] DELETE /identity/v3/projects/0a1cf08091af4e938452e25e57b21b36 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:16.172032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:16.172032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:16.176694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-01c41231-341c-4645-b5fd-de9baafddf04 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:16.179252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-01c41231-341c-4645-b5fd-de9baafddf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:16.260881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61753990-57e1-4cfb-a58b-38aaf6bf41d8 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:16.267510 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468f848-f0a2-4a5f-8281-b1bfa59f511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:16.268385 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468f848-f0a2-4a5f-8281-b1bfa59f511d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.268927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468f848-f0a2-4a5f-8281-b1bfa59f511d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.269206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468f848-f0a2-4a5f-8281-b1bfa59f511d admin admin] PATH_INFO: `/v3/users/059da31ef67e48858d9226f0106cb0ce` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.270428 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468f848-f0a2-4a5f-8281-b1bfa59f511d admin admin] RBAC: Authorizing `identity:delete_user(user_id=059da31ef67e48858d9226f0106cb0ce)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:16.271545 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 935/1856] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:16.272397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468f848-f0a2-4a5f-8281-b1bfa59f511d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:16.276459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a349b-64bb-4d58-b33b-d2b31bf9320c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.276833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a349b-64bb-4d58-b33b-d2b31bf9320c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.277237 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a349b-64bb-4d58-b33b-d2b31bf9320c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.296468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-9b1a349b-64bb-4d58-b33b-d2b31bf9320c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:16.297805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9b1a349b-64bb-4d58-b33b-d2b31bf9320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:16.314312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 936/1857] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:16.315348 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a349b-64bb-4d58-b33b-d2b31bf9320c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:16.325214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a349b-64bb-4d58-b33b-d2b31bf9320c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:16.330569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948536f0-62be-4092-8737-69101b35ce28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:16.331767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948536f0-62be-4092-8737-69101b35ce28 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.332087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948536f0-62be-4092-8737-69101b35ce28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.332322 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948536f0-62be-4092-8737-69101b35ce28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.333158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948536f0-62be-4092-8737-69101b35ce28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:16.333409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948536f0-62be-4092-8737-69101b35ce28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:16.335270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948536f0-62be-4092-8737-69101b35ce28 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:16.340014 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-b468f848-f0a2-4a5f-8281-b1bfa59f511d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059da31ef67e48858d9226f0106cb0ce'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.341525 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-b468f848-f0a2-4a5f-8281-b1bfa59f511d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059da31ef67e48858d9226f0106cb0ce'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.342378 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-b468f848-f0a2-4a5f-8281-b1bfa59f511d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059da31ef67e48858d9226f0106cb0ce'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.348786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 937/1858] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:16.350326 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cd8e4-d75f-4721-b7ea-ba52d5be77c9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.350713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cd8e4-d75f-4721-b7ea-ba52d5be77c9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.351033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cd8e4-d75f-4721-b7ea-ba52d5be77c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.372555 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-b468f848-f0a2-4a5f-8281-b1bfa59f511d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059da31ef67e48858d9226f0106cb0ce'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.382596 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-3c3cd8e4-d75f-4721-b7ea-ba52d5be77c9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:16.383958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3c3cd8e4-d75f-4721-b7ea-ba52d5be77c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:16.391635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-b468f848-f0a2-4a5f-8281-b1bfa59f511d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059da31ef67e48858d9226f0106cb0ce'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:16.397238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 938/1859] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:16.397238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cd8e4-d75f-4721-b7ea-ba52d5be77c9 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:16.397238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3c3cd8e4-d75f-4721-b7ea-ba52d5be77c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:16.415501 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cd8e4-d75f-4721-b7ea-ba52d5be77c9 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:16.422163 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 922/1860] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:16 2022] DELETE /identity/v3/users/059da31ef67e48858d9226f0106cb0ce => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:16.423830 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468f848-f0a2-4a5f-8281-b1bfa59f511d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:16.444000 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf54ff-e3bd-4aa9-88e7-0e1ed7e0ce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:16.446886 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf54ff-e3bd-4aa9-88e7-0e1ed7e0ce2e admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.447285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf54ff-e3bd-4aa9-88e7-0e1ed7e0ce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.447667 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf54ff-e3bd-4aa9-88e7-0e1ed7e0ce2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.448479 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf54ff-e3bd-4aa9-88e7-0e1ed7e0ce2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:16.456688 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf54ff-e3bd-4aa9-88e7-0e1ed7e0ce2e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:16.502791 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468f848-f0a2-4a5f-8281-b1bfa59f511d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:16.511658 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a8247-914b-4d79-9b6f-43c4f31a188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:16.512827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8247-914b-4d79-9b6f-43c4f31a188b admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.513266 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8247-914b-4d79-9b6f-43c4f31a188b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.513546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8247-914b-4d79-9b6f-43c4f31a188b admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.514851 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a8247-914b-4d79-9b6f-43c4f31a188b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:16.515215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a8247-914b-4d79-9b6f-43c4f31a188b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:16.518055 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a8247-914b-4d79-9b6f-43c4f31a188b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:16.525110 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 939/1861] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:16 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:16.528713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf54ff-e3bd-4aa9-88e7-0e1ed7e0ce2e admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:16.538280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 923/1862] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:16.540025 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a8247-914b-4d79-9b6f-43c4f31a188b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:16.571738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a8247-914b-4d79-9b6f-43c4f31a188b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:16.664235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf54ff-e3bd-4aa9-88e7-0e1ed7e0ce2e admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:16.675135 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59474b-a1d6-4693-9bc7-20393461e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:16.676143 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59474b-a1d6-4693-9bc7-20393461e722 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.676568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59474b-a1d6-4693-9bc7-20393461e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.676910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59474b-a1d6-4693-9bc7-20393461e722 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.678060 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59474b-a1d6-4693-9bc7-20393461e722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:16.680811 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59474b-a1d6-4693-9bc7-20393461e722 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:16.692950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f257e92-308d-4e78-b5b5-5fbed4708701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:16.693636 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f257e92-308d-4e78-b5b5-5fbed4708701 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.693919 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f257e92-308d-4e78-b5b5-5fbed4708701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.694196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f257e92-308d-4e78-b5b5-5fbed4708701 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.694994 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f257e92-308d-4e78-b5b5-5fbed4708701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:16.697367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f257e92-308d-4e78-b5b5-5fbed4708701 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:16.712493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 940/1863] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:16 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:16.716307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59474b-a1d6-4693-9bc7-20393461e722 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:16.734594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59474b-a1d6-4693-9bc7-20393461e722 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:16.739045 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 924/1864] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:16 2022] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:16.744279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f257e92-308d-4e78-b5b5-5fbed4708701 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:16.745446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e2d93-3fc2-4dc6-bed9-8de90b542cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:16.746433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e2d93-3fc2-4dc6-bed9-8de90b542cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.746782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e2d93-3fc2-4dc6-bed9-8de90b542cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.747520 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e2d93-3fc2-4dc6-bed9-8de90b542cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.748337 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e2d93-3fc2-4dc6-bed9-8de90b542cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:16.750638 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e2d93-3fc2-4dc6-bed9-8de90b542cb9 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:16.792035 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 941/1865] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:43:16.796380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e2d93-3fc2-4dc6-bed9-8de90b542cb9 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:16.842354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e2d93-3fc2-4dc6-bed9-8de90b542cb9 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:16.897324 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f257e92-308d-4e78-b5b5-5fbed4708701 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:16.903261 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0ace5-6eae-4a56-a357-77f96fd11b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:16.903941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0ace5-6eae-4a56-a357-77f96fd11b0d admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.904225 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0ace5-6eae-4a56-a357-77f96fd11b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.904556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0ace5-6eae-4a56-a357-77f96fd11b0d admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.905374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0ace5-6eae-4a56-a357-77f96fd11b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:16.907357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0ace5-6eae-4a56-a357-77f96fd11b0d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:16.937783 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 925/1866] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:16 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:16.940823 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0ace5-6eae-4a56-a357-77f96fd11b0d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:16.963892 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0ace5-6eae-4a56-a357-77f96fd11b0d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:16.972752 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371afd9-2364-4394-91b0-01d12e9b5e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:16.973593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371afd9-2364-4394-91b0-01d12e9b5e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.973990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371afd9-2364-4394-91b0-01d12e9b5e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.974368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371afd9-2364-4394-91b0-01d12e9b5e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.975251 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371afd9-2364-4394-91b0-01d12e9b5e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:16.977712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371afd9-2364-4394-91b0-01d12e9b5e93 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:16.979432 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ad111-3cd7-4160-a98d-76211e6af7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:16.980833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ad111-3cd7-4160-a98d-76211e6af7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:16.981290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ad111-3cd7-4160-a98d-76211e6af7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:16.982160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ad111-3cd7-4160-a98d-76211e6af7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:16.983179 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ad111-3cd7-4160-a98d-76211e6af7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:16.987083 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ad111-3cd7-4160-a98d-76211e6af7d1 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:16.992839 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 926/1867] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:43:16.994203 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371afd9-2364-4394-91b0-01d12e9b5e93 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:17.006732 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371afd9-2364-4394-91b0-01d12e9b5e93 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:17.007491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 942/1868] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:17.012029 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ad111-3cd7-4160-a98d-76211e6af7d1 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:17.016786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c2649-4bc0-4530-bb67-b890187bfc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:17.017674 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c2649-4bc0-4530-bb67-b890187bfc04 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.018320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c2649-4bc0-4530-bb67-b890187bfc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.019286 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c2649-4bc0-4530-bb67-b890187bfc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.020196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c2649-4bc0-4530-bb67-b890187bfc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:17.022207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c2649-4bc0-4530-bb67-b890187bfc04 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:17.023498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ad111-3cd7-4160-a98d-76211e6af7d1 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:17.030029 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990c297-6f0c-4f56-bb66-9c37544c1dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:17.030914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990c297-6f0c-4f56-bb66-9c37544c1dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.031201 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990c297-6f0c-4f56-bb66-9c37544c1dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.031936 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990c297-6f0c-4f56-bb66-9c37544c1dcb admin admin] PATH_INFO: `/v3/projects/7f791d82ba5e48eea814b075e161e58b/users/16f385b6b4dd48148380f15e3af8b36f/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.035712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 927/1869] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:17.045719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c2649-4bc0-4530-bb67-b890187bfc04 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:17.047527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-234c2649-4bc0-4530-bb67-b890187bfc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:17.056349 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990c297-6f0c-4f56-bb66-9c37544c1dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f791d82ba5e48eea814b075e161e58b, user_id=16f385b6b4dd48148380f15e3af8b36f, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:17.060072 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990c297-6f0c-4f56-bb66-9c37544c1dcb admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:17.062351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c2649-4bc0-4530-bb67-b890187bfc04 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:17.067202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5ca3e-225b-47e4-9d92-d8df4d51990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:17.068125 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5ca3e-225b-47e4-9d92-d8df4d51990d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.068421 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5ca3e-225b-47e4-9d92-d8df4d51990d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.068606 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5ca3e-225b-47e4-9d92-d8df4d51990d admin admin] PATH_INFO: `/v3/projects/634e623acb884359b2d579658464f081` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.070035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5ca3e-225b-47e4-9d92-d8df4d51990d admin admin] RBAC: Authorizing `identity:delete_project(project_id=634e623acb884359b2d579658464f081)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:17.072316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5ca3e-225b-47e4-9d92-d8df4d51990d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:17.079216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 943/1870] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:17 2022] PUT /identity/v3/projects/7f791d82ba5e48eea814b075e161e58b/users/16f385b6b4dd48148380f15e3af8b36f/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:17.080214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990c297-6f0c-4f56-bb66-9c37544c1dcb admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:17.123433 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-73e5ca3e-225b-47e4-9d92-d8df4d51990d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634e623acb884359b2d579658464f081', 'request_id': 'req-73e5ca3e-225b-47e4-9d92-d8df4d51990d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:17.132230 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-73e5ca3e-225b-47e4-9d92-d8df4d51990d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634e623acb884359b2d579658464f081', 'request_id': 'req-73e5ca3e-225b-47e4-9d92-d8df4d51990d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:17.137962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-73e5ca3e-225b-47e4-9d92-d8df4d51990d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634e623acb884359b2d579658464f081', 'request_id': 'req-73e5ca3e-225b-47e4-9d92-d8df4d51990d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:17.149563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-73e5ca3e-225b-47e4-9d92-d8df4d51990d admin admin] The token cache is being invalidate because project 634e623acb884359b2d579658464f081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:17.149947 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-73e5ca3e-225b-47e4-9d92-d8df4d51990d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:17.150822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-73e5ca3e-225b-47e4-9d92-d8df4d51990d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:17.152393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 928/1871] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:17 2022] DELETE /identity/v3/projects/634e623acb884359b2d579658464f081 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:17.153652 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1883-1b43-4ea6-bf26-1c166b333b33 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.153796 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990c297-6f0c-4f56-bb66-9c37544c1dcb admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:17.153978 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1883-1b43-4ea6-bf26-1c166b333b33 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.154235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c1883-1b43-4ea6-bf26-1c166b333b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.181725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-5f1c1883-1b43-4ea6-bf26-1c166b333b33 None None] MFA Rules not processed for user `16f385b6b4dd48148380f15e3af8b36f`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:17.182993 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-5f1c1883-1b43-4ea6-bf26-1c166b333b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:17.216762 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6db689-ba6b-4447-bc15-082902f6389a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:17.217645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6db689-ba6b-4447-bc15-082902f6389a admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.217915 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6db689-ba6b-4447-bc15-082902f6389a admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.218190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6db689-ba6b-4447-bc15-082902f6389a admin admin] PATH_INFO: `/v3/projects/65780f9d1dbe4d26bcc0a36daa18c732/users/b3422d742fdb4e84b82cf9ccb3cd596f/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.233371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6db689-ba6b-4447-bc15-082902f6389a admin admin] RBAC: Authorizing `identity:create_grant(project_id=65780f9d1dbe4d26bcc0a36daa18c732, user_id=b3422d742fdb4e84b82cf9ccb3cd596f, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:17.236857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6db689-ba6b-4447-bc15-082902f6389a admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:17.264212 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 944/1872] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:17 2022] PUT /identity/v3/projects/65780f9d1dbe4d26bcc0a36daa18c732/users/b3422d742fdb4e84b82cf9ccb3cd596f/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:17.270571 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4eeb0-2f6c-4c80-bec5-ccbb8e9105bf None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.270960 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4eeb0-2f6c-4c80-bec5-ccbb8e9105bf None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.271293 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4eeb0-2f6c-4c80-bec5-ccbb8e9105bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.289095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 929/1873] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:17.292753 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7dd53-5e04-40d2-89c5-afe6d6c59f12 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.293048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7dd53-5e04-40d2-89c5-afe6d6c59f12 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.293688 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7dd53-5e04-40d2-89c5-afe6d6c59f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.304766 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-c5a4eeb0-2f6c-4c80-bec5-ccbb8e9105bf None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:17.309778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c5a4eeb0-2f6c-4c80-bec5-ccbb8e9105bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:17.368094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-6ea7dd53-5e04-40d2-89c5-afe6d6c59f12 None None] MFA Rules not processed for user `b3422d742fdb4e84b82cf9ccb3cd596f`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:17.370546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-6ea7dd53-5e04-40d2-89c5-afe6d6c59f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:17.414655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 945/1874] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:17.416157 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4eeb0-2f6c-4c80-bec5-ccbb8e9105bf None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:17.417872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c5a4eeb0-2f6c-4c80-bec5-ccbb8e9105bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:17.434630 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4eeb0-2f6c-4c80-bec5-ccbb8e9105bf None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:17.440811 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e2cef-078c-48ec-8301-2f4af680b1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:17.441753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e2cef-078c-48ec-8301-2f4af680b1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.442935 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e2cef-078c-48ec-8301-2f4af680b1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.443443 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e2cef-078c-48ec-8301-2f4af680b1b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.445173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e2cef-078c-48ec-8301-2f4af680b1b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:17.451028 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e2cef-078c-48ec-8301-2f4af680b1b6 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:17.457934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 930/1875] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:17.459394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d8548-4b39-40eb-ba1c-55035b9dc418 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.459728 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d8548-4b39-40eb-ba1c-55035b9dc418 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.459954 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d8548-4b39-40eb-ba1c-55035b9dc418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.479173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-cf7d8548-4b39-40eb-ba1c-55035b9dc418 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:17.480515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-cf7d8548-4b39-40eb-ba1c-55035b9dc418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:17.488754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 946/1876] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:17 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:17.489571 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e2cef-078c-48ec-8301-2f4af680b1b6 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:17.495481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9c1e2cef-078c-48ec-8301-2f4af680b1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:17.498015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 931/1877] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:17.501791 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d8548-4b39-40eb-ba1c-55035b9dc418 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:17.512683 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d8548-4b39-40eb-ba1c-55035b9dc418 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:17.585030 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425741a-5247-49ea-ae29-35346d3f4c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:17.585789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425741a-5247-49ea-ae29-35346d3f4c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.585942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e2cef-078c-48ec-8301-2f4af680b1b6 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:17.586273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425741a-5247-49ea-ae29-35346d3f4c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.586826 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425741a-5247-49ea-ae29-35346d3f4c40 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.587750 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425741a-5247-49ea-ae29-35346d3f4c40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:17.589692 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425741a-5247-49ea-ae29-35346d3f4c40 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:17.591287 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec8ba3-b7ad-4904-80e2-859a97a049cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:17.592520 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec8ba3-b7ad-4904-80e2-859a97a049cd admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.593068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec8ba3-b7ad-4904-80e2-859a97a049cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.593348 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec8ba3-b7ad-4904-80e2-859a97a049cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.594251 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec8ba3-b7ad-4904-80e2-859a97a049cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:17.596354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec8ba3-b7ad-4904-80e2-859a97a049cd admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:17.619143 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 932/1878] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:17 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:17.622977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425741a-5247-49ea-ae29-35346d3f4c40 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:17.638596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425741a-5247-49ea-ae29-35346d3f4c40 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:17.642788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 947/1879] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:17 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:17.642947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec8ba3-b7ad-4904-80e2-859a97a049cd admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:17.644881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0211ce-16a4-45c7-be3a-7c9669d67a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:17.647490 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0211ce-16a4-45c7-be3a-7c9669d67a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.647870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0211ce-16a4-45c7-be3a-7c9669d67a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.648147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0211ce-16a4-45c7-be3a-7c9669d67a96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.648985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0211ce-16a4-45c7-be3a-7c9669d67a96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:17.649564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0211ce-16a4-45c7-be3a-7c9669d67a96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:17.651906 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0211ce-16a4-45c7-be3a-7c9669d67a96 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:17.669243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 933/1880] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:17.670160 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0211ce-16a4-45c7-be3a-7c9669d67a96 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:17.682955 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0211ce-16a4-45c7-be3a-7c9669d67a96 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:17.763324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec8ba3-b7ad-4904-80e2-859a97a049cd admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:17.776896 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b844625-e3dd-4456-9c53-56869dc97659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:17.777685 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b844625-e3dd-4456-9c53-56869dc97659 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.778048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b844625-e3dd-4456-9c53-56869dc97659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.778397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b844625-e3dd-4456-9c53-56869dc97659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.779287 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b844625-e3dd-4456-9c53-56869dc97659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:17.783219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b844625-e3dd-4456-9c53-56869dc97659 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:17.803578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee10f68-509f-4275-bd4c-735052b751ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:17.804395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee10f68-509f-4275-bd4c-735052b751ef admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.804706 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee10f68-509f-4275-bd4c-735052b751ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.805637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee10f68-509f-4275-bd4c-735052b751ef admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.806419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee10f68-509f-4275-bd4c-735052b751ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:17.809660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee10f68-509f-4275-bd4c-735052b751ef admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:17.820381 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 948/1881] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:17.820381 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b844625-e3dd-4456-9c53-56869dc97659 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:17.838465 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b844625-e3dd-4456-9c53-56869dc97659 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:17.842170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 934/1882] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:17 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:17.842529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee10f68-509f-4275-bd4c-735052b751ef admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:17.850980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51451cf1-73ca-4103-b418-dce6320b3d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:17.853102 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51451cf1-73ca-4103-b418-dce6320b3d56 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.853429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee10f68-509f-4275-bd4c-735052b751ef admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:17.853833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51451cf1-73ca-4103-b418-dce6320b3d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.854330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51451cf1-73ca-4103-b418-dce6320b3d56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.855388 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51451cf1-73ca-4103-b418-dce6320b3d56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:17.857742 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51451cf1-73ca-4103-b418-dce6320b3d56 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:17.858258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49861f4d-f7bd-4f31-8bed-82e6a5b5a725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:17.859233 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49861f4d-f7bd-4f31-8bed-82e6a5b5a725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:17.859462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49861f4d-f7bd-4f31-8bed-82e6a5b5a725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:17.859741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49861f4d-f7bd-4f31-8bed-82e6a5b5a725 admin admin] PATH_INFO: `/v3/projects/e3aa5c719e454e0dac5c44cec48e925e/users/2ee1a192b3ed485d9a80770827a7879e/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:17.882479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49861f4d-f7bd-4f31-8bed-82e6a5b5a725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3aa5c719e454e0dac5c44cec48e925e, user_id=2ee1a192b3ed485d9a80770827a7879e, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:17.886652 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49861f4d-f7bd-4f31-8bed-82e6a5b5a725 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:17.896212 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 949/1883] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:17 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:17.902215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51451cf1-73ca-4103-b418-dce6320b3d56 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:17.907118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 935/1884] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:17 2022] PUT /identity/v3/projects/e3aa5c719e454e0dac5c44cec48e925e/users/2ee1a192b3ed485d9a80770827a7879e/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:17.907118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49861f4d-f7bd-4f31-8bed-82e6a5b5a725 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:17.986051 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51451cf1-73ca-4103-b418-dce6320b3d56 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:18.006087 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49861f4d-f7bd-4f31-8bed-82e6a5b5a725 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:18.012316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeba6a7-326d-4c0c-b38c-3190c78baf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:18.012990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeba6a7-326d-4c0c-b38c-3190c78baf34 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.013273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeba6a7-326d-4c0c-b38c-3190c78baf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.013551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeba6a7-326d-4c0c-b38c-3190c78baf34 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.014529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeba6a7-326d-4c0c-b38c-3190c78baf34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:18.016777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeba6a7-326d-4c0c-b38c-3190c78baf34 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:18.038817 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 936/1885] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:17 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:18.040350 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeba6a7-326d-4c0c-b38c-3190c78baf34 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:18.051511 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeba6a7-326d-4c0c-b38c-3190c78baf34 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:18.054804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909d09a-29f6-4e97-86ff-06b6e9fee453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:18.056342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d09a-29f6-4e97-86ff-06b6e9fee453 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.056624 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d09a-29f6-4e97-86ff-06b6e9fee453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.056810 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b549f-268a-4f8c-a90c-71b281252fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:18.056938 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d09a-29f6-4e97-86ff-06b6e9fee453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.057496 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b549f-268a-4f8c-a90c-71b281252fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.057787 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b549f-268a-4f8c-a90c-71b281252fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.058129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909d09a-29f6-4e97-86ff-06b6e9fee453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:18.058429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b549f-268a-4f8c-a90c-71b281252fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.059211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b549f-268a-4f8c-a90c-71b281252fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:18.059839 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909d09a-29f6-4e97-86ff-06b6e9fee453 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:18.060835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b549f-268a-4f8c-a90c-71b281252fe1 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:18.073991 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 950/1886] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:18.073991 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909d09a-29f6-4e97-86ff-06b6e9fee453 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:18.074255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 937/1887] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:18.075633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b549f-268a-4f8c-a90c-71b281252fe1 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:18.084672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909d09a-29f6-4e97-86ff-06b6e9fee453 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:18.085820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b549f-268a-4f8c-a90c-71b281252fe1 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:18.090602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5584eb-7315-4b60-bb20-d2b49e45ac8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:18.090916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5584eb-7315-4b60-bb20-d2b49e45ac8c admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.091123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38128a-5ece-4192-adcf-ff98e5e923d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:18.091386 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5584eb-7315-4b60-bb20-d2b49e45ac8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.091659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5584eb-7315-4b60-bb20-d2b49e45ac8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.092002 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38128a-5ece-4192-adcf-ff98e5e923d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.092289 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38128a-5ece-4192-adcf-ff98e5e923d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.092560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38128a-5ece-4192-adcf-ff98e5e923d0 admin admin] PATH_INFO: `/v3/projects/4301aad219e74174a52a94569ecd3e2b/users/53c58b3282f74da6a02720a47f63535a/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.092670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5584eb-7315-4b60-bb20-d2b49e45ac8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:18.094442 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5584eb-7315-4b60-bb20-d2b49e45ac8c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:18.106268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 951/1888] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:18.108078 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38128a-5ece-4192-adcf-ff98e5e923d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4301aad219e74174a52a94569ecd3e2b, user_id=53c58b3282f74da6a02720a47f63535a, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:18.110972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38128a-5ece-4192-adcf-ff98e5e923d0 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:18.111403 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5584eb-7315-4b60-bb20-d2b49e45ac8c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:18.125778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5584eb-7315-4b60-bb20-d2b49e45ac8c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:18.133010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 938/1889] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:18 2022] PUT /identity/v3/projects/4301aad219e74174a52a94569ecd3e2b/users/53c58b3282f74da6a02720a47f63535a/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:18.133010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38128a-5ece-4192-adcf-ff98e5e923d0 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:18.201337 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38128a-5ece-4192-adcf-ff98e5e923d0 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:18.207885 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253dff-8260-4651-bbae-910ccf6941b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:18.208672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253dff-8260-4651-bbae-910ccf6941b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.208837 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253dff-8260-4651-bbae-910ccf6941b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.209099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253dff-8260-4651-bbae-910ccf6941b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.209833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0253dff-8260-4651-bbae-910ccf6941b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:18.212335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0253dff-8260-4651-bbae-910ccf6941b9 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:18.216861 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cff7b-da30-4bbc-9434-3f63be624931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:18.217929 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cff7b-da30-4bbc-9434-3f63be624931 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.218279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cff7b-da30-4bbc-9434-3f63be624931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.218633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cff7b-da30-4bbc-9434-3f63be624931 admin admin] PATH_INFO: `/v3/projects/e3aa5c719e454e0dac5c44cec48e925e/users/2ee1a192b3ed485d9a80770827a7879e/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.221055 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cff7b-da30-4bbc-9434-3f63be624931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3aa5c719e454e0dac5c44cec48e925e, user_id=2ee1a192b3ed485d9a80770827a7879e, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:18.223944 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cff7b-da30-4bbc-9434-3f63be624931 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:18.229537 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 939/1890] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:18.231218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253dff-8260-4651-bbae-910ccf6941b9 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:18.242775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 952/1891] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:18 2022] PUT /identity/v3/projects/e3aa5c719e454e0dac5c44cec48e925e/users/2ee1a192b3ed485d9a80770827a7879e/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:18.244003 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cff7b-da30-4bbc-9434-3f63be624931 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:18.244131 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253dff-8260-4651-bbae-910ccf6941b9 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:18.314218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77502742-0ad5-4fef-a0bd-ac935d2a8056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:18.314970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77502742-0ad5-4fef-a0bd-ac935d2a8056 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.315209 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77502742-0ad5-4fef-a0bd-ac935d2a8056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.315578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77502742-0ad5-4fef-a0bd-ac935d2a8056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.316374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77502742-0ad5-4fef-a0bd-ac935d2a8056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:18.317982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77502742-0ad5-4fef-a0bd-ac935d2a8056 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:18.328563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 940/1892] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:18.329969 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cff7b-da30-4bbc-9434-3f63be624931 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:18.333057 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6254cd9-5347-425a-bf77-9bd951b03547 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.333373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6254cd9-5347-425a-bf77-9bd951b03547 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.333653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6254cd9-5347-425a-bf77-9bd951b03547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.337102 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbfb7e-86db-4d98-abd5-a3e3a7fc49d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:18.338127 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbfb7e-86db-4d98-abd5-a3e3a7fc49d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.338462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbfb7e-86db-4d98-abd5-a3e3a7fc49d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.338790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbfb7e-86db-4d98-abd5-a3e3a7fc49d3 admin admin] PATH_INFO: `/v3/projects/c0b0e7301b144261bf1873a38a50a808/users/2ef39b7432aa4f83abafab54f6a46a5a/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.357021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbfb7e-86db-4d98-abd5-a3e3a7fc49d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b0e7301b144261bf1873a38a50a808, user_id=2ef39b7432aa4f83abafab54f6a46a5a, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:18.359953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbfb7e-86db-4d98-abd5-a3e3a7fc49d3 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:18.364737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-f6254cd9-5347-425a-bf77-9bd951b03547 None None] MFA Rules not processed for user `2ee1a192b3ed485d9a80770827a7879e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:18.366295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f6254cd9-5347-425a-bf77-9bd951b03547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:18.375015 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 953/1893] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:18 2022] PUT /identity/v3/projects/c0b0e7301b144261bf1873a38a50a808/users/2ef39b7432aa4f83abafab54f6a46a5a/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:18.376003 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbfb7e-86db-4d98-abd5-a3e3a7fc49d3 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:18.463362 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbfb7e-86db-4d98-abd5-a3e3a7fc49d3 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:18.474665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f07c85-f89e-496a-84de-4ad113e1135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:18.478254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f07c85-f89e-496a-84de-4ad113e1135f admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.478550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f07c85-f89e-496a-84de-4ad113e1135f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.478898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f07c85-f89e-496a-84de-4ad113e1135f admin admin] PATH_INFO: `/v3/projects/4301aad219e74174a52a94569ecd3e2b/users/53c58b3282f74da6a02720a47f63535a/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.486709 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f07c85-f89e-496a-84de-4ad113e1135f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4301aad219e74174a52a94569ecd3e2b, user_id=53c58b3282f74da6a02720a47f63535a, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:18.488843 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f07c85-f89e-496a-84de-4ad113e1135f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:18.507310 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 941/1894] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:18.509050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b50d2d-9c07-4d0a-8c9a-192da5b883bd None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.509381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b50d2d-9c07-4d0a-8c9a-192da5b883bd None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.509651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b50d2d-9c07-4d0a-8c9a-192da5b883bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.522382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 954/1895] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:18 2022] PUT /identity/v3/projects/4301aad219e74174a52a94569ecd3e2b/users/53c58b3282f74da6a02720a47f63535a/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:18.532243 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f07c85-f89e-496a-84de-4ad113e1135f admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:18.534108 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-99f07c85-f89e-496a-84de-4ad113e1135f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:18.561783 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-33b50d2d-9c07-4d0a-8c9a-192da5b883bd None None] MFA Rules not processed for user `2ef39b7432aa4f83abafab54f6a46a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:18.565332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-33b50d2d-9c07-4d0a-8c9a-192da5b883bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:18.654822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f07c85-f89e-496a-84de-4ad113e1135f admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:18.660451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1321a-64b6-4a6d-a272-94dd1704756e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:18.661107 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1321a-64b6-4a6d-a272-94dd1704756e service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.661383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1321a-64b6-4a6d-a272-94dd1704756e service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.661654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1321a-64b6-4a6d-a272-94dd1704756e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.690353 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 942/1896] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:18.692081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac2cd-e8bb-48dd-b3c0-609baa59414b None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.697301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac2cd-e8bb-48dd-b3c0-609baa59414b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.697897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac2cd-e8bb-48dd-b3c0-609baa59414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.750758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1321a-64b6-4a6d-a272-94dd1704756e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:18.753314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1321a-64b6-4a6d-a272-94dd1704756e service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:18.756319 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-64aac2cd-e8bb-48dd-b3c0-609baa59414b None None] MFA Rules not processed for user `53c58b3282f74da6a02720a47f63535a`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:18.761343 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-64aac2cd-e8bb-48dd-b3c0-609baa59414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:18.771833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 955/1897] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:18.772674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1321a-64b6-4a6d-a272-94dd1704756e service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:18.874416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1321a-64b6-4a6d-a272-94dd1704756e service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:18.879882 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d59b9f-7c0b-4073-9a32-0dcbf92e5a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:18.880612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d59b9f-7c0b-4073-9a32-0dcbf92e5a16 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.880914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d59b9f-7c0b-4073-9a32-0dcbf92e5a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.881203 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d59b9f-7c0b-4073-9a32-0dcbf92e5a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.881979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d59b9f-7c0b-4073-9a32-0dcbf92e5a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:18.884728 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d59b9f-7c0b-4073-9a32-0dcbf92e5a16 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:18.902591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 943/1898] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:18.918722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 956/1899] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:18 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:18.920789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aac2cd-e8bb-48dd-b3c0-609baa59414b None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:18.923670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d59b9f-7c0b-4073-9a32-0dcbf92e5a16 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:18.932719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aac2cd-e8bb-48dd-b3c0-609baa59414b None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:18.997367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69667cff-e686-4cdc-943b-16299803b595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:18.998045 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667cff-e686-4cdc-943b-16299803b595 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:18.998353 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667cff-e686-4cdc-943b-16299803b595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:18.998585 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667cff-e686-4cdc-943b-16299803b595 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:18.999424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69667cff-e686-4cdc-943b-16299803b595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:19.001224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69667cff-e686-4cdc-943b-16299803b595 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:19.003489 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d59b9f-7c0b-4073-9a32-0dcbf92e5a16 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:19.021348 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dd1ce-a51b-42ae-b5cb-5915e1125b42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:19.024226 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dd1ce-a51b-42ae-b5cb-5915e1125b42 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:19.024555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dd1ce-a51b-42ae-b5cb-5915e1125b42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:19.026441 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dd1ce-a51b-42ae-b5cb-5915e1125b42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:19.029926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 944/1900] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:18 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:19.030901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69667cff-e686-4cdc-943b-16299803b595 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:19.032981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-69667cff-e686-4cdc-943b-16299803b595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:19.047498 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69667cff-e686-4cdc-943b-16299803b595 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:19.051166 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971875a-d99f-4a8f-be13-772c9dab9381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:19.052290 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971875a-d99f-4a8f-be13-772c9dab9381 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:19.052290 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971875a-d99f-4a8f-be13-772c9dab9381 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:19.052544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971875a-d99f-4a8f-be13-772c9dab9381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:19.101250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0dd1ce-a51b-42ae-b5cb-5915e1125b42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:19.103024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0dd1ce-a51b-42ae-b5cb-5915e1125b42 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:19.114747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 957/1901] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:19.115679 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dd1ce-a51b-42ae-b5cb-5915e1125b42 service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:19.127539 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dd1ce-a51b-42ae-b5cb-5915e1125b42 service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:19.136710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712be1dc-94df-4fb8-8d7e-e6569558165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:19.137490 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712be1dc-94df-4fb8-8d7e-e6569558165b admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:19.137775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712be1dc-94df-4fb8-8d7e-e6569558165b admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:19.138049 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712be1dc-94df-4fb8-8d7e-e6569558165b admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:19.138824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712be1dc-94df-4fb8-8d7e-e6569558165b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:19.140490 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712be1dc-94df-4fb8-8d7e-e6569558165b admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:19.140780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971875a-d99f-4a8f-be13-772c9dab9381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:19.142725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971875a-d99f-4a8f-be13-772c9dab9381 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:19.151987 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 958/1902] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:19.154448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 945/1903] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:19.159781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712be1dc-94df-4fb8-8d7e-e6569558165b admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:19.171294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712be1dc-94df-4fb8-8d7e-e6569558165b admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:19.176296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972b38a-3465-4ec3-91dd-715a7c2c283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:19.177481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972b38a-3465-4ec3-91dd-715a7c2c283f admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:19.177770 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972b38a-3465-4ec3-91dd-715a7c2c283f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:19.178050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972b38a-3465-4ec3-91dd-715a7c2c283f admin admin] PATH_INFO: `/v3/projects/ecb7df7589a64b70848766d10a1ab6da/users/2eda36494dd945f6a21eaff8a4c6e5df/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:19.184933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971875a-d99f-4a8f-be13-772c9dab9381 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:19.186331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9971875a-d99f-4a8f-be13-772c9dab9381 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:19.198805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972b38a-3465-4ec3-91dd-715a7c2c283f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb7df7589a64b70848766d10a1ab6da, user_id=2eda36494dd945f6a21eaff8a4c6e5df, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:19.201820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972b38a-3465-4ec3-91dd-715a7c2c283f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:19.204644 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971875a-d99f-4a8f-be13-772c9dab9381 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:19.212743 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4735e8-ed2e-43ef-b510-909df148a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:19.213701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4735e8-ed2e-43ef-b510-909df148a862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:19.213976 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4735e8-ed2e-43ef-b510-909df148a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:19.214249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4735e8-ed2e-43ef-b510-909df148a862 admin admin] PATH_INFO: `/v3/users/b14dfd7e4d6b45b69592d52bde0f0d8a` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:19.215607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4735e8-ed2e-43ef-b510-909df148a862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14dfd7e4d6b45b69592d52bde0f0d8a)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:19.217520 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4735e8-ed2e-43ef-b510-909df148a862 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:19.220696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 959/1904] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:19 2022] PUT /identity/v3/projects/ecb7df7589a64b70848766d10a1ab6da/users/2eda36494dd945f6a21eaff8a4c6e5df/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:19.224443 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972b38a-3465-4ec3-91dd-715a7c2c283f admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:19.296918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ad4735e8-ed2e-43ef-b510-909df148a862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14dfd7e4d6b45b69592d52bde0f0d8a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:19.299594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ad4735e8-ed2e-43ef-b510-909df148a862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14dfd7e4d6b45b69592d52bde0f0d8a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:19.311818 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ad4735e8-ed2e-43ef-b510-909df148a862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14dfd7e4d6b45b69592d52bde0f0d8a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:19.351375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972b38a-3465-4ec3-91dd-715a7c2c283f admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:19.356980 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ad4735e8-ed2e-43ef-b510-909df148a862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14dfd7e4d6b45b69592d52bde0f0d8a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:19.363671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811e326-09d9-4fcf-ad42-d5491849daa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:19.366270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811e326-09d9-4fcf-ad42-d5491849daa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:19.369913 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811e326-09d9-4fcf-ad42-d5491849daa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:19.370347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811e326-09d9-4fcf-ad42-d5491849daa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:19.371460 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811e326-09d9-4fcf-ad42-d5491849daa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:19.373337 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811e326-09d9-4fcf-ad42-d5491849daa5 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:19.377815 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ad4735e8-ed2e-43ef-b510-909df148a862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14dfd7e4d6b45b69592d52bde0f0d8a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:19.401710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 960/1905] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:43:19.402897 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811e326-09d9-4fcf-ad42-d5491849daa5 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:19.407928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-1811e326-09d9-4fcf-ad42-d5491849daa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:19.419338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 946/1906] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:19 2022] DELETE /identity/v3/users/b14dfd7e4d6b45b69592d52bde0f0d8a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:19.424473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f3f7-eb80-44fe-9ffd-a76fd28d8e53 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:19.424985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f3f7-eb80-44fe-9ffd-a76fd28d8e53 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:19.425460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f3f7-eb80-44fe-9ffd-a76fd28d8e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:19.437069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811e326-09d9-4fcf-ad42-d5491849daa5 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:19.472564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-d194f3f7-eb80-44fe-9ffd-a76fd28d8e53 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:19.474727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d194f3f7-eb80-44fe-9ffd-a76fd28d8e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:19.603202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 947/1907] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:19.616743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b544c7d-41c5-4243-b9a7-ab09792bba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:19.616743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b544c7d-41c5-4243-b9a7-ab09792bba09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:19.616743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b544c7d-41c5-4243-b9a7-ab09792bba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:19.616743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b544c7d-41c5-4243-b9a7-ab09792bba09 admin admin] PATH_INFO: `/v3/projects/ecb7df7589a64b70848766d10a1ab6da/users/2eda36494dd945f6a21eaff8a4c6e5df/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:19.617079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b544c7d-41c5-4243-b9a7-ab09792bba09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb7df7589a64b70848766d10a1ab6da, user_id=2eda36494dd945f6a21eaff8a4c6e5df, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:19.617079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b544c7d-41c5-4243-b9a7-ab09792bba09 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:19.635031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f3f7-eb80-44fe-9ffd-a76fd28d8e53 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:19.636667 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d194f3f7-eb80-44fe-9ffd-a76fd28d8e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:19.646879 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 961/1908] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:19 2022] PUT /identity/v3/projects/ecb7df7589a64b70848766d10a1ab6da/users/2eda36494dd945f6a21eaff8a4c6e5df/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:19.658625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad187ac-e715-49cd-88ba-9a1d0f106ab5 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:19.658973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad187ac-e715-49cd-88ba-9a1d0f106ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:19.659255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad187ac-e715-49cd-88ba-9a1d0f106ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:19.730402 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-6ad187ac-e715-49cd-88ba-9a1d0f106ab5 None None] MFA Rules not processed for user `2eda36494dd945f6a21eaff8a4c6e5df`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:19.732073 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6ad187ac-e715-49cd-88ba-9a1d0f106ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:19.792107 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f3f7-eb80-44fe-9ffd-a76fd28d8e53 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:19.837205 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 962/1909] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:19.838075 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad187ac-e715-49cd-88ba-9a1d0f106ab5 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:19.839861 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6ad187ac-e715-49cd-88ba-9a1d0f106ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:19.860636 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ae78a-932d-40c4-aab4-0516870a3ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:19.861439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ae78a-932d-40c4-aab4-0516870a3ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:19.861726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ae78a-932d-40c4-aab4-0516870a3ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:19.862018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ae78a-932d-40c4-aab4-0516870a3ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:19.929328 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad187ac-e715-49cd-88ba-9a1d0f106ab5 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:19.935023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e267923-c94e-4988-8ad1-afb6300fad77 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53c58b3282f74da6a02720a47f63535a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4301aad219e74174a52a94569ecd3e2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:19.935755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e267923-c94e-4988-8ad1-afb6300fad77 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:19.936112 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e267923-c94e-4988-8ad1-afb6300fad77 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:19.936472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e267923-c94e-4988-8ad1-afb6300fad77 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:19.937291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e267923-c94e-4988-8ad1-afb6300fad77 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:19.937672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e267923-c94e-4988-8ad1-afb6300fad77 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:19.939441 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e267923-c94e-4988-8ad1-afb6300fad77 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:19.943626 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ae78a-932d-40c4-aab4-0516870a3ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:19.945068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ae78a-932d-40c4-aab4-0516870a3ea5 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:19.952612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 963/1910] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:19.954307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e267923-c94e-4988-8ad1-afb6300fad77 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:19.956541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9e267923-c94e-4988-8ad1-afb6300fad77 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:19.963343 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 948/1911] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:19.964386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ae78a-932d-40c4-aab4-0516870a3ea5 service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:19.978228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ae78a-932d-40c4-aab4-0516870a3ea5 service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:19.984807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8840a5a-55cd-4314-9972-5f1f6ebc6e4c tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53c58b3282f74da6a02720a47f63535a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4301aad219e74174a52a94569ecd3e2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:19.985483 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8840a5a-55cd-4314-9972-5f1f6ebc6e4c tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:19.986009 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8840a5a-55cd-4314-9972-5f1f6ebc6e4c tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:19.986395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8840a5a-55cd-4314-9972-5f1f6ebc6e4c tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:19.987141 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8840a5a-55cd-4314-9972-5f1f6ebc6e4c tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:19.989595 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8840a5a-55cd-4314-9972-5f1f6ebc6e4c tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:20.031868 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 949/1912] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:19 2022] POST /identity/v3/projects => generated 355 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:20.038873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e267923-c94e-4988-8ad1-afb6300fad77 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:20.041759 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8840a5a-55cd-4314-9972-5f1f6ebc6e4c tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:20.107424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b707ffc-a58c-4710-8796-b6c7ee7e257b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:20.109259 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b707ffc-a58c-4710-8796-b6c7ee7e257b service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:20.109550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b707ffc-a58c-4710-8796-b6c7ee7e257b service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:20.109831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b707ffc-a58c-4710-8796-b6c7ee7e257b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:20.153733 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8840a5a-55cd-4314-9972-5f1f6ebc6e4c tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:20.168519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe30114-0cfe-4347-8324-9262ac307999 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53c58b3282f74da6a02720a47f63535a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4301aad219e74174a52a94569ecd3e2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:20.171651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe30114-0cfe-4347-8324-9262ac307999 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:20.171843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe30114-0cfe-4347-8324-9262ac307999 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:20.172135 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe30114-0cfe-4347-8324-9262ac307999 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:20.175094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe30114-0cfe-4347-8324-9262ac307999 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:20.175433 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe30114-0cfe-4347-8324-9262ac307999 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:20.177247 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe30114-0cfe-4347-8324-9262ac307999 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:20.203233 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 950/1913] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:20.267097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe30114-0cfe-4347-8324-9262ac307999 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:20.281691 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b707ffc-a58c-4710-8796-b6c7ee7e257b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:20.283598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b707ffc-a58c-4710-8796-b6c7ee7e257b service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:20.284239 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe30114-0cfe-4347-8324-9262ac307999 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:20.305800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53c58b3282f74da6a02720a47f63535a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4301aad219e74174a52a94569ecd3e2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:20.307226 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:20.308006 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:20.308006 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] PATH_INFO: `/v3/projects/090c63af748c4243acf1a4ae35f3697e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:20.308853 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 964/1914] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:20.310482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] RBAC: Authorizing `identity:delete_project(project_id=090c63af748c4243acf1a4ae35f3697e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:20.313297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:20.445929 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '090c63af748c4243acf1a4ae35f3697e', 'request_id': 'req-c10e4c36-eeae-4200-a6d7-cf74e02cc450'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:20.463318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '090c63af748c4243acf1a4ae35f3697e', 'request_id': 'req-c10e4c36-eeae-4200-a6d7-cf74e02cc450'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:20.471835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '090c63af748c4243acf1a4ae35f3697e', 'request_id': 'req-c10e4c36-eeae-4200-a6d7-cf74e02cc450'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:20.495780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] The token cache is being invalidate because project 090c63af748c4243acf1a4ae35f3697e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:20.496749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:20.499039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:20.511382 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 951/1915] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:20 2022] DELETE /identity/v3/projects/090c63af748c4243acf1a4ae35f3697e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:20.574531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b707ffc-a58c-4710-8796-b6c7ee7e257b service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:20.576962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4b707ffc-a58c-4710-8796-b6c7ee7e257b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:20.763194 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b707ffc-a58c-4710-8796-b6c7ee7e257b service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:20.904673 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:20.905692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:20.905842 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:20.906583 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] PATH_INFO: `/v3/projects/98ad4940f31941ceb69cf30594c021fa` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:20.909273 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ad4940f31941ceb69cf30594c021fa)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:20.911215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:20.993820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ad4940f31941ceb69cf30594c021fa', 'request_id': 'req-bb41d8e3-8403-4116-be72-fe264687c7b3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.008430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ad4940f31941ceb69cf30594c021fa', 'request_id': 'req-bb41d8e3-8403-4116-be72-fe264687c7b3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.019669 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ad4940f31941ceb69cf30594c021fa', 'request_id': 'req-bb41d8e3-8403-4116-be72-fe264687c7b3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.042341 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] The token cache is being invalidate because project 98ad4940f31941ceb69cf30594c021fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:21.042846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.053384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:21.054943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:21.057511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.064478 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 965/1916] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:20 2022] DELETE /identity/v3/projects/98ad4940f31941ceb69cf30594c021fa => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:21.066802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:21.081503 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e4c36-eeae-4200-a6d7-cf74e02cc450 tempest-VolumeQuotaClassesTest-130278131 tempest-VolumeQuotaClassesTest-130278131-project-admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:21.082015 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:21.269938 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40fca3-46ee-4a8d-a164-44e8939901d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:21.271459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40fca3-46ee-4a8d-a164-44e8939901d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:21.271985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40fca3-46ee-4a8d-a164-44e8939901d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:21.272995 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40fca3-46ee-4a8d-a164-44e8939901d3 admin admin] PATH_INFO: `/v3/users/b3422d742fdb4e84b82cf9ccb3cd596f` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:21.273430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41d8e3-8403-4116-be72-fe264687c7b3 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:21.276305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40fca3-46ee-4a8d-a164-44e8939901d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3422d742fdb4e84b82cf9ccb3cd596f)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:21.280864 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40fca3-46ee-4a8d-a164-44e8939901d3 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:21.296092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed00f60-d83c-4924-a40d-1e4a5efd404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:21.296999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed00f60-d83c-4924-a40d-1e4a5efd404f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:21.297280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed00f60-d83c-4924-a40d-1e4a5efd404f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:21.297556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed00f60-d83c-4924-a40d-1e4a5efd404f admin admin] PATH_INFO: `/v3/users/2fcd6617ab1c40a6aebda871b4643937` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:21.299261 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed00f60-d83c-4924-a40d-1e4a5efd404f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fcd6617ab1c40a6aebda871b4643937)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:21.301455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed00f60-d83c-4924-a40d-1e4a5efd404f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:21.412390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7ed00f60-d83c-4924-a40d-1e4a5efd404f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fcd6617ab1c40a6aebda871b4643937'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.413359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7ed00f60-d83c-4924-a40d-1e4a5efd404f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fcd6617ab1c40a6aebda871b4643937'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.417861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7a40fca3-46ee-4a8d-a164-44e8939901d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3422d742fdb4e84b82cf9ccb3cd596f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.419267 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7a40fca3-46ee-4a8d-a164-44e8939901d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3422d742fdb4e84b82cf9ccb3cd596f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.420632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7a40fca3-46ee-4a8d-a164-44e8939901d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3422d742fdb4e84b82cf9ccb3cd596f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.436982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7a40fca3-46ee-4a8d-a164-44e8939901d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3422d742fdb4e84b82cf9ccb3cd596f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.446843 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7ed00f60-d83c-4924-a40d-1e4a5efd404f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fcd6617ab1c40a6aebda871b4643937'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.447516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7a40fca3-46ee-4a8d-a164-44e8939901d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3422d742fdb4e84b82cf9ccb3cd596f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.447973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7ed00f60-d83c-4924-a40d-1e4a5efd404f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fcd6617ab1c40a6aebda871b4643937'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.463380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7ed00f60-d83c-4924-a40d-1e4a5efd404f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fcd6617ab1c40a6aebda871b4643937'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.477797 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 952/1917] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:21 2022] DELETE /identity/v3/users/b3422d742fdb4e84b82cf9ccb3cd596f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:21.487951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd6d3-6776-4615-920e-34eb483046ca None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:21.489889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd6d3-6776-4615-920e-34eb483046ca None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:21.489889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bd6d3-6776-4615-920e-34eb483046ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:21.504252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 966/1918] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:21 2022] DELETE /identity/v3/users/2fcd6617ab1c40a6aebda871b4643937 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:21.527123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-856bd6d3-6776-4615-920e-34eb483046ca None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:21.529496 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-856bd6d3-6776-4615-920e-34eb483046ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:21.644917 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 953/1919] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:21.659480 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed00f60-d83c-4924-a40d-1e4a5efd404f admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:21.661732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-7ed00f60-d83c-4924-a40d-1e4a5efd404f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:21.768978 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed00f60-d83c-4924-a40d-1e4a5efd404f admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:21.792410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7b1a6-a6e8-485c-8ada-6a04cc2eb345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:21.793657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b1a6-a6e8-485c-8ada-6a04cc2eb345 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:21.794820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b1a6-a6e8-485c-8ada-6a04cc2eb345 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:21.796841 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b1a6-a6e8-485c-8ada-6a04cc2eb345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:21.816110 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7b1a6-a6e8-485c-8ada-6a04cc2eb345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:21.817916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7b1a6-a6e8-485c-8ada-6a04cc2eb345 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:21.833507 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bd6d3-6776-4615-920e-34eb483046ca None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:21.833649 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 967/1920] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:21.834567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-856bd6d3-6776-4615-920e-34eb483046ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:21.849635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bd6d3-6776-4615-920e-34eb483046ca None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:21.857059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3182d2-a1d4-4917-8bda-8847eef3f818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:21.858450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3182d2-a1d4-4917-8bda-8847eef3f818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:21.858933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3182d2-a1d4-4917-8bda-8847eef3f818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:21.859490 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3182d2-a1d4-4917-8bda-8847eef3f818 admin admin] PATH_INFO: `/v3/users/2ef39b7432aa4f83abafab54f6a46a5a` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:21.860860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3182d2-a1d4-4917-8bda-8847eef3f818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef39b7432aa4f83abafab54f6a46a5a)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:21.863371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3182d2-a1d4-4917-8bda-8847eef3f818 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:21.969633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-5a3182d2-a1d4-4917-8bda-8847eef3f818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef39b7432aa4f83abafab54f6a46a5a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.970445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-5a3182d2-a1d4-4917-8bda-8847eef3f818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef39b7432aa4f83abafab54f6a46a5a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:21.971398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-5a3182d2-a1d4-4917-8bda-8847eef3f818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef39b7432aa4f83abafab54f6a46a5a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.003085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-5a3182d2-a1d4-4917-8bda-8847eef3f818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef39b7432aa4f83abafab54f6a46a5a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.033821 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-5a3182d2-a1d4-4917-8bda-8847eef3f818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef39b7432aa4f83abafab54f6a46a5a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.057934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7b1a6-a6e8-485c-8ada-6a04cc2eb345 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:22.060957 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b1c7b1a6-a6e8-485c-8ada-6a04cc2eb345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:22.080654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 954/1921] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:21 2022] DELETE /identity/v3/users/2ef39b7432aa4f83abafab54f6a46a5a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:22.087759 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1e69d-ab9b-4cd5-b9a3-2b646d55016c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:22.089103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7b1a6-a6e8-485c-8ada-6a04cc2eb345 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:22.090198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1e69d-ab9b-4cd5-b9a3-2b646d55016c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:22.090489 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1e69d-ab9b-4cd5-b9a3-2b646d55016c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:22.130800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-dac1e69d-ab9b-4cd5-b9a3-2b646d55016c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:22.132163 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-dac1e69d-ab9b-4cd5-b9a3-2b646d55016c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:22.200629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:22.201570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:22.201851 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:22.202124 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] PATH_INFO: `/v3/projects/b25373f1ddb44bea83e6069c4a2a2b7e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:22.203550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25373f1ddb44bea83e6069c4a2a2b7e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:22.205469 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:22.252605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 955/1922] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:22.255399 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1e69d-ab9b-4cd5-b9a3-2b646d55016c None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:22.258620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-dac1e69d-ab9b-4cd5-b9a3-2b646d55016c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:22.278808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1e69d-ab9b-4cd5-b9a3-2b646d55016c None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:22.302139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25373f1ddb44bea83e6069c4a2a2b7e', 'request_id': 'req-484c304a-4c1c-4190-a786-988fb8504a71'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.316114 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25373f1ddb44bea83e6069c4a2a2b7e', 'request_id': 'req-484c304a-4c1c-4190-a786-988fb8504a71'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.325495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25373f1ddb44bea83e6069c4a2a2b7e', 'request_id': 'req-484c304a-4c1c-4190-a786-988fb8504a71'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.340955 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] The token cache is being invalidate because project b25373f1ddb44bea83e6069c4a2a2b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:22.341331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.342315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.347235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 968/1923] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:22 2022] DELETE /identity/v3/projects/b25373f1ddb44bea83e6069c4a2a2b7e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:22.347235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:22.348970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:22.353686 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84b66a-018d-4f78-9469-ec7a42036092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:22.354561 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b66a-018d-4f78-9469-ec7a42036092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:22.354891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b66a-018d-4f78-9469-ec7a42036092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:22.355166 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b66a-018d-4f78-9469-ec7a42036092 admin admin] PATH_INFO: `/v3/projects/65780f9d1dbe4d26bcc0a36daa18c732` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:22.356527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84b66a-018d-4f78-9469-ec7a42036092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65780f9d1dbe4d26bcc0a36daa18c732)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:22.359565 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84b66a-018d-4f78-9469-ec7a42036092 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:22.429124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cb84b66a-018d-4f78-9469-ec7a42036092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65780f9d1dbe4d26bcc0a36daa18c732', 'request_id': 'req-cb84b66a-018d-4f78-9469-ec7a42036092'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.444530 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c304a-4c1c-4190-a786-988fb8504a71 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:22.447178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cb84b66a-018d-4f78-9469-ec7a42036092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65780f9d1dbe4d26bcc0a36daa18c732', 'request_id': 'req-cb84b66a-018d-4f78-9469-ec7a42036092'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.455782 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cb84b66a-018d-4f78-9469-ec7a42036092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65780f9d1dbe4d26bcc0a36daa18c732', 'request_id': 'req-cb84b66a-018d-4f78-9469-ec7a42036092'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.475096 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cb84b66a-018d-4f78-9469-ec7a42036092 admin admin] The token cache is being invalidate because project 65780f9d1dbe4d26bcc0a36daa18c732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:22.475612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cb84b66a-018d-4f78-9469-ec7a42036092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.478447 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cb84b66a-018d-4f78-9469-ec7a42036092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.481240 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 956/1924] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:22 2022] DELETE /identity/v3/projects/65780f9d1dbe4d26bcc0a36daa18c732 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:22.482747 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bdad1-e2a1-4331-8639-88ff8bc49f92 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:22.483363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bdad1-e2a1-4331-8639-88ff8bc49f92 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:22.484106 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bdad1-e2a1-4331-8639-88ff8bc49f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:22.521801 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-8c2bdad1-e2a1-4331-8639-88ff8bc49f92 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:22.526951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-8c2bdad1-e2a1-4331-8639-88ff8bc49f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:22.559280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39311ed3-0680-4990-966f-13211578463e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:22.560096 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39311ed3-0680-4990-966f-13211578463e service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:22.561699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39311ed3-0680-4990-966f-13211578463e service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:22.561998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39311ed3-0680-4990-966f-13211578463e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:22.568777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-39311ed3-0680-4990-966f-13211578463e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:22.649227 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 957/1925] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:22.650413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bdad1-e2a1-4331-8639-88ff8bc49f92 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:22.654911 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-8c2bdad1-e2a1-4331-8639-88ff8bc49f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:22.684612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bdad1-e2a1-4331-8639-88ff8bc49f92 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:22.697926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a8d3e-ad6f-4f14-bf37-a4f4c31f347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:22.701371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a8d3e-ad6f-4f14-bf37-a4f4c31f347f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:22.701950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a8d3e-ad6f-4f14-bf37-a4f4c31f347f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:22.702468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a8d3e-ad6f-4f14-bf37-a4f4c31f347f admin admin] PATH_INFO: `/v3/users/53c58b3282f74da6a02720a47f63535a` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:22.706199 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a8d3e-ad6f-4f14-bf37-a4f4c31f347f admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c58b3282f74da6a02720a47f63535a)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:22.710934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a8d3e-ad6f-4f14-bf37-a4f4c31f347f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:22.714396 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39311ed3-0680-4990-966f-13211578463e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:22.716188 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39311ed3-0680-4990-966f-13211578463e service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:22.738242 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 969/1926] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:22.740151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556253c3-6bf6-4b93-89b7-d5dd2ee41a77 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:22.740151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556253c3-6bf6-4b93-89b7-d5dd2ee41a77 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:22.740366 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556253c3-6bf6-4b93-89b7-d5dd2ee41a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:22.798561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-556253c3-6bf6-4b93-89b7-d5dd2ee41a77 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:22.799811 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-556253c3-6bf6-4b93-89b7-d5dd2ee41a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:22.815074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fb1a8d3e-ad6f-4f14-bf37-a4f4c31f347f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c58b3282f74da6a02720a47f63535a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.815777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fb1a8d3e-ad6f-4f14-bf37-a4f4c31f347f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c58b3282f74da6a02720a47f63535a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.816407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fb1a8d3e-ad6f-4f14-bf37-a4f4c31f347f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c58b3282f74da6a02720a47f63535a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.824709 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 970/1927] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:22.831138 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556253c3-6bf6-4b93-89b7-d5dd2ee41a77 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:22.842875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fb1a8d3e-ad6f-4f14-bf37-a4f4c31f347f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c58b3282f74da6a02720a47f63535a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.850593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556253c3-6bf6-4b93-89b7-d5dd2ee41a77 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:22.853402 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fb1a8d3e-ad6f-4f14-bf37-a4f4c31f347f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c58b3282f74da6a02720a47f63535a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:22.857570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b3282-bf03-41ce-abce-313a0b30658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:22.859233 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b3282-bf03-41ce-abce-313a0b30658c admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:22.859481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b3282-bf03-41ce-abce-313a0b30658c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:22.859876 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b3282-bf03-41ce-abce-313a0b30658c admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:22.861244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b3282-bf03-41ce-abce-313a0b30658c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:22.861244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b3282-bf03-41ce-abce-313a0b30658c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:22.863066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b3282-bf03-41ce-abce-313a0b30658c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:22.886152 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 971/1929] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:22.886322 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 958/1929] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:22 2022] DELETE /identity/v3/users/53c58b3282f74da6a02720a47f63535a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:22.887235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b3282-bf03-41ce-abce-313a0b30658c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:22.889397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-1a2b3282-bf03-41ce-abce-313a0b30658c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:22.905629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b3282-bf03-41ce-abce-313a0b30658c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:22.983054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2afb2-3537-4d5a-8f55-f9538a1f6dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:22.984128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2afb2-3537-4d5a-8f55-f9538a1f6dbe admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:22.984634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2afb2-3537-4d5a-8f55-f9538a1f6dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:22.985123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2afb2-3537-4d5a-8f55-f9538a1f6dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:22.986385 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2afb2-3537-4d5a-8f55-f9538a1f6dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:22.988803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2afb2-3537-4d5a-8f55-f9538a1f6dbe admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:23.023475 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 972/1930] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:22 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:23.024727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a8d3e-ad6f-4f14-bf37-a4f4c31f347f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:23.041118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a8d3e-ad6f-4f14-bf37-a4f4c31f347f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:23.207869 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bf066-1b64-40ed-8ea2-7bcebaf21127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:23.208622 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bf066-1b64-40ed-8ea2-7bcebaf21127 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:23.208902 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bf066-1b64-40ed-8ea2-7bcebaf21127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:23.209177 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bf066-1b64-40ed-8ea2-7bcebaf21127 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:23.210014 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bf066-1b64-40ed-8ea2-7bcebaf21127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:23.213642 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bf066-1b64-40ed-8ea2-7bcebaf21127 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:23.256978 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 959/1931] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:23 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:23.258765 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2afb2-3537-4d5a-8f55-f9538a1f6dbe admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:23.270149 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2afb2-3537-4d5a-8f55-f9538a1f6dbe admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:23.275981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a9343-d6b7-4a24-a2a8-18a3e5ac3b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:23.276846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9343-d6b7-4a24-a2a8-18a3e5ac3b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:23.277220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9343-d6b7-4a24-a2a8-18a3e5ac3b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:23.277593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9343-d6b7-4a24-a2a8-18a3e5ac3b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:23.278518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a9343-d6b7-4a24-a2a8-18a3e5ac3b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:23.280655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a9343-d6b7-4a24-a2a8-18a3e5ac3b5c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:23.295228 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 973/1932] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:23.299087 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bf066-1b64-40ed-8ea2-7bcebaf21127 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:23.310320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bf066-1b64-40ed-8ea2-7bcebaf21127 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:23.315926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04af05d-0d81-4b46-ade8-3d9d96e546c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:23.316597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04af05d-0d81-4b46-ade8-3d9d96e546c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:23.316885 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04af05d-0d81-4b46-ade8-3d9d96e546c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:23.317184 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04af05d-0d81-4b46-ade8-3d9d96e546c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:23.317922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04af05d-0d81-4b46-ade8-3d9d96e546c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:23.319651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04af05d-0d81-4b46-ade8-3d9d96e546c1 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:23.331079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 960/1933] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:23.335248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a9343-d6b7-4a24-a2a8-18a3e5ac3b5c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:23.351079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a9343-d6b7-4a24-a2a8-18a3e5ac3b5c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:23.360568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2a665-fd32-4edb-b8cd-0bb4262db7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:23.361970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2a665-fd32-4edb-b8cd-0bb4262db7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:23.362334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2a665-fd32-4edb-b8cd-0bb4262db7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:23.362622 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2a665-fd32-4edb-b8cd-0bb4262db7f3 admin admin] PATH_INFO: `/v3/projects/2b9233cd986e4b53b7009c49f4752ef2/users/fc82b07d98324e5db2fcb8c6fce6327f/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:23.387853 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2a665-fd32-4edb-b8cd-0bb4262db7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9233cd986e4b53b7009c49f4752ef2, user_id=fc82b07d98324e5db2fcb8c6fce6327f, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:23.390727 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2a665-fd32-4edb-b8cd-0bb4262db7f3 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:23.409060 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 974/1934] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:23 2022] PUT /identity/v3/projects/2b9233cd986e4b53b7009c49f4752ef2/users/fc82b07d98324e5db2fcb8c6fce6327f/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:23.419332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2a665-fd32-4edb-b8cd-0bb4262db7f3 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:23.419499 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e77f3a-e588-4889-8b3c-d273a7131f92 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:23.419709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e77f3a-e588-4889-8b3c-d273a7131f92 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:23.419920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e77f3a-e588-4889-8b3c-d273a7131f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:23.428224 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a4d2a665-fd32-4edb-b8cd-0bb4262db7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:23.464391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-87e77f3a-e588-4889-8b3c-d273a7131f92 None None] MFA Rules not processed for user `fc82b07d98324e5db2fcb8c6fce6327f`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:23.465844 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-87e77f3a-e588-4889-8b3c-d273a7131f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:23.557326 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2a665-fd32-4edb-b8cd-0bb4262db7f3 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:23.562639 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:23.563521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:23.563806 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:23.564085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] PATH_INFO: `/v3/projects/4301aad219e74174a52a94569ecd3e2b` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:23.565320 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4301aad219e74174a52a94569ecd3e2b)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:23.568507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:23.573474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 961/1935] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:23.574496 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e77f3a-e588-4889-8b3c-d273a7131f92 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:23.576000 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-87e77f3a-e588-4889-8b3c-d273a7131f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:23.591471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e77f3a-e588-4889-8b3c-d273a7131f92 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:23.596901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5197c9f-ba8b-4541-b0c3-0cef24191277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:23.597800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5197c9f-ba8b-4541-b0c3-0cef24191277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:23.598884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5197c9f-ba8b-4541-b0c3-0cef24191277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:23.599495 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5197c9f-ba8b-4541-b0c3-0cef24191277 admin admin] PATH_INFO: `/v3/projects/c0b0e7301b144261bf1873a38a50a808` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:23.600756 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5197c9f-ba8b-4541-b0c3-0cef24191277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b0e7301b144261bf1873a38a50a808)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:23.602763 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5197c9f-ba8b-4541-b0c3-0cef24191277 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:23.666898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4301aad219e74174a52a94569ecd3e2b', 'request_id': 'req-70a13646-6cae-471e-8da0-ffd16abacb27'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:23.679276 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f5197c9f-ba8b-4541-b0c3-0cef24191277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b0e7301b144261bf1873a38a50a808', 'request_id': 'req-f5197c9f-ba8b-4541-b0c3-0cef24191277'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:23.681669 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4301aad219e74174a52a94569ecd3e2b', 'request_id': 'req-70a13646-6cae-471e-8da0-ffd16abacb27'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:23.691442 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4301aad219e74174a52a94569ecd3e2b', 'request_id': 'req-70a13646-6cae-471e-8da0-ffd16abacb27'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:23.695342 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f5197c9f-ba8b-4541-b0c3-0cef24191277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b0e7301b144261bf1873a38a50a808', 'request_id': 'req-f5197c9f-ba8b-4541-b0c3-0cef24191277'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:23.706096 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f5197c9f-ba8b-4541-b0c3-0cef24191277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b0e7301b144261bf1873a38a50a808', 'request_id': 'req-f5197c9f-ba8b-4541-b0c3-0cef24191277'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:23.712900 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] The token cache is being invalidate because project 4301aad219e74174a52a94569ecd3e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:23.713199 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:23.716172 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:23.725021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 975/1936] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:23 2022] DELETE /identity/v3/projects/4301aad219e74174a52a94569ecd3e2b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:23.725021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:23.729881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:23.733527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f5197c9f-ba8b-4541-b0c3-0cef24191277 admin admin] The token cache is being invalidate because project c0b0e7301b144261bf1873a38a50a808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:23.734281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f5197c9f-ba8b-4541-b0c3-0cef24191277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:23.735290 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f5197c9f-ba8b-4541-b0c3-0cef24191277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:23.737452 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 962/1937] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:23 2022] DELETE /identity/v3/projects/c0b0e7301b144261bf1873a38a50a808 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:23.739083 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a40a8-2d3b-45bd-bb5b-25d572d1264b None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:23.739434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a40a8-2d3b-45bd-bb5b-25d572d1264b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:23.739723 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a40a8-2d3b-45bd-bb5b-25d572d1264b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:23.773902 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-df2a40a8-2d3b-45bd-bb5b-25d572d1264b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:23.775216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-df2a40a8-2d3b-45bd-bb5b-25d572d1264b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:23.829559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a13646-6cae-471e-8da0-ffd16abacb27 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:23.886053 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 963/1938] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:23.894236 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a40a8-2d3b-45bd-bb5b-25d572d1264b None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:23.895651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-df2a40a8-2d3b-45bd-bb5b-25d572d1264b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:23.911973 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a40a8-2d3b-45bd-bb5b-25d572d1264b None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:23.931665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f36f2-e7e2-4135-8b94-402c01ff80cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:23.932571 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f36f2-e7e2-4135-8b94-402c01ff80cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:23.932924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f36f2-e7e2-4135-8b94-402c01ff80cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:23.933104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f36f2-e7e2-4135-8b94-402c01ff80cf admin admin] PATH_INFO: `/v3/users/2eda36494dd945f6a21eaff8a4c6e5df` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:23.939561 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f36f2-e7e2-4135-8b94-402c01ff80cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eda36494dd945f6a21eaff8a4c6e5df)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:23.941702 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f36f2-e7e2-4135-8b94-402c01ff80cf admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:23.952115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71409452-3631-4648-9c37-141e5ea27c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:23.953744 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71409452-3631-4648-9c37-141e5ea27c33 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:23.954041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71409452-3631-4648-9c37-141e5ea27c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:23.954312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71409452-3631-4648-9c37-141e5ea27c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:23.955426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71409452-3631-4648-9c37-141e5ea27c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:23.958581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71409452-3631-4648-9c37-141e5ea27c33 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:23.996755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 976/1939] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:23 2022] POST /identity/v3/projects => generated 377 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:23.998242 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b488e-7755-422d-b988-f96d8ffaa7dd None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:23.998561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b488e-7755-422d-b988-f96d8ffaa7dd None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:23.999216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b488e-7755-422d-b988-f96d8ffaa7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:24.019938 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-dd4b488e-7755-422d-b988-f96d8ffaa7dd None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:24.021159 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-dd4b488e-7755-422d-b988-f96d8ffaa7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:24.024563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-392f36f2-e7e2-4135-8b94-402c01ff80cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eda36494dd945f6a21eaff8a4c6e5df'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.025300 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-392f36f2-e7e2-4135-8b94-402c01ff80cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eda36494dd945f6a21eaff8a4c6e5df'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.025918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-392f36f2-e7e2-4135-8b94-402c01ff80cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eda36494dd945f6a21eaff8a4c6e5df'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.038373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-392f36f2-e7e2-4135-8b94-402c01ff80cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eda36494dd945f6a21eaff8a4c6e5df'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.045840 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-392f36f2-e7e2-4135-8b94-402c01ff80cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eda36494dd945f6a21eaff8a4c6e5df'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.061671 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 964/1940] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:23 2022] DELETE /identity/v3/users/2eda36494dd945f6a21eaff8a4c6e5df => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:24.064029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f36f2-e7e2-4135-8b94-402c01ff80cf admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:24.065817 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-392f36f2-e7e2-4135-8b94-402c01ff80cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:24.101591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 977/1941] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:24.106252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b488e-7755-422d-b988-f96d8ffaa7dd None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:24.116130 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b488e-7755-422d-b988-f96d8ffaa7dd None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:24.182960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f36f2-e7e2-4135-8b94-402c01ff80cf admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:24.195201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae208b3-ec29-4dc4-8c4d-33065d34fe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:24.197154 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae208b3-ec29-4dc4-8c4d-33065d34fe1e admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:24.197449 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae208b3-ec29-4dc4-8c4d-33065d34fe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:24.197725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae208b3-ec29-4dc4-8c4d-33065d34fe1e admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:24.198423 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae208b3-ec29-4dc4-8c4d-33065d34fe1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:24.216251 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae208b3-ec29-4dc4-8c4d-33065d34fe1e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:24.243994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdd32b-3e66-4024-a610-5711a5edff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:24.244696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdd32b-3e66-4024-a610-5711a5edff80 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:24.244980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdd32b-3e66-4024-a610-5711a5edff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:24.245253 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdd32b-3e66-4024-a610-5711a5edff80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:24.246048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdd32b-3e66-4024-a610-5711a5edff80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:24.246349 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdd32b-3e66-4024-a610-5711a5edff80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:24.248338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdd32b-3e66-4024-a610-5711a5edff80 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:24.264402 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 978/1942] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:43:24.265245 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 965/1943] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:24 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:24.269522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdd32b-3e66-4024-a610-5711a5edff80 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:24.269771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae208b3-ec29-4dc4-8c4d-33065d34fe1e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:24.288872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdd32b-3e66-4024-a610-5711a5edff80 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:24.300152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae208b3-ec29-4dc4-8c4d-33065d34fe1e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:24.304381 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ffe3-effb-4f2b-a157-3d52a52c74dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:24.305747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ffe3-effb-4f2b-a157-3d52a52c74dd admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:24.306163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ffe3-effb-4f2b-a157-3d52a52c74dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:24.306446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ffe3-effb-4f2b-a157-3d52a52c74dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:24.307184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3ffe3-effb-4f2b-a157-3d52a52c74dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:24.309110 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3ffe3-effb-4f2b-a157-3d52a52c74dd admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:24.311018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c28bf1-4758-441b-b095-937843fb73b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:24.311677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c28bf1-4758-441b-b095-937843fb73b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:24.311958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c28bf1-4758-441b-b095-937843fb73b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:24.312230 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c28bf1-4758-441b-b095-937843fb73b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:24.313117 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c28bf1-4758-441b-b095-937843fb73b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:24.314820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c28bf1-4758-441b-b095-937843fb73b9 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:24.327015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 966/1944] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:24.346899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c28bf1-4758-441b-b095-937843fb73b9 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:24.362209 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c28bf1-4758-441b-b095-937843fb73b9 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:24.368438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 979/1945] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:24 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:24.372591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315ed6-ae0a-426e-8d20-771a0e2724e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:24.373001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ffe3-effb-4f2b-a157-3d52a52c74dd admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:24.373757 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315ed6-ae0a-426e-8d20-771a0e2724e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:24.374089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315ed6-ae0a-426e-8d20-771a0e2724e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:24.374380 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315ed6-ae0a-426e-8d20-771a0e2724e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:24.375311 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315ed6-ae0a-426e-8d20-771a0e2724e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:24.377140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315ed6-ae0a-426e-8d20-771a0e2724e0 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:24.392115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 967/1946] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:24.398063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315ed6-ae0a-426e-8d20-771a0e2724e0 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:24.420317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315ed6-ae0a-426e-8d20-771a0e2724e0 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:24.481778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ffe3-effb-4f2b-a157-3d52a52c74dd admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:24.491225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efc7a7-f4c6-4399-b906-0784a9a1d668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:24.491936 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efc7a7-f4c6-4399-b906-0784a9a1d668 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:24.493141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efc7a7-f4c6-4399-b906-0784a9a1d668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:24.494266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efc7a7-f4c6-4399-b906-0784a9a1d668 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:24.495600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efc7a7-f4c6-4399-b906-0784a9a1d668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:24.496827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eed013-054a-4d79-8c11-ad75925bc93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:24.498082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed013-054a-4d79-8c11-ad75925bc93c admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:24.498189 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efc7a7-f4c6-4399-b906-0784a9a1d668 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:24.498556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed013-054a-4d79-8c11-ad75925bc93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:24.498869 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed013-054a-4d79-8c11-ad75925bc93c admin admin] PATH_INFO: `/v3/projects/1024eeeb74024f28a166423b73a06319/users/7dfc80a7160f4019bd97fd8265d80399/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:24.520339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eed013-054a-4d79-8c11-ad75925bc93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1024eeeb74024f28a166423b73a06319, user_id=7dfc80a7160f4019bd97fd8265d80399, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:24.524410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eed013-054a-4d79-8c11-ad75925bc93c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:24.552581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 980/1947] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:24 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:24.553577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efc7a7-f4c6-4399-b906-0784a9a1d668 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:24.557578 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d6efc7a7-f4c6-4399-b906-0784a9a1d668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:24.563966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 968/1948] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:24 2022] PUT /identity/v3/projects/1024eeeb74024f28a166423b73a06319/users/7dfc80a7160f4019bd97fd8265d80399/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:24.565090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eed013-054a-4d79-8c11-ad75925bc93c admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:24.571515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a6eed013-054a-4d79-8c11-ad75925bc93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:24.586140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efc7a7-f4c6-4399-b906-0784a9a1d668 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:24.660638 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eed013-054a-4d79-8c11-ad75925bc93c admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:24.667437 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed5cd6-6191-4e12-bab4-084670fcf871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:24.669006 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed5cd6-6191-4e12-bab4-084670fcf871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:24.669479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed5cd6-6191-4e12-bab4-084670fcf871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:24.669987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed5cd6-6191-4e12-bab4-084670fcf871 admin admin] PATH_INFO: `/v3/users/16f385b6b4dd48148380f15e3af8b36f` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:24.671836 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed5cd6-6191-4e12-bab4-084670fcf871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f385b6b4dd48148380f15e3af8b36f)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:24.673848 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed5cd6-6191-4e12-bab4-084670fcf871 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:24.677176 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b925900-78ef-4a2e-833a-c53a46eaa164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:24.678414 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b925900-78ef-4a2e-833a-c53a46eaa164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:24.678879 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b925900-78ef-4a2e-833a-c53a46eaa164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:24.679169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b925900-78ef-4a2e-833a-c53a46eaa164 admin admin] PATH_INFO: `/v3/projects/ecb7df7589a64b70848766d10a1ab6da` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:24.682576 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b925900-78ef-4a2e-833a-c53a46eaa164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb7df7589a64b70848766d10a1ab6da)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:24.683855 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b925900-78ef-4a2e-833a-c53a46eaa164 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:24.735552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-56ed5cd6-6191-4e12-bab4-084670fcf871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f385b6b4dd48148380f15e3af8b36f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.736288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-56ed5cd6-6191-4e12-bab4-084670fcf871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f385b6b4dd48148380f15e3af8b36f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.736971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-56ed5cd6-6191-4e12-bab4-084670fcf871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f385b6b4dd48148380f15e3af8b36f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.751586 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-56ed5cd6-6191-4e12-bab4-084670fcf871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f385b6b4dd48148380f15e3af8b36f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.762434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-56ed5cd6-6191-4e12-bab4-084670fcf871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f385b6b4dd48148380f15e3af8b36f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.762660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5b925900-78ef-4a2e-833a-c53a46eaa164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb7df7589a64b70848766d10a1ab6da', 'request_id': 'req-5b925900-78ef-4a2e-833a-c53a46eaa164'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.785875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 969/1949] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:24 2022] DELETE /identity/v3/users/16f385b6b4dd48148380f15e3af8b36f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:24.785875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed5cd6-6191-4e12-bab4-084670fcf871 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:24.786174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5b925900-78ef-4a2e-833a-c53a46eaa164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb7df7589a64b70848766d10a1ab6da', 'request_id': 'req-5b925900-78ef-4a2e-833a-c53a46eaa164'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.791111 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5b925900-78ef-4a2e-833a-c53a46eaa164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb7df7589a64b70848766d10a1ab6da', 'request_id': 'req-5b925900-78ef-4a2e-833a-c53a46eaa164'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.797894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-56ed5cd6-6191-4e12-bab4-084670fcf871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:24.805467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5b925900-78ef-4a2e-833a-c53a46eaa164 admin admin] The token cache is being invalidate because project ecb7df7589a64b70848766d10a1ab6da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:24.805899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5b925900-78ef-4a2e-833a-c53a46eaa164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.807369 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5b925900-78ef-4a2e-833a-c53a46eaa164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:24.813139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 981/1950] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:24 2022] DELETE /identity/v3/projects/ecb7df7589a64b70848766d10a1ab6da => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:24.813139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51899a-080f-4545-99e8-d21827f91ca9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:24.813139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51899a-080f-4545-99e8-d21827f91ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:24.813139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51899a-080f-4545-99e8-d21827f91ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:24.845140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-5b51899a-080f-4545-99e8-d21827f91ca9 None None] MFA Rules not processed for user `7dfc80a7160f4019bd97fd8265d80399`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:24.846651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5b51899a-080f-4545-99e8-d21827f91ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:24.905940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed5cd6-6191-4e12-bab4-084670fcf871 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:24.911726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d5dce-f130-400f-95cf-6a25fd923bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:24.912558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d5dce-f130-400f-95cf-6a25fd923bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:24.912841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d5dce-f130-400f-95cf-6a25fd923bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:24.913393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d5dce-f130-400f-95cf-6a25fd923bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:24.914781 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d5dce-f130-400f-95cf-6a25fd923bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:24.917059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d5dce-f130-400f-95cf-6a25fd923bb1 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:24.929402 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 970/1951] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:24.931752 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3765b-1289-4ddb-8bdc-c8797bdac35b None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:24.932038 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3765b-1289-4ddb-8bdc-c8797bdac35b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:24.932311 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3765b-1289-4ddb-8bdc-c8797bdac35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:24.960396 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-d4e3765b-1289-4ddb-8bdc-c8797bdac35b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:24.962730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d4e3765b-1289-4ddb-8bdc-c8797bdac35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:24.971594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 971/1952] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:24.972974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad504e2-ad39-4cd3-9d71-5bf025d34d2b None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:24.973262 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad504e2-ad39-4cd3-9d71-5bf025d34d2b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:24.973534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad504e2-ad39-4cd3-9d71-5bf025d34d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:24.984956 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 982/1953] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:24.985894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51899a-080f-4545-99e8-d21827f91ca9 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:24.991336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5b51899a-080f-4545-99e8-d21827f91ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:24.995615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-0ad504e2-ad39-4cd3-9d71-5bf025d34d2b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:24.997034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0ad504e2-ad39-4cd3-9d71-5bf025d34d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:25.006485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 972/1954] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:25.007117 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad504e2-ad39-4cd3-9d71-5bf025d34d2b None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:25.011798 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0ad504e2-ad39-4cd3-9d71-5bf025d34d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:25.023048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51899a-080f-4545-99e8-d21827f91ca9 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:25.027866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad504e2-ad39-4cd3-9d71-5bf025d34d2b None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:25.033788 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2a642-3108-4d6f-918b-03fd3323949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:25.034746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2a642-3108-4d6f-918b-03fd3323949b admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.036181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f78290-c076-4eff-9be8-a1d8c2426334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:25.037068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f78290-c076-4eff-9be8-a1d8c2426334 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.037366 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f78290-c076-4eff-9be8-a1d8c2426334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.038184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f78290-c076-4eff-9be8-a1d8c2426334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.038370 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f78290-c076-4eff-9be8-a1d8c2426334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:25.040629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f78290-c076-4eff-9be8-a1d8c2426334 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:25.040766 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2a642-3108-4d6f-918b-03fd3323949b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.041122 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2a642-3108-4d6f-918b-03fd3323949b admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.042201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2a642-3108-4d6f-918b-03fd3323949b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:25.045260 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2a642-3108-4d6f-918b-03fd3323949b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:25.056676 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 983/1955] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:25.060637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f78290-c076-4eff-9be8-a1d8c2426334 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:25.087594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 973/1956] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:25 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:25.087594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13290349-187d-4c06-8312-664816d39328 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.087594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13290349-187d-4c06-8312-664816d39328 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.087594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13290349-187d-4c06-8312-664816d39328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.093006 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-98f78290-c076-4eff-9be8-a1d8c2426334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:25.134385 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-13290349-187d-4c06-8312-664816d39328 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:25.135914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-13290349-187d-4c06-8312-664816d39328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:25.221387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f78290-c076-4eff-9be8-a1d8c2426334 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:25.226024 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 974/1957] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:25.227744 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13290349-187d-4c06-8312-664816d39328 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:25.246211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13290349-187d-4c06-8312-664816d39328 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:25.251278 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037596bb-26c9-4ed3-91df-c69e6adf2f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:25.252233 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037596bb-26c9-4ed3-91df-c69e6adf2f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.252700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037596bb-26c9-4ed3-91df-c69e6adf2f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.253035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037596bb-26c9-4ed3-91df-c69e6adf2f11 admin admin] PATH_INFO: `/v3/projects/339a311338b349da9532e1f9f193c38b/users/e81226dc11f7466d9645a2b95d628e17/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.270370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037596bb-26c9-4ed3-91df-c69e6adf2f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339a311338b349da9532e1f9f193c38b, user_id=e81226dc11f7466d9645a2b95d628e17, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:25.273395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037596bb-26c9-4ed3-91df-c69e6adf2f11 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:25.299477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 975/1958] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:25 2022] PUT /identity/v3/projects/339a311338b349da9532e1f9f193c38b/users/e81226dc11f7466d9645a2b95d628e17/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:25.300329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037596bb-26c9-4ed3-91df-c69e6adf2f11 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:25.310437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71b0ce-8dc3-4232-b2ba-7af7c23f64ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:25.311175 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71b0ce-8dc3-4232-b2ba-7af7c23f64ec service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.311424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71b0ce-8dc3-4232-b2ba-7af7c23f64ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.311699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71b0ce-8dc3-4232-b2ba-7af7c23f64ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.330048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71b0ce-8dc3-4232-b2ba-7af7c23f64ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:25.331613 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71b0ce-8dc3-4232-b2ba-7af7c23f64ec service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:25.343391 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 984/1959] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:25.344248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71b0ce-8dc3-4232-b2ba-7af7c23f64ec service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:25.358265 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71b0ce-8dc3-4232-b2ba-7af7c23f64ec service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:25.384685 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037596bb-26c9-4ed3-91df-c69e6adf2f11 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:25.389979 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f78ab4-c30c-45e6-be05-71f4123a2553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:25.390755 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f78ab4-c30c-45e6-be05-71f4123a2553 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.393023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f78ab4-c30c-45e6-be05-71f4123a2553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.393315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f78ab4-c30c-45e6-be05-71f4123a2553 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.394025 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f78ab4-c30c-45e6-be05-71f4123a2553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:25.396031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f78ab4-c30c-45e6-be05-71f4123a2553 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:25.422258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 976/1960] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:25 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:25.423996 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20266fb6-6d19-4294-85be-894dc497e76a None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.424341 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20266fb6-6d19-4294-85be-894dc497e76a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.424617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20266fb6-6d19-4294-85be-894dc497e76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.437167 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5114be-28b9-4592-a458-406cdf6c3388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:25.438251 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5114be-28b9-4592-a458-406cdf6c3388 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.439358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5114be-28b9-4592-a458-406cdf6c3388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.439723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5114be-28b9-4592-a458-406cdf6c3388 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.440922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5114be-28b9-4592-a458-406cdf6c3388 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:25.441304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5114be-28b9-4592-a458-406cdf6c3388 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:25.443048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5114be-28b9-4592-a458-406cdf6c3388 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:25.452987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-20266fb6-6d19-4294-85be-894dc497e76a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:25.454216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-20266fb6-6d19-4294-85be-894dc497e76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:25.463154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 985/1961] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:25.464809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5114be-28b9-4592-a458-406cdf6c3388 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:25.467047 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 977/1962] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:25.467999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20266fb6-6d19-4294-85be-894dc497e76a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:25.482115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5114be-28b9-4592-a458-406cdf6c3388 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:25.484456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20266fb6-6d19-4294-85be-894dc497e76a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:25.493001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356bdfa-b6e2-4f60-91ec-64e8ae2df237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:25.493697 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356bdfa-b6e2-4f60-91ec-64e8ae2df237 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.493965 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356bdfa-b6e2-4f60-91ec-64e8ae2df237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.494238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356bdfa-b6e2-4f60-91ec-64e8ae2df237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.494992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356bdfa-b6e2-4f60-91ec-64e8ae2df237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:25.496600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356bdfa-b6e2-4f60-91ec-64e8ae2df237 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:25.496712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cce6c-b89c-46be-b07b-64adbd2113e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:25.497643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cce6c-b89c-46be-b07b-64adbd2113e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.498870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cce6c-b89c-46be-b07b-64adbd2113e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.501469 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cce6c-b89c-46be-b07b-64adbd2113e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.502764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cce6c-b89c-46be-b07b-64adbd2113e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:25.505438 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cce6c-b89c-46be-b07b-64adbd2113e4 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:25.514112 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 986/1963] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:25.514112 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356bdfa-b6e2-4f60-91ec-64e8ae2df237 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:25.516047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6356bdfa-b6e2-4f60-91ec-64e8ae2df237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:25.553154 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 978/1964] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:25 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:25.553154 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cce6c-b89c-46be-b07b-64adbd2113e4 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:25.594660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356bdfa-b6e2-4f60-91ec-64e8ae2df237 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:25.646350 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cce6c-b89c-46be-b07b-64adbd2113e4 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:25.655165 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ae475-6248-4ca2-b942-15f2c6f50ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:25.656080 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae475-6248-4ca2-b942-15f2c6f50ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.656358 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae475-6248-4ca2-b942-15f2c6f50ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.656630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae475-6248-4ca2-b942-15f2c6f50ba6 admin admin] PATH_INFO: `/v3/projects/290e477a523b48a68a54d3d9b44cd211/users/dc0a859266074ca98e133c8a2b54c836/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.675636 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ae475-6248-4ca2-b942-15f2c6f50ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290e477a523b48a68a54d3d9b44cd211, user_id=dc0a859266074ca98e133c8a2b54c836, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:25.678441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ae475-6248-4ca2-b942-15f2c6f50ba6 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:25.691898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19790ec-aba0-4bb9-8c5c-fd7bde846ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:25.692567 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19790ec-aba0-4bb9-8c5c-fd7bde846ece service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.692849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19790ec-aba0-4bb9-8c5c-fd7bde846ece service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.693123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19790ec-aba0-4bb9-8c5c-fd7bde846ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.697660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 979/1965] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:25 2022] PUT /identity/v3/projects/290e477a523b48a68a54d3d9b44cd211/users/dc0a859266074ca98e133c8a2b54c836/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:25.697660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ae475-6248-4ca2-b942-15f2c6f50ba6 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:25.709671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19790ec-aba0-4bb9-8c5c-fd7bde846ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:25.712435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19790ec-aba0-4bb9-8c5c-fd7bde846ece service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:25.725793 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 987/1966] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:25.727554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19790ec-aba0-4bb9-8c5c-fd7bde846ece service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:25.741042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19790ec-aba0-4bb9-8c5c-fd7bde846ece service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:25.816635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ae475-6248-4ca2-b942-15f2c6f50ba6 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:25.830141 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3966a-d7cc-423c-997c-34ee5fc97364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:25.830869 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3966a-d7cc-423c-997c-34ee5fc97364 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.831150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3966a-d7cc-423c-997c-34ee5fc97364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.831427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3966a-d7cc-423c-997c-34ee5fc97364 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.832136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3966a-d7cc-423c-997c-34ee5fc97364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:25.839611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8ae60-bf56-454f-99f3-68596c987a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:25.839888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3966a-d7cc-423c-997c-34ee5fc97364 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:25.840723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8ae60-bf56-454f-99f3-68596c987a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.841252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8ae60-bf56-454f-99f3-68596c987a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.841670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8ae60-bf56-454f-99f3-68596c987a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.843294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8ae60-bf56-454f-99f3-68596c987a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:25.845635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8ae60-bf56-454f-99f3-68596c987a7a admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:25.862254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 988/1967] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:25.866411 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8ae60-bf56-454f-99f3-68596c987a7a admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:25.882187 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8ae60-bf56-454f-99f3-68596c987a7a admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:25.896263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 980/1968] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:25 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:25.897363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3966a-d7cc-423c-997c-34ee5fc97364 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:25.900339 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaa568-72f1-444e-94d5-bdc10a3b3072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:25.901499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaa568-72f1-444e-94d5-bdc10a3b3072 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.903024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaa568-72f1-444e-94d5-bdc10a3b3072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.903453 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaa568-72f1-444e-94d5-bdc10a3b3072 admin admin] PATH_INFO: `/v3/projects/290e477a523b48a68a54d3d9b44cd211/users/dc0a859266074ca98e133c8a2b54c836/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.911280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcaa568-72f1-444e-94d5-bdc10a3b3072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290e477a523b48a68a54d3d9b44cd211, user_id=dc0a859266074ca98e133c8a2b54c836, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:25.916070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3966a-d7cc-423c-997c-34ee5fc97364 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:25.919198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcaa568-72f1-444e-94d5-bdc10a3b3072 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:25.925416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101293b2-a853-4be2-a069-48a5bdeb80ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:25.926164 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101293b2-a853-4be2-a069-48a5bdeb80ba admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.926460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101293b2-a853-4be2-a069-48a5bdeb80ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.926862 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101293b2-a853-4be2-a069-48a5bdeb80ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.928562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101293b2-a853-4be2-a069-48a5bdeb80ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:25.931905 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101293b2-a853-4be2-a069-48a5bdeb80ba admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:25.956958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 989/1969] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:25 2022] PUT /identity/v3/projects/290e477a523b48a68a54d3d9b44cd211/users/dc0a859266074ca98e133c8a2b54c836/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:25.958661 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef820754-c496-4657-a249-1a6e50de0b04 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:25.958978 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef820754-c496-4657-a249-1a6e50de0b04 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:25.959259 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef820754-c496-4657-a249-1a6e50de0b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:25.970253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 981/1970] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:25.972013 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101293b2-a853-4be2-a069-48a5bdeb80ba admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:25.983905 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101293b2-a853-4be2-a069-48a5bdeb80ba admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:26.032839 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ef820754-c496-4657-a249-1a6e50de0b04 None None] MFA Rules not processed for user `dc0a859266074ca98e133c8a2b54c836`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:26.034872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ef820754-c496-4657-a249-1a6e50de0b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:26.073593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050efbf-a4a8-48f6-a5aa-df5a8527d063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:26.075099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050efbf-a4a8-48f6-a5aa-df5a8527d063 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:26.075099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050efbf-a4a8-48f6-a5aa-df5a8527d063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:26.075483 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050efbf-a4a8-48f6-a5aa-df5a8527d063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:26.076347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050efbf-a4a8-48f6-a5aa-df5a8527d063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:26.078434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050efbf-a4a8-48f6-a5aa-df5a8527d063 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:26.101129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 982/1971] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:26.108816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050efbf-a4a8-48f6-a5aa-df5a8527d063 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:26.125882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050efbf-a4a8-48f6-a5aa-df5a8527d063 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:26.133656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f44be-b6d3-4957-a6d8-73f5aeff0de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:26.135229 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f44be-b6d3-4957-a6d8-73f5aeff0de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:26.136068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f44be-b6d3-4957-a6d8-73f5aeff0de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:26.137473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f44be-b6d3-4957-a6d8-73f5aeff0de1 admin admin] PATH_INFO: `/v3/projects/ddea23f7d54f415b9f5436f0aa5c9c7c/users/bedfb3da6f8d4a2fa9a9c37cd23398ab/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:26.160560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f44be-b6d3-4957-a6d8-73f5aeff0de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddea23f7d54f415b9f5436f0aa5c9c7c, user_id=bedfb3da6f8d4a2fa9a9c37cd23398ab, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:26.165949 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 990/1972] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:26.169350 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f44be-b6d3-4957-a6d8-73f5aeff0de1 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:26.176446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef820754-c496-4657-a249-1a6e50de0b04 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:26.178103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ef820754-c496-4657-a249-1a6e50de0b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:26.186725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 983/1973] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:26 2022] PUT /identity/v3/projects/ddea23f7d54f415b9f5436f0aa5c9c7c/users/bedfb3da6f8d4a2fa9a9c37cd23398ab/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:26.197967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8edd5a-6c95-426a-913e-60afeff1d2ff None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:26.198372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8edd5a-6c95-426a-913e-60afeff1d2ff None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:26.198839 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8edd5a-6c95-426a-913e-60afeff1d2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:26.232002 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ef8edd5a-6c95-426a-913e-60afeff1d2ff None None] MFA Rules not processed for user `bedfb3da6f8d4a2fa9a9c37cd23398ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:26.234395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ef8edd5a-6c95-426a-913e-60afeff1d2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:26.266745 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef820754-c496-4657-a249-1a6e50de0b04 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:26.330657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5786ee9-9e40-4d43-8ee7-a053f7f1e6dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:26.333297 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5786ee9-9e40-4d43-8ee7-a053f7f1e6dc service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:26.333678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5786ee9-9e40-4d43-8ee7-a053f7f1e6dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:26.334190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5786ee9-9e40-4d43-8ee7-a053f7f1e6dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:26.358027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 984/1974] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:26.412351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5786ee9-9e40-4d43-8ee7-a053f7f1e6dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:26.414841 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5786ee9-9e40-4d43-8ee7-a053f7f1e6dc service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:26.422507 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8edd5a-6c95-426a-913e-60afeff1d2ff None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:26.428108 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ef8edd5a-6c95-426a-913e-60afeff1d2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:26.429169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 991/1975] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:26.443851 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8edd5a-6c95-426a-913e-60afeff1d2ff None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:26.449581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd597f-67f1-401f-b702-73af01118c0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:26.450593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd597f-67f1-401f-b702-73af01118c0e service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:26.451238 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd597f-67f1-401f-b702-73af01118c0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:26.451672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd597f-67f1-401f-b702-73af01118c0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:26.464018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd597f-67f1-401f-b702-73af01118c0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:26.465713 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd597f-67f1-401f-b702-73af01118c0e service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:26.479813 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 985/1976] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:26.501960 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5786ee9-9e40-4d43-8ee7-a053f7f1e6dc service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:26.507227 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd597f-67f1-401f-b702-73af01118c0e service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:26.518593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd597f-67f1-401f-b702-73af01118c0e service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:26.525958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d016c6-7bc3-4e15-aa82-c53eac367a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:26.526633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d016c6-7bc3-4e15-aa82-c53eac367a8b service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:26.526970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d016c6-7bc3-4e15-aa82-c53eac367a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:26.527250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d016c6-7bc3-4e15-aa82-c53eac367a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:26.534395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-56d016c6-7bc3-4e15-aa82-c53eac367a8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:26.609802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5786ee9-9e40-4d43-8ee7-a053f7f1e6dc service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:26.612834 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d016c6-7bc3-4e15-aa82-c53eac367a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:26.615943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d016c6-7bc3-4e15-aa82-c53eac367a8b service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:26.617870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcf506-318d-455a-8177-6002a560fa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:26.619109 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcf506-318d-455a-8177-6002a560fa06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:26.619411 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcf506-318d-455a-8177-6002a560fa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:26.619689 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcf506-318d-455a-8177-6002a560fa06 admin admin] PATH_INFO: `/v3/users/bedfb3da6f8d4a2fa9a9c37cd23398ab` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:26.622355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcf506-318d-455a-8177-6002a560fa06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bedfb3da6f8d4a2fa9a9c37cd23398ab)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:26.625105 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcf506-318d-455a-8177-6002a560fa06 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:26.629277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 986/1977] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:26.745406 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5bfcf506-318d-455a-8177-6002a560fa06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bedfb3da6f8d4a2fa9a9c37cd23398ab'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:26.745406 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5bfcf506-318d-455a-8177-6002a560fa06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bedfb3da6f8d4a2fa9a9c37cd23398ab'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:26.756810 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5bfcf506-318d-455a-8177-6002a560fa06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bedfb3da6f8d4a2fa9a9c37cd23398ab'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:26.757417 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5bfcf506-318d-455a-8177-6002a560fa06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bedfb3da6f8d4a2fa9a9c37cd23398ab'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:26.766536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d016c6-7bc3-4e15-aa82-c53eac367a8b service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:26.769035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-56d016c6-7bc3-4e15-aa82-c53eac367a8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:26.770405 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5bfcf506-318d-455a-8177-6002a560fa06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bedfb3da6f8d4a2fa9a9c37cd23398ab'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:26.796498 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d016c6-7bc3-4e15-aa82-c53eac367a8b service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:26.799791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 992/1978] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:26 2022] DELETE /identity/v3/users/bedfb3da6f8d4a2fa9a9c37cd23398ab => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:26.801563 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feb689-bd97-4944-8b78-4ca5692c9c97 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:26.801860 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feb689-bd97-4944-8b78-4ca5692c9c97 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:26.802139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feb689-bd97-4944-8b78-4ca5692c9c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:26.840492 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-e8feb689-bd97-4944-8b78-4ca5692c9c97 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:26.844504 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e8feb689-bd97-4944-8b78-4ca5692c9c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:26.878459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:26.879646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:26.880392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:26.880873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] PATH_INFO: `/v3/projects/7f791d82ba5e48eea814b075e161e58b` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:26.883389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f791d82ba5e48eea814b075e161e58b)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:26.885764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:26.948378 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 993/1979] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:26.971369 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8feb689-bd97-4944-8b78-4ca5692c9c97 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:26.973323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e8feb689-bd97-4944-8b78-4ca5692c9c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:26.979630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f791d82ba5e48eea814b075e161e58b', 'request_id': 'req-913007b7-17e1-4f78-bedd-787d9b4a7b85'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:26.990478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f791d82ba5e48eea814b075e161e58b', 'request_id': 'req-913007b7-17e1-4f78-bedd-787d9b4a7b85'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:26.999354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f791d82ba5e48eea814b075e161e58b', 'request_id': 'req-913007b7-17e1-4f78-bedd-787d9b4a7b85'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:27.014991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] The token cache is being invalidate because project 7f791d82ba5e48eea814b075e161e58b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:27.015418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:27.016156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:27.022484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 987/1980] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:26 2022] DELETE /identity/v3/projects/7f791d82ba5e48eea814b075e161e58b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:27.023604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:27.026175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:27.063702 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8feb689-bd97-4944-8b78-4ca5692c9c97 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:27.125048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913007b7-17e1-4f78-bedd-787d9b4a7b85 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:27.133895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401c55-2987-4bb1-8913-8f12e5d9af58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:27.135941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401c55-2987-4bb1-8913-8f12e5d9af58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:27.138081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401c55-2987-4bb1-8913-8f12e5d9af58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:27.138476 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401c55-2987-4bb1-8913-8f12e5d9af58 admin admin] PATH_INFO: `/v3/users/2ee1a192b3ed485d9a80770827a7879e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:27.141096 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2401c55-2987-4bb1-8913-8f12e5d9af58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee1a192b3ed485d9a80770827a7879e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:27.147688 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2401c55-2987-4bb1-8913-8f12e5d9af58 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:27.149139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a3577-6852-4f50-b8bf-7a0ea6915b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:27.151263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a3577-6852-4f50-b8bf-7a0ea6915b3c service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:27.151689 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a3577-6852-4f50-b8bf-7a0ea6915b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:27.152020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a3577-6852-4f50-b8bf-7a0ea6915b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:27.154079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e08a3577-6852-4f50-b8bf-7a0ea6915b3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:27.169614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a3577-6852-4f50-b8bf-7a0ea6915b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:27.171480 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a3577-6852-4f50-b8bf-7a0ea6915b3c service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:27.184254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 994/1981] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:27.226791 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f2401c55-2987-4bb1-8913-8f12e5d9af58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee1a192b3ed485d9a80770827a7879e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:27.231630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f2401c55-2987-4bb1-8913-8f12e5d9af58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee1a192b3ed485d9a80770827a7879e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:27.232664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f2401c55-2987-4bb1-8913-8f12e5d9af58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee1a192b3ed485d9a80770827a7879e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:27.270715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f2401c55-2987-4bb1-8913-8f12e5d9af58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee1a192b3ed485d9a80770827a7879e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:27.292758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-f2401c55-2987-4bb1-8913-8f12e5d9af58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee1a192b3ed485d9a80770827a7879e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:27.319968 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 988/1982] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:27 2022] DELETE /identity/v3/users/2ee1a192b3ed485d9a80770827a7879e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:27.701523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fab812-fb5c-45fc-88be-5b60a2e9ccf2 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:27.701523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fab812-fb5c-45fc-88be-5b60a2e9ccf2 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:27.702156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fab812-fb5c-45fc-88be-5b60a2e9ccf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:27.756712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-f1fab812-fb5c-45fc-88be-5b60a2e9ccf2 None None] MFA Rules not processed for user `e81226dc11f7466d9645a2b95d628e17`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:27.758938 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f1fab812-fb5c-45fc-88be-5b60a2e9ccf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:27.776063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401c55-2987-4bb1-8913-8f12e5d9af58 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:27.777786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f2401c55-2987-4bb1-8913-8f12e5d9af58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:27.886384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401c55-2987-4bb1-8913-8f12e5d9af58 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:27.891485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:27.892427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:27.892713 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:27.892999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] PATH_INFO: `/v3/projects/ddea23f7d54f415b9f5436f0aa5c9c7c` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:27.894702 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 995/1983] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:27.895644 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fab812-fb5c-45fc-88be-5b60a2e9ccf2 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:27.899201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddea23f7d54f415b9f5436f0aa5c9c7c)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:27.900278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f1fab812-fb5c-45fc-88be-5b60a2e9ccf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:27.901139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:27.931492 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fab812-fb5c-45fc-88be-5b60a2e9ccf2 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:27.944269 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:27.946839 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:27.947130 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:27.948416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3 admin admin] PATH_INFO: `/v3/projects/e3aa5c719e454e0dac5c44cec48e925e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:27.951085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3aa5c719e454e0dac5c44cec48e925e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:27.956341 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:27.975215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddea23f7d54f415b9f5436f0aa5c9c7c', 'request_id': 'req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:27.984286 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddea23f7d54f415b9f5436f0aa5c9c7c', 'request_id': 'req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:27.994126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddea23f7d54f415b9f5436f0aa5c9c7c', 'request_id': 'req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:28.011244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] The token cache is being invalidate because project ddea23f7d54f415b9f5436f0aa5c9c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:28.011734 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:28.013739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:28.015807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 989/1984] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:27 2022] DELETE /identity/v3/projects/ddea23f7d54f415b9f5436f0aa5c9c7c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:28.016838 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:28.020574 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:28.045846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3aa5c719e454e0dac5c44cec48e925e', 'request_id': 'req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:28.057262 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3aa5c719e454e0dac5c44cec48e925e', 'request_id': 'req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:28.069954 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3aa5c719e454e0dac5c44cec48e925e', 'request_id': 'req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:28.092947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3 admin admin] The token cache is being invalidate because project e3aa5c719e454e0dac5c44cec48e925e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:28.093661 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:28.095062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-aaabc4f4-a3cb-4c9d-8a32-3794f724d1f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:28.097859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 996/1985] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:27 2022] DELETE /identity/v3/projects/e3aa5c719e454e0dac5c44cec48e925e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:28.099582 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6baa8-8392-4564-bd41-6c0c73bf22b1 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.099875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6baa8-8392-4564-bd41-6c0c73bf22b1 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.100711 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6baa8-8392-4564-bd41-6c0c73bf22b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.111640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb1b5f-2ea7-45fe-ad22-9f06cd01d6c0 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:28.131526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-aff6baa8-8392-4564-bd41-6c0c73bf22b1 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:28.132962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-aff6baa8-8392-4564-bd41-6c0c73bf22b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:28.183265 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afab903-28da-4381-b33c-5ad01ce2e900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:28.184095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afab903-28da-4381-b33c-5ad01ce2e900 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.184353 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afab903-28da-4381-b33c-5ad01ce2e900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.184625 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afab903-28da-4381-b33c-5ad01ce2e900 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.185318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afab903-28da-4381-b33c-5ad01ce2e900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:28.187494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afab903-28da-4381-b33c-5ad01ce2e900 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:28.216011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 997/1986] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:28.217665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f74e8-7003-4204-9ddd-8c7f67725033 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.218074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f74e8-7003-4204-9ddd-8c7f67725033 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.218474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f74e8-7003-4204-9ddd-8c7f67725033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.232381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 990/1987] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:28 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:28.234284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd18fd-8287-40ca-8831-4c49a0ded77e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.235333 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd18fd-8287-40ca-8831-4c49a0ded77e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.237555 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd18fd-8287-40ca-8831-4c49a0ded77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.245362 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ac7f74e8-7003-4204-9ddd-8c7f67725033 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:28.246809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ac7f74e8-7003-4204-9ddd-8c7f67725033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:28.271346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-88cd18fd-8287-40ca-8831-4c49a0ded77e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:28.272606 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-88cd18fd-8287-40ca-8831-4c49a0ded77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:28.345383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 998/1988] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:28.345383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f74e8-7003-4204-9ddd-8c7f67725033 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:28.345383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ac7f74e8-7003-4204-9ddd-8c7f67725033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:28.355091 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f74e8-7003-4204-9ddd-8c7f67725033 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:28.361169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b15136-4294-408d-ae28-a3bb32a3af35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:28.361834 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b15136-4294-408d-ae28-a3bb32a3af35 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.362115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b15136-4294-408d-ae28-a3bb32a3af35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.362411 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b15136-4294-408d-ae28-a3bb32a3af35 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.363154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b15136-4294-408d-ae28-a3bb32a3af35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:28.363825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 991/1989] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:28.365255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b7ae0-7e31-4e06-a0f6-27578bf9791c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.365385 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b15136-4294-408d-ae28-a3bb32a3af35 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:28.365544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b7ae0-7e31-4e06-a0f6-27578bf9791c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.365840 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b7ae0-7e31-4e06-a0f6-27578bf9791c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.394225 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-319b7ae0-7e31-4e06-a0f6-27578bf9791c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:28.395711 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-319b7ae0-7e31-4e06-a0f6-27578bf9791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:28.399983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 999/1990] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:28 2022] POST /identity/v3/users => generated 293 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:28.400715 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b15136-4294-408d-ae28-a3bb32a3af35 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:28.410515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 992/1991] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:28.410515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b7ae0-7e31-4e06-a0f6-27578bf9791c None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:28.411691 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b15136-4294-408d-ae28-a3bb32a3af35 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:28.417458 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07219cc-07ee-4c08-90aa-cb00c7dcfa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:28.418302 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b7ae0-7e31-4e06-a0f6-27578bf9791c None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:28.421951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07219cc-07ee-4c08-90aa-cb00c7dcfa3e admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.421951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07219cc-07ee-4c08-90aa-cb00c7dcfa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.422952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07219cc-07ee-4c08-90aa-cb00c7dcfa3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.423669 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07219cc-07ee-4c08-90aa-cb00c7dcfa3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:28.423972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38de9f-0b0e-44c8-9404-ec2c74674877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:28.424128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07219cc-07ee-4c08-90aa-cb00c7dcfa3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:28.426182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38de9f-0b0e-44c8-9404-ec2c74674877 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.426182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38de9f-0b0e-44c8-9404-ec2c74674877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.426182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38de9f-0b0e-44c8-9404-ec2c74674877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.426409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07219cc-07ee-4c08-90aa-cb00c7dcfa3e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:28.426505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38de9f-0b0e-44c8-9404-ec2c74674877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:28.428548 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38de9f-0b0e-44c8-9404-ec2c74674877 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:28.442332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 993/1992] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:28.443374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38de9f-0b0e-44c8-9404-ec2c74674877 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:28.454817 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38de9f-0b0e-44c8-9404-ec2c74674877 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:28.455438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1000/1993] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:28.456422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07219cc-07ee-4c08-90aa-cb00c7dcfa3e admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:28.465255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e2d86-34f9-4add-b9b7-02f684898457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:28.466045 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e2d86-34f9-4add-b9b7-02f684898457 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.466469 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e2d86-34f9-4add-b9b7-02f684898457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.466786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e2d86-34f9-4add-b9b7-02f684898457 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.467731 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e2d86-34f9-4add-b9b7-02f684898457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:28.468110 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e2d86-34f9-4add-b9b7-02f684898457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:28.470207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e2d86-34f9-4add-b9b7-02f684898457 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:28.470705 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07219cc-07ee-4c08-90aa-cb00c7dcfa3e admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:28.485316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 994/1994] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:28.486239 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e2d86-34f9-4add-b9b7-02f684898457 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:28.505887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e2d86-34f9-4add-b9b7-02f684898457 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:28.518327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb19fc-47f0-4380-ba29-f70e81fe8231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:28.519254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb19fc-47f0-4380-ba29-f70e81fe8231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.520180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb19fc-47f0-4380-ba29-f70e81fe8231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.520457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb19fc-47f0-4380-ba29-f70e81fe8231 admin admin] PATH_INFO: `/v3/projects/7b85aa3c24f5423d8c9a7b83ace994cc/users/6ec753257d2b4007808a4206f0065861/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.526796 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9ef53-69d4-424d-acc4-2081679d3e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:28.527965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9ef53-69d4-424d-acc4-2081679d3e60 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.527965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9ef53-69d4-424d-acc4-2081679d3e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.528170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9ef53-69d4-424d-acc4-2081679d3e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.528947 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9ef53-69d4-424d-acc4-2081679d3e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:28.533083 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9ef53-69d4-424d-acc4-2081679d3e60 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:28.560026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb19fc-47f0-4380-ba29-f70e81fe8231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b85aa3c24f5423d8c9a7b83ace994cc, user_id=6ec753257d2b4007808a4206f0065861, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:28.565151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb19fc-47f0-4380-ba29-f70e81fe8231 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:28.583747 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 995/1995] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:28 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:28.584914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9ef53-69d4-424d-acc4-2081679d3e60 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:28.599148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1001/1996] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:28 2022] PUT /identity/v3/projects/7b85aa3c24f5423d8c9a7b83ace994cc/users/6ec753257d2b4007808a4206f0065861/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:28.600034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb19fc-47f0-4380-ba29-f70e81fe8231 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:28.721529 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb19fc-47f0-4380-ba29-f70e81fe8231 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:28.729808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c39ed7-571a-41a0-9bc4-17aaca30df37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:28.730455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c39ed7-571a-41a0-9bc4-17aaca30df37 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.730772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c39ed7-571a-41a0-9bc4-17aaca30df37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.731056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c39ed7-571a-41a0-9bc4-17aaca30df37 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.731934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c39ed7-571a-41a0-9bc4-17aaca30df37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:28.734475 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9ef53-69d4-424d-acc4-2081679d3e60 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:28.734603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c39ed7-571a-41a0-9bc4-17aaca30df37 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:28.757932 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915b414-e246-4e56-b2ce-277c3332d6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:28.762342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1002/1997] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:28 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:28.763757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c39ed7-571a-41a0-9bc4-17aaca30df37 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:28.765476 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915b414-e246-4e56-b2ce-277c3332d6db admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.765767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915b414-e246-4e56-b2ce-277c3332d6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.766042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915b414-e246-4e56-b2ce-277c3332d6db admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.768301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915b414-e246-4e56-b2ce-277c3332d6db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:28.772646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915b414-e246-4e56-b2ce-277c3332d6db admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:28.783578 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c39ed7-571a-41a0-9bc4-17aaca30df37 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:28.792533 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fceebe4-1b51-4247-9fba-51fb84466edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:28.793220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fceebe4-1b51-4247-9fba-51fb84466edc admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.793499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fceebe4-1b51-4247-9fba-51fb84466edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.793774 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fceebe4-1b51-4247-9fba-51fb84466edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.794683 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fceebe4-1b51-4247-9fba-51fb84466edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:28.797010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fceebe4-1b51-4247-9fba-51fb84466edc admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:28.814617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1003/1998] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:28.814617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fceebe4-1b51-4247-9fba-51fb84466edc admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:28.827131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fceebe4-1b51-4247-9fba-51fb84466edc admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:28.834934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3d4a2-08e5-4a7a-9646-edf2cffe7999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:28.835713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3d4a2-08e5-4a7a-9646-edf2cffe7999 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.836761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3d4a2-08e5-4a7a-9646-edf2cffe7999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.837231 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3d4a2-08e5-4a7a-9646-edf2cffe7999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.838042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3d4a2-08e5-4a7a-9646-edf2cffe7999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:28.840053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3d4a2-08e5-4a7a-9646-edf2cffe7999 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:28.842745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 996/1999] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:28 2022] POST /identity/v3/projects => generated 375 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:28.843714 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915b414-e246-4e56-b2ce-277c3332d6db admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:28.856085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1004/2000] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:28.859193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3d4a2-08e5-4a7a-9646-edf2cffe7999 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:28.873967 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3d4a2-08e5-4a7a-9646-edf2cffe7999 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:28.969340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915b414-e246-4e56-b2ce-277c3332d6db admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:28.988341 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b8559-6cba-4792-9573-f139ffdaefb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:28.989613 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b8559-6cba-4792-9573-f139ffdaefb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:28.990035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b8559-6cba-4792-9573-f139ffdaefb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:28.990401 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b8559-6cba-4792-9573-f139ffdaefb7 admin admin] PATH_INFO: `/v3/projects/7b85aa3c24f5423d8c9a7b83ace994cc/users/6ec753257d2b4007808a4206f0065861/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:28.997416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b8559-6cba-4792-9573-f139ffdaefb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b85aa3c24f5423d8c9a7b83ace994cc, user_id=6ec753257d2b4007808a4206f0065861, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:28.998622 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae9131-4c47-47cb-b31c-ae79b194e379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:28.999868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae9131-4c47-47cb-b31c-ae79b194e379 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:29.000302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae9131-4c47-47cb-b31c-ae79b194e379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:29.000717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae9131-4c47-47cb-b31c-ae79b194e379 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:29.001455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae9131-4c47-47cb-b31c-ae79b194e379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:29.004183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae9131-4c47-47cb-b31c-ae79b194e379 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:29.016714 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b8559-6cba-4792-9573-f139ffdaefb7 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:29.033957 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1005/2001] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:28 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:29.034994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae9131-4c47-47cb-b31c-ae79b194e379 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:29.048023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 997/2002] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:28 2022] PUT /identity/v3/projects/7b85aa3c24f5423d8c9a7b83ace994cc/users/6ec753257d2b4007808a4206f0065861/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:29.048974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b8559-6cba-4792-9573-f139ffdaefb7 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:29.052453 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae9131-4c47-47cb-b31c-ae79b194e379 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:29.177262 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b8559-6cba-4792-9573-f139ffdaefb7 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:29.184767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae400b-23a0-4ea2-a528-0f7e108857d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:29.185839 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae400b-23a0-4ea2-a528-0f7e108857d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:29.186309 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae400b-23a0-4ea2-a528-0f7e108857d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:29.186841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae400b-23a0-4ea2-a528-0f7e108857d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:29.187800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae400b-23a0-4ea2-a528-0f7e108857d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:29.190033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae400b-23a0-4ea2-a528-0f7e108857d6 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:29.226777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 998/2003] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:29.231281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae400b-23a0-4ea2-a528-0f7e108857d6 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:29.240671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1cb55-b4ed-4ec2-92e9-202e65d7273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:29.241416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1cb55-b4ed-4ec2-92e9-202e65d7273b admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:29.241946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1cb55-b4ed-4ec2-92e9-202e65d7273b admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:29.242068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1cb55-b4ed-4ec2-92e9-202e65d7273b admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:29.245071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1cb55-b4ed-4ec2-92e9-202e65d7273b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:29.247152 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1cb55-b4ed-4ec2-92e9-202e65d7273b admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:29.253981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae400b-23a0-4ea2-a528-0f7e108857d6 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:29.263056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1006/2004] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:29.266202 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1cb55-b4ed-4ec2-92e9-202e65d7273b admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:29.276293 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8991b8d-fb6b-4a3e-8e67-200975854907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:29.277500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8991b8d-fb6b-4a3e-8e67-200975854907 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:29.278120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8991b8d-fb6b-4a3e-8e67-200975854907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:29.279335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8991b8d-fb6b-4a3e-8e67-200975854907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:29.281246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8991b8d-fb6b-4a3e-8e67-200975854907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:29.281857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1cb55-b4ed-4ec2-92e9-202e65d7273b admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:29.286181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8991b8d-fb6b-4a3e-8e67-200975854907 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:29.299713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee071e4c-3feb-4d8c-8b10-93a6db9c4a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:29.300707 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071e4c-3feb-4d8c-8b10-93a6db9c4a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:29.301098 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071e4c-3feb-4d8c-8b10-93a6db9c4a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:29.301648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071e4c-3feb-4d8c-8b10-93a6db9c4a64 admin admin] PATH_INFO: `/v3/projects/b78f2909bbf4473698d472df75efa3fa/users/3aa767912b9f4b19bd4d392c58940eff/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:29.316702 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 999/2005] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:29.321662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8991b8d-fb6b-4a3e-8e67-200975854907 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:29.327423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee071e4c-3feb-4d8c-8b10-93a6db9c4a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78f2909bbf4473698d472df75efa3fa, user_id=3aa767912b9f4b19bd4d392c58940eff, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:29.331121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee071e4c-3feb-4d8c-8b10-93a6db9c4a64 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:29.346599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8991b8d-fb6b-4a3e-8e67-200975854907 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:29.357075 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1007/2006] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:29 2022] PUT /identity/v3/projects/b78f2909bbf4473698d472df75efa3fa/users/3aa767912b9f4b19bd4d392c58940eff/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:29.367914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0604c9-d559-458d-8f9d-d7e2829de289 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:29.368343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0604c9-d559-458d-8f9d-d7e2829de289 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:29.368887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0604c9-d559-458d-8f9d-d7e2829de289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:29.431608 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-5c0604c9-d559-458d-8f9d-d7e2829de289 None None] MFA Rules not processed for user `3aa767912b9f4b19bd4d392c58940eff`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:29.431608 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5c0604c9-d559-458d-8f9d-d7e2829de289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:29.481045 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197334c-aeb3-4663-97dc-e528071239f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:29.483180 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197334c-aeb3-4663-97dc-e528071239f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:29.483894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197334c-aeb3-4663-97dc-e528071239f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:29.484417 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197334c-aeb3-4663-97dc-e528071239f2 admin admin] PATH_INFO: `/v3/projects/92da346f8d2e4fb88efc74af2244b7cb/users/de0808f807d64fda8181dc414695e234/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:29.504334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197334c-aeb3-4663-97dc-e528071239f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92da346f8d2e4fb88efc74af2244b7cb, user_id=de0808f807d64fda8181dc414695e234, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:29.507516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197334c-aeb3-4663-97dc-e528071239f2 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:29.543939 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1000/2007] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:29 2022] PUT /identity/v3/projects/92da346f8d2e4fb88efc74af2244b7cb/users/de0808f807d64fda8181dc414695e234/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:29.546355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a26180-1c98-44dc-bb10-56f36d31d505 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:29.546647 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a26180-1c98-44dc-bb10-56f36d31d505 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:29.546945 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a26180-1c98-44dc-bb10-56f36d31d505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:29.581971 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1008/2008] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:29.596697 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0604c9-d559-458d-8f9d-d7e2829de289 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:29.598546 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5c0604c9-d559-458d-8f9d-d7e2829de289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:29.618186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-92a26180-1c98-44dc-bb10-56f36d31d505 None None] MFA Rules not processed for user `de0808f807d64fda8181dc414695e234`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:29.622269 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-92a26180-1c98-44dc-bb10-56f36d31d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:29.753186 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0604c9-d559-458d-8f9d-d7e2829de289 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:29.767277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1001/2009] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:29.805512 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a26180-1c98-44dc-bb10-56f36d31d505 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:29.807581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-92a26180-1c98-44dc-bb10-56f36d31d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:29.836774 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6465d7-c1ee-48f4-8268-eb59e8d57ab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:29.838007 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6465d7-c1ee-48f4-8268-eb59e8d57ab8 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:29.838396 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6465d7-c1ee-48f4-8268-eb59e8d57ab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:29.838803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6465d7-c1ee-48f4-8268-eb59e8d57ab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:29.931079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a26180-1c98-44dc-bb10-56f36d31d505 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:29.936508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49ea49-c801-40d1-b760-2b30b1587d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:29.937363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49ea49-c801-40d1-b760-2b30b1587d17 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:29.937807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49ea49-c801-40d1-b760-2b30b1587d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:29.938250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49ea49-c801-40d1-b760-2b30b1587d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:29.947648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6465d7-c1ee-48f4-8268-eb59e8d57ab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:29.951245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6465d7-c1ee-48f4-8268-eb59e8d57ab8 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:29.960754 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49ea49-c801-40d1-b760-2b30b1587d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:29.962757 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49ea49-c801-40d1-b760-2b30b1587d17 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:29.970729 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1009/2010] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:29.979061 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1002/2011] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:30.629304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6465d7-c1ee-48f4-8268-eb59e8d57ab8 service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:30.632461 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-be6465d7-c1ee-48f4-8268-eb59e8d57ab8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:30.719111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81789ebb-bb52-4786-a881-8f9e312a738a None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:30.719767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81789ebb-bb52-4786-a881-8f9e312a738a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:30.720113 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81789ebb-bb52-4786-a881-8f9e312a738a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:30.772033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-81789ebb-bb52-4786-a881-8f9e312a738a None None] MFA Rules not processed for user `6ec753257d2b4007808a4206f0065861`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:30.778130 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-81789ebb-bb52-4786-a881-8f9e312a738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:30.785933 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6465d7-c1ee-48f4-8268-eb59e8d57ab8 service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:30.794992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bab28-c225-483c-97d2-e3dc00237cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:30.796190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bab28-c225-483c-97d2-e3dc00237cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:30.797411 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bab28-c225-483c-97d2-e3dc00237cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:30.798023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bab28-c225-483c-97d2-e3dc00237cc5 admin admin] PATH_INFO: `/v3/users/fc82b07d98324e5db2fcb8c6fce6327f` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:30.799648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bab28-c225-483c-97d2-e3dc00237cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc82b07d98324e5db2fcb8c6fce6327f)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:30.802803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bab28-c225-483c-97d2-e3dc00237cc5 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:30.865707 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-233bab28-c225-483c-97d2-e3dc00237cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc82b07d98324e5db2fcb8c6fce6327f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:30.866423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-233bab28-c225-483c-97d2-e3dc00237cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc82b07d98324e5db2fcb8c6fce6327f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:30.880121 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1003/2012] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:30.882390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-233bab28-c225-483c-97d2-e3dc00237cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc82b07d98324e5db2fcb8c6fce6327f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:30.884276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-233bab28-c225-483c-97d2-e3dc00237cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc82b07d98324e5db2fcb8c6fce6327f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:30.893094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81789ebb-bb52-4786-a881-8f9e312a738a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:30.895424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-233bab28-c225-483c-97d2-e3dc00237cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc82b07d98324e5db2fcb8c6fce6327f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:30.904668 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81789ebb-bb52-4786-a881-8f9e312a738a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:30.909815 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e1df3-9b4b-4dd5-90e5-2716542703f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:30.911128 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e1df3-9b4b-4dd5-90e5-2716542703f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:30.911428 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e1df3-9b4b-4dd5-90e5-2716542703f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:30.911712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e1df3-9b4b-4dd5-90e5-2716542703f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:30.913767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-167e1df3-9b4b-4dd5-90e5-2716542703f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:30.917709 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1010/2013] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:30 2022] DELETE /identity/v3/users/fc82b07d98324e5db2fcb8c6fce6327f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:30.924482 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e044037-5092-4ff5-8d59-e6dcd0d81680 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:30.924957 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e044037-5092-4ff5-8d59-e6dcd0d81680 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:30.925421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e044037-5092-4ff5-8d59-e6dcd0d81680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:30.949342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-4e044037-5092-4ff5-8d59-e6dcd0d81680 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:30.951761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4e044037-5092-4ff5-8d59-e6dcd0d81680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:31.017291 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e1df3-9b4b-4dd5-90e5-2716542703f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:31.019302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1011/2014] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:31.023214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e1df3-9b4b-4dd5-90e5-2716542703f3 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:31.029603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e044037-5092-4ff5-8d59-e6dcd0d81680 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:31.031544 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4e044037-5092-4ff5-8d59-e6dcd0d81680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:31.061997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1004/2015] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:31.127332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e044037-5092-4ff5-8d59-e6dcd0d81680 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:31.134978 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47e3aa-88bc-4ac5-b803-f6076a38fecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:31.136247 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47e3aa-88bc-4ac5-b803-f6076a38fecc service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:31.136561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47e3aa-88bc-4ac5-b803-f6076a38fecc service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:31.136845 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47e3aa-88bc-4ac5-b803-f6076a38fecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:31.148331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47e3aa-88bc-4ac5-b803-f6076a38fecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:31.150172 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47e3aa-88bc-4ac5-b803-f6076a38fecc service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:31.162362 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1012/2016] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:31.475854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e1df3-9b4b-4dd5-90e5-2716542703f3 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:31.477479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-167e1df3-9b4b-4dd5-90e5-2716542703f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:31.494135 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e1df3-9b4b-4dd5-90e5-2716542703f3 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:31.499718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:31.500778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:31.501069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:31.501389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] PATH_INFO: `/v3/projects/2b9233cd986e4b53b7009c49f4752ef2` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:31.502777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9233cd986e4b53b7009c49f4752ef2)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:31.505040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:31.562936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9233cd986e4b53b7009c49f4752ef2', 'request_id': 'req-a09002b9-d63d-454e-9935-68f8c6bb2363'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:31.572381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9233cd986e4b53b7009c49f4752ef2', 'request_id': 'req-a09002b9-d63d-454e-9935-68f8c6bb2363'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:31.578991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9233cd986e4b53b7009c49f4752ef2', 'request_id': 'req-a09002b9-d63d-454e-9935-68f8c6bb2363'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:31.601934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] The token cache is being invalidate because project 2b9233cd986e4b53b7009c49f4752ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:31.602905 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:31.602905 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:31.604763 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1005/2017] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:31 2022] DELETE /identity/v3/projects/2b9233cd986e4b53b7009c49f4752ef2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:31.608516 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47e3aa-88bc-4ac5-b803-f6076a38fecc service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:31.618639 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47e3aa-88bc-4ac5-b803-f6076a38fecc service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:31.710331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed609f53-393f-46cc-925d-dc746d36f5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:31.712939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed609f53-393f-46cc-925d-dc746d36f5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:31.713459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed609f53-393f-46cc-925d-dc746d36f5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:31.713838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed609f53-393f-46cc-925d-dc746d36f5ee admin admin] PATH_INFO: `/v3/users/7dfc80a7160f4019bd97fd8265d80399` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:31.715367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed609f53-393f-46cc-925d-dc746d36f5ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dfc80a7160f4019bd97fd8265d80399)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:31.717732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed609f53-393f-46cc-925d-dc746d36f5ee admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:31.783471 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ed609f53-393f-46cc-925d-dc746d36f5ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dfc80a7160f4019bd97fd8265d80399'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:31.784752 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ed609f53-393f-46cc-925d-dc746d36f5ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dfc80a7160f4019bd97fd8265d80399'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:31.807278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ed609f53-393f-46cc-925d-dc746d36f5ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dfc80a7160f4019bd97fd8265d80399'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:31.808859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ed609f53-393f-46cc-925d-dc746d36f5ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dfc80a7160f4019bd97fd8265d80399'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:31.818057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ed609f53-393f-46cc-925d-dc746d36f5ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dfc80a7160f4019bd97fd8265d80399'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:31.839985 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1013/2018] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:31 2022] DELETE /identity/v3/users/7dfc80a7160f4019bd97fd8265d80399 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:32.208330 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:32.210089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:32.226070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09002b9-d63d-454e-9935-68f8c6bb2363 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:32.299497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:32.299792 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:32.300073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:32.300345 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] PATH_INFO: `/v3/projects/1024eeeb74024f28a166423b73a06319` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:32.301618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1024eeeb74024f28a166423b73a06319)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:32.303660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:32.352678 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1024eeeb74024f28a166423b73a06319', 'request_id': 'req-7bfd82fe-0438-4a53-80c5-080907c408d4'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:32.360142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1024eeeb74024f28a166423b73a06319', 'request_id': 'req-7bfd82fe-0438-4a53-80c5-080907c408d4'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:32.365848 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1024eeeb74024f28a166423b73a06319', 'request_id': 'req-7bfd82fe-0438-4a53-80c5-080907c408d4'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:32.377165 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] The token cache is being invalidate because project 1024eeeb74024f28a166423b73a06319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:32.377451 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:32.378083 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:32.379668 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1006/2019] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:32 2022] DELETE /identity/v3/projects/1024eeeb74024f28a166423b73a06319 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:32.383803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed609f53-393f-46cc-925d-dc746d36f5ee admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:32.385219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ed609f53-393f-46cc-925d-dc746d36f5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:32.398205 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed609f53-393f-46cc-925d-dc746d36f5ee admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:32.455613 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea10071-ba28-4b30-b0c6-b116857c0172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:32.456490 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10071-ba28-4b30-b0c6-b116857c0172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:32.456774 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10071-ba28-4b30-b0c6-b116857c0172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:32.457053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10071-ba28-4b30-b0c6-b116857c0172 admin admin] PATH_INFO: `/v3/users/dc0a859266074ca98e133c8a2b54c836` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:32.458256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea10071-ba28-4b30-b0c6-b116857c0172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0a859266074ca98e133c8a2b54c836)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:32.460217 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea10071-ba28-4b30-b0c6-b116857c0172 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:32.482004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:32.483421 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:32.509593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5ea10071-ba28-4b30-b0c6-b116857c0172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0a859266074ca98e133c8a2b54c836'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:32.510235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5ea10071-ba28-4b30-b0c6-b116857c0172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0a859266074ca98e133c8a2b54c836'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:32.521755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5ea10071-ba28-4b30-b0c6-b116857c0172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0a859266074ca98e133c8a2b54c836'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:32.522380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5ea10071-ba28-4b30-b0c6-b116857c0172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0a859266074ca98e133c8a2b54c836'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:32.530494 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5ea10071-ba28-4b30-b0c6-b116857c0172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0a859266074ca98e133c8a2b54c836'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:32.542972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd82fe-0438-4a53-80c5-080907c408d4 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:32.544744 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1014/2020] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:32 2022] DELETE /identity/v3/users/dc0a859266074ca98e133c8a2b54c836 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:32.604441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e3518-5a1e-4cd7-b8ec-8c07c8cec45d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:32.605165 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e3518-5a1e-4cd7-b8ec-8c07c8cec45d service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:32.605632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e3518-5a1e-4cd7-b8ec-8c07c8cec45d service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:32.605915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e3518-5a1e-4cd7-b8ec-8c07c8cec45d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:32.607831 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c93e3518-5a1e-4cd7-b8ec-8c07c8cec45d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:32.683479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e3518-5a1e-4cd7-b8ec-8c07c8cec45d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:32.684991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e3518-5a1e-4cd7-b8ec-8c07c8cec45d service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:32.697344 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1007/2021] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:32.847368 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea10071-ba28-4b30-b0c6-b116857c0172 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:32.848977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5ea10071-ba28-4b30-b0c6-b116857c0172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:32.925713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea10071-ba28-4b30-b0c6-b116857c0172 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:32.931205 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:32.932074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:32.932385 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:32.932662 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a admin admin] PATH_INFO: `/v3/projects/290e477a523b48a68a54d3d9b44cd211` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:32.933913 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=290e477a523b48a68a54d3d9b44cd211)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:32.935807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:32.980969 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290e477a523b48a68a54d3d9b44cd211', 'request_id': 'req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:32.987758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290e477a523b48a68a54d3d9b44cd211', 'request_id': 'req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:32.994008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290e477a523b48a68a54d3d9b44cd211', 'request_id': 'req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:33.004616 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a admin admin] The token cache is being invalidate because project 290e477a523b48a68a54d3d9b44cd211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:33.004897 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:33.005526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-75ff19c1-20ef-41e0-95ee-55e0fe5ffa0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:33.007105 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1015/2022] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:32 2022] DELETE /identity/v3/projects/290e477a523b48a68a54d3d9b44cd211 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:33.013007 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec24054-b285-4f7e-9afb-9376acade330 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.013300 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec24054-b285-4f7e-9afb-9376acade330 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.013576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec24054-b285-4f7e-9afb-9376acade330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.030656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-6ec24054-b285-4f7e-9afb-9376acade330 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:33.031878 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-6ec24054-b285-4f7e-9afb-9376acade330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:33.088616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1008/2023] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:33.097174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89614787-98cd-4934-9e9a-35c772789622 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.097550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89614787-98cd-4934-9e9a-35c772789622 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.097857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89614787-98cd-4934-9e9a-35c772789622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.116457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-89614787-98cd-4934-9e9a-35c772789622 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:33.119697 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-89614787-98cd-4934-9e9a-35c772789622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:33.127881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1016/2024] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:33.132353 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec24054-b285-4f7e-9afb-9376acade330 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:33.142188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec24054-b285-4f7e-9afb-9376acade330 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:33.146767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af237fe2-b933-4424-b822-6e8ecc2dbce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:33.147416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af237fe2-b933-4424-b822-6e8ecc2dbce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.147694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af237fe2-b933-4424-b822-6e8ecc2dbce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.147967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af237fe2-b933-4424-b822-6e8ecc2dbce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.149224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af237fe2-b933-4424-b822-6e8ecc2dbce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:33.149613 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af237fe2-b933-4424-b822-6e8ecc2dbce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:33.151240 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af237fe2-b933-4424-b822-6e8ecc2dbce2 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:33.162346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1009/2025] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:43:33.167367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89614787-98cd-4934-9e9a-35c772789622 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:33.176393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89614787-98cd-4934-9e9a-35c772789622 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:33.181041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a5858-d841-4bca-abe1-ed563210bbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:33.181682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a5858-d841-4bca-abe1-ed563210bbbc admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.181972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a5858-d841-4bca-abe1-ed563210bbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.182248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a5858-d841-4bca-abe1-ed563210bbbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.182972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a5858-d841-4bca-abe1-ed563210bbbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:33.184939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a5858-d841-4bca-abe1-ed563210bbbc admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:33.209182 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1017/2026] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:33 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:33.213903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af237fe2-b933-4424-b822-6e8ecc2dbce2 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:33.224227 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af237fe2-b933-4424-b822-6e8ecc2dbce2 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:33.282427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3303317-ee91-4ba3-98d4-711237f90a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:33.283122 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303317-ee91-4ba3-98d4-711237f90a9c admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.283405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303317-ee91-4ba3-98d4-711237f90a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.283738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303317-ee91-4ba3-98d4-711237f90a9c admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.284459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3303317-ee91-4ba3-98d4-711237f90a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:33.286376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3303317-ee91-4ba3-98d4-711237f90a9c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:33.305693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1010/2027] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:33 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:33.309807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a5858-d841-4bca-abe1-ed563210bbbc admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:33.320069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a5858-d841-4bca-abe1-ed563210bbbc admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:33.324737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bddebc-3ac4-429b-b5bb-7822981d6a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:33.325444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bddebc-3ac4-429b-b5bb-7822981d6a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.325725 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bddebc-3ac4-429b-b5bb-7822981d6a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.325999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bddebc-3ac4-429b-b5bb-7822981d6a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.326740 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bddebc-3ac4-429b-b5bb-7822981d6a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:33.328475 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bddebc-3ac4-429b-b5bb-7822981d6a8f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:33.339289 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1018/2028] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:33.343021 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3303317-ee91-4ba3-98d4-711237f90a9c admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:33.353505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3303317-ee91-4ba3-98d4-711237f90a9c admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:33.358543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ce5d6-a0df-46de-88f4-ddbe834ae24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:33.359337 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ce5d6-a0df-46de-88f4-ddbe834ae24d admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.359621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ce5d6-a0df-46de-88f4-ddbe834ae24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.359897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ce5d6-a0df-46de-88f4-ddbe834ae24d admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.360617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ce5d6-a0df-46de-88f4-ddbe834ae24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:33.362235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ce5d6-a0df-46de-88f4-ddbe834ae24d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:33.372761 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1011/2029] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:33.376912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bddebc-3ac4-429b-b5bb-7822981d6a8f admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:33.386801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bddebc-3ac4-429b-b5bb-7822981d6a8f admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:33.391891 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b7e69-4683-4d9c-a4e5-a6bb0447acc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:33.393047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b7e69-4683-4d9c-a4e5-a6bb0447acc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.393343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b7e69-4683-4d9c-a4e5-a6bb0447acc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.393621 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b7e69-4683-4d9c-a4e5-a6bb0447acc3 admin admin] PATH_INFO: `/v3/projects/9976c5873f814e7fa50641928520680b/users/d0c0c132cdbf49118f8643f2c5271ce7/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.410181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b7e69-4683-4d9c-a4e5-a6bb0447acc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9976c5873f814e7fa50641928520680b, user_id=d0c0c132cdbf49118f8643f2c5271ce7, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:33.412878 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b7e69-4683-4d9c-a4e5-a6bb0447acc3 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:33.426768 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1019/2030] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:33 2022] PUT /identity/v3/projects/9976c5873f814e7fa50641928520680b/users/d0c0c132cdbf49118f8643f2c5271ce7/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:33.439047 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb51df-dd60-4a2b-b25c-ea0de7d96bae None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.439289 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb51df-dd60-4a2b-b25c-ea0de7d96bae None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.439563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb51df-dd60-4a2b-b25c-ea0de7d96bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.466754 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-22cb51df-dd60-4a2b-b25c-ea0de7d96bae None None] MFA Rules not processed for user `d0c0c132cdbf49118f8643f2c5271ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:33.467936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-22cb51df-dd60-4a2b-b25c-ea0de7d96bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:33.532515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1012/2031] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:33.536922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b7e69-4683-4d9c-a4e5-a6bb0447acc3 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:33.598548 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b7e69-4683-4d9c-a4e5-a6bb0447acc3 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:33.604005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8611eeb-9622-4787-a6d6-e219d48cf87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:33.604655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8611eeb-9622-4787-a6d6-e219d48cf87c admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.604936 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8611eeb-9622-4787-a6d6-e219d48cf87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.605209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8611eeb-9622-4787-a6d6-e219d48cf87c admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.605926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8611eeb-9622-4787-a6d6-e219d48cf87c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:33.607846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8611eeb-9622-4787-a6d6-e219d48cf87c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:33.633518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1020/2032] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:33 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:33.637531 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb51df-dd60-4a2b-b25c-ea0de7d96bae None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:33.648182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb51df-dd60-4a2b-b25c-ea0de7d96bae None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:33.703171 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f755a-2e7c-40e6-9b7e-9e3d52dfc7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:33.704015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f755a-2e7c-40e6-9b7e-9e3d52dfc7dd admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.704306 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f755a-2e7c-40e6-9b7e-9e3d52dfc7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.704610 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f755a-2e7c-40e6-9b7e-9e3d52dfc7dd admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.705341 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f755a-2e7c-40e6-9b7e-9e3d52dfc7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:33.707347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f755a-2e7c-40e6-9b7e-9e3d52dfc7dd admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:33.728070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1013/2033] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:33 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:33.732215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8611eeb-9622-4787-a6d6-e219d48cf87c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:33.742400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8611eeb-9622-4787-a6d6-e219d48cf87c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:33.747313 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88569339-cc6f-41c3-8da5-083dc5f0c8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:33.747970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88569339-cc6f-41c3-8da5-083dc5f0c8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.748249 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88569339-cc6f-41c3-8da5-083dc5f0c8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.748522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88569339-cc6f-41c3-8da5-083dc5f0c8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.749238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88569339-cc6f-41c3-8da5-083dc5f0c8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:33.750852 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88569339-cc6f-41c3-8da5-083dc5f0c8a6 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:33.766829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1021/2034] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:43:33.768185 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f755a-2e7c-40e6-9b7e-9e3d52dfc7dd admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:33.779134 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f755a-2e7c-40e6-9b7e-9e3d52dfc7dd admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:33.783726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee24c2-ea83-44e2-a8c9-9f282141ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:33.784599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee24c2-ea83-44e2-a8c9-9f282141ae56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.784879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee24c2-ea83-44e2-a8c9-9f282141ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.785152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee24c2-ea83-44e2-a8c9-9f282141ae56 admin admin] PATH_INFO: `/v3/projects/ec74aafd4517490c9103f9ee04ec282b/users/df2beb6cbf124a298f158ca73fd514fb/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.800002 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee24c2-ea83-44e2-a8c9-9f282141ae56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec74aafd4517490c9103f9ee04ec282b, user_id=df2beb6cbf124a298f158ca73fd514fb, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:33.802782 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee24c2-ea83-44e2-a8c9-9f282141ae56 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:33.815347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1014/2035] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:33 2022] PUT /identity/v3/projects/ec74aafd4517490c9103f9ee04ec282b/users/df2beb6cbf124a298f158ca73fd514fb/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:33.819237 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88569339-cc6f-41c3-8da5-083dc5f0c8a6 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:33.829643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88569339-cc6f-41c3-8da5-083dc5f0c8a6 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:33.887670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c94441-d01d-4d5d-bc1d-888fdf8ff65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:33.888349 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c94441-d01d-4d5d-bc1d-888fdf8ff65d admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.888602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c94441-d01d-4d5d-bc1d-888fdf8ff65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.888870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c94441-d01d-4d5d-bc1d-888fdf8ff65d admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.889590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c94441-d01d-4d5d-bc1d-888fdf8ff65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:33.891212 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c94441-d01d-4d5d-bc1d-888fdf8ff65d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:33.901943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1022/2036] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:33.906573 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee24c2-ea83-44e2-a8c9-9f282141ae56 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:33.918113 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee24c2-ea83-44e2-a8c9-9f282141ae56 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:33.922793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32d472-d804-4ab6-9462-e7c490be7c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:33.923679 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32d472-d804-4ab6-9462-e7c490be7c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.923962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32d472-d804-4ab6-9462-e7c490be7c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.924266 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32d472-d804-4ab6-9462-e7c490be7c45 admin admin] PATH_INFO: `/v3/projects/ec74aafd4517490c9103f9ee04ec282b/users/df2beb6cbf124a298f158ca73fd514fb/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.926259 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32d472-d804-4ab6-9462-e7c490be7c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec74aafd4517490c9103f9ee04ec282b, user_id=df2beb6cbf124a298f158ca73fd514fb, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:33.928921 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32d472-d804-4ab6-9462-e7c490be7c45 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:33.948680 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1015/2037] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:33 2022] PUT /identity/v3/projects/ec74aafd4517490c9103f9ee04ec282b/users/df2beb6cbf124a298f158ca73fd514fb/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:33.949753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92b7d1-e797-4a97-9b70-d347dc4dc5c8 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:33.950355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92b7d1-e797-4a97-9b70-d347dc4dc5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:33.950355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92b7d1-e797-4a97-9b70-d347dc4dc5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:33.991744 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-9a92b7d1-e797-4a97-9b70-d347dc4dc5c8 None None] MFA Rules not processed for user `df2beb6cbf124a298f158ca73fd514fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:33.992957 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9a92b7d1-e797-4a97-9b70-d347dc4dc5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:34.062181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1023/2038] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:34.074070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32d472-d804-4ab6-9462-e7c490be7c45 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:34.075804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-fb32d472-d804-4ab6-9462-e7c490be7c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:34.133660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32d472-d804-4ab6-9462-e7c490be7c45 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:34.137264 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b553b-bb66-45e5-886b-982b90c1523c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:34.137897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b553b-bb66-45e5-886b-982b90c1523c service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:34.138172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b553b-bb66-45e5-886b-982b90c1523c service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:34.138440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b553b-bb66-45e5-886b-982b90c1523c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:34.147430 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b553b-bb66-45e5-886b-982b90c1523c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:34.149608 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b553b-bb66-45e5-886b-982b90c1523c service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:34.158750 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1016/2039] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:34.229405 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92b7d1-e797-4a97-9b70-d347dc4dc5c8 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:34.238899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92b7d1-e797-4a97-9b70-d347dc4dc5c8 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:34.242551 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28ee2f-857a-412c-8e7a-311991613111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:34.243321 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28ee2f-857a-412c-8e7a-311991613111 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:34.243607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28ee2f-857a-412c-8e7a-311991613111 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:34.243884 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28ee2f-857a-412c-8e7a-311991613111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:34.300130 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28ee2f-857a-412c-8e7a-311991613111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:34.301577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28ee2f-857a-412c-8e7a-311991613111 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:34.310605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1024/2040] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:34.566130 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b553b-bb66-45e5-886b-982b90c1523c service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:34.628178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b553b-bb66-45e5-886b-982b90c1523c service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:34.633850 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfd795-252d-4db5-a5b7-00d819d8b3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:34.634737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfd795-252d-4db5-a5b7-00d819d8b3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:34.635013 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfd795-252d-4db5-a5b7-00d819d8b3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:34.635281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfd795-252d-4db5-a5b7-00d819d8b3ea admin admin] PATH_INFO: `/v3/users/d0c0c132cdbf49118f8643f2c5271ce7` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:34.636465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfd795-252d-4db5-a5b7-00d819d8b3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c0c132cdbf49118f8643f2c5271ce7)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:34.638364 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfd795-252d-4db5-a5b7-00d819d8b3ea admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:34.683409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a6cfd795-252d-4db5-a5b7-00d819d8b3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c0c132cdbf49118f8643f2c5271ce7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:34.684060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a6cfd795-252d-4db5-a5b7-00d819d8b3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c0c132cdbf49118f8643f2c5271ce7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:34.684666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a6cfd795-252d-4db5-a5b7-00d819d8b3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c0c132cdbf49118f8643f2c5271ce7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:34.698150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a6cfd795-252d-4db5-a5b7-00d819d8b3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c0c132cdbf49118f8643f2c5271ce7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:34.704739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a6cfd795-252d-4db5-a5b7-00d819d8b3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c0c132cdbf49118f8643f2c5271ce7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:34.717504 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1017/2041] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:34 2022] DELETE /identity/v3/users/d0c0c132cdbf49118f8643f2c5271ce7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:34.722121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e1460-2c65-4a9a-98c8-c8989f33875e None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:34.722410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e1460-2c65-4a9a-98c8-c8989f33875e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:34.722744 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e1460-2c65-4a9a-98c8-c8989f33875e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:34.739929 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-558e1460-2c65-4a9a-98c8-c8989f33875e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:34.741051 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-558e1460-2c65-4a9a-98c8-c8989f33875e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:34.798477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1025/2042] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:34.809650 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfd795-252d-4db5-a5b7-00d819d8b3ea admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:34.811211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a6cfd795-252d-4db5-a5b7-00d819d8b3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:34.866060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfd795-252d-4db5-a5b7-00d819d8b3ea admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:34.870632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9ba55-d3a7-49bb-8803-f4adf4333a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:34.871333 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9ba55-d3a7-49bb-8803-f4adf4333a79 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:34.871608 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9ba55-d3a7-49bb-8803-f4adf4333a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:34.871876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9ba55-d3a7-49bb-8803-f4adf4333a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:34.880585 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9ba55-d3a7-49bb-8803-f4adf4333a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:34.881997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9ba55-d3a7-49bb-8803-f4adf4333a79 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:34.892487 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1018/2043] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:35.357521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e1460-2c65-4a9a-98c8-c8989f33875e None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:35.359156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-558e1460-2c65-4a9a-98c8-c8989f33875e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:35.377721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e1460-2c65-4a9a-98c8-c8989f33875e None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:35.387461 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:35.388350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:35.388762 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:35.389768 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] PATH_INFO: `/v3/projects/9976c5873f814e7fa50641928520680b` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:35.394800 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9976c5873f814e7fa50641928520680b)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:35.399976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:35.475718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9976c5873f814e7fa50641928520680b', 'request_id': 'req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.477592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9ba55-d3a7-49bb-8803-f4adf4333a79 service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:35.480745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4ca9ba55-d3a7-49bb-8803-f4adf4333a79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:35.486355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9976c5873f814e7fa50641928520680b', 'request_id': 'req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.498203 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9976c5873f814e7fa50641928520680b', 'request_id': 'req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.498394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9ba55-d3a7-49bb-8803-f4adf4333a79 service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:35.514558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] The token cache is being invalidate because project 9976c5873f814e7fa50641928520680b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:35.514957 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.515692 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.517598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1026/2044] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:35 2022] DELETE /identity/v3/projects/9976c5873f814e7fa50641928520680b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:35.521348 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:35.522686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:35.569594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df9fd8-ee80-4f1d-8232-57365941d711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:35.570444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df9fd8-ee80-4f1d-8232-57365941d711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:35.571389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df9fd8-ee80-4f1d-8232-57365941d711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:35.571799 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df9fd8-ee80-4f1d-8232-57365941d711 admin admin] PATH_INFO: `/v3/users/de0808f807d64fda8181dc414695e234` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:35.573072 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df9fd8-ee80-4f1d-8232-57365941d711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0808f807d64fda8181dc414695e234)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:35.575359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df9fd8-ee80-4f1d-8232-57365941d711 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:35.628178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a5df9fd8-ee80-4f1d-8232-57365941d711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0808f807d64fda8181dc414695e234'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.629209 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a5df9fd8-ee80-4f1d-8232-57365941d711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0808f807d64fda8181dc414695e234'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.630032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a5df9fd8-ee80-4f1d-8232-57365941d711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0808f807d64fda8181dc414695e234'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.630640 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6a020-acf0-4f49-a13d-ee5eaedd16c3 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:35.637347 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265e8e2-8eac-448c-b487-b2c760e49e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:35.638716 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265e8e2-8eac-448c-b487-b2c760e49e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:35.638847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265e8e2-8eac-448c-b487-b2c760e49e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:35.639171 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265e8e2-8eac-448c-b487-b2c760e49e9c admin admin] PATH_INFO: `/v3/users/df2beb6cbf124a298f158ca73fd514fb` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:35.640422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265e8e2-8eac-448c-b487-b2c760e49e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2beb6cbf124a298f158ca73fd514fb)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:35.644263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265e8e2-8eac-448c-b487-b2c760e49e9c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:35.649064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a5df9fd8-ee80-4f1d-8232-57365941d711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0808f807d64fda8181dc414695e234'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.659484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a5df9fd8-ee80-4f1d-8232-57365941d711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0808f807d64fda8181dc414695e234'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.682327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1019/2045] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:35 2022] DELETE /identity/v3/users/de0808f807d64fda8181dc414695e234 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:35.684427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e214c36-9fee-4743-952a-0fdb151dcf26 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:35.684783 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e214c36-9fee-4743-952a-0fdb151dcf26 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:35.685073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e214c36-9fee-4743-952a-0fdb151dcf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:35.708567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-5e214c36-9fee-4743-952a-0fdb151dcf26 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:35.710228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-5e214c36-9fee-4743-952a-0fdb151dcf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:35.722425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5265e8e2-8eac-448c-b487-b2c760e49e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2beb6cbf124a298f158ca73fd514fb'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.723159 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5265e8e2-8eac-448c-b487-b2c760e49e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2beb6cbf124a298f158ca73fd514fb'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.740599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5265e8e2-8eac-448c-b487-b2c760e49e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2beb6cbf124a298f158ca73fd514fb'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.741359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5265e8e2-8eac-448c-b487-b2c760e49e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2beb6cbf124a298f158ca73fd514fb'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.749147 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5265e8e2-8eac-448c-b487-b2c760e49e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2beb6cbf124a298f158ca73fd514fb'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:35.765578 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1027/2046] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:35 2022] DELETE /identity/v3/users/df2beb6cbf124a298f158ca73fd514fb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:35.780092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1020/2047] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:35.791006 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265e8e2-8eac-448c-b487-b2c760e49e9c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:35.792534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5265e8e2-8eac-448c-b487-b2c760e49e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:35.850859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265e8e2-8eac-448c-b487-b2c760e49e9c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:35.855097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d464b16-69a2-401e-8db6-05ac8dd40611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:35.855742 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d464b16-69a2-401e-8db6-05ac8dd40611 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:35.856022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d464b16-69a2-401e-8db6-05ac8dd40611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:35.856297 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d464b16-69a2-401e-8db6-05ac8dd40611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:35.927180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d464b16-69a2-401e-8db6-05ac8dd40611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:35.928821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d464b16-69a2-401e-8db6-05ac8dd40611 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:35.940525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1028/2048] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:36.216585 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e214c36-9fee-4743-952a-0fdb151dcf26 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:36.218095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-5e214c36-9fee-4743-952a-0fdb151dcf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:36.243040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e214c36-9fee-4743-952a-0fdb151dcf26 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:36.254331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:36.255242 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:36.255572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:36.255859 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] PATH_INFO: `/v3/projects/ec74aafd4517490c9103f9ee04ec282b` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:36.260841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec74aafd4517490c9103f9ee04ec282b)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:36.263028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:36.353976 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec74aafd4517490c9103f9ee04ec282b', 'request_id': 'req-9b3f5087-0c06-4c94-a408-6461ab241556'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:36.370006 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec74aafd4517490c9103f9ee04ec282b', 'request_id': 'req-9b3f5087-0c06-4c94-a408-6461ab241556'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:36.378947 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec74aafd4517490c9103f9ee04ec282b', 'request_id': 'req-9b3f5087-0c06-4c94-a408-6461ab241556'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:36.401722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] The token cache is being invalidate because project ec74aafd4517490c9103f9ee04ec282b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:36.402473 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:36.402696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:36.407986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1021/2049] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:36 2022] DELETE /identity/v3/projects/ec74aafd4517490c9103f9ee04ec282b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:36.409826 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b49b47-28db-431b-9e5b-71a9f394bf1a None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:36.410322 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b49b47-28db-431b-9e5b-71a9f394bf1a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:36.410422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b49b47-28db-431b-9e5b-71a9f394bf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:36.443166 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:36.444953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-41b49b47-28db-431b-9e5b-71a9f394bf1a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:36.445119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:36.446340 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-41b49b47-28db-431b-9e5b-71a9f394bf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:36.556712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1029/2050] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:36.571786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63b0f9-0470-436b-8379-7091c5074303 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:36.572543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63b0f9-0470-436b-8379-7091c5074303 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:36.573249 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63b0f9-0470-436b-8379-7091c5074303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:36.596690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-9c63b0f9-0470-436b-8379-7091c5074303 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:36.598158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9c63b0f9-0470-436b-8379-7091c5074303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:36.615624 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1030/2051] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:36.620983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63b0f9-0470-436b-8379-7091c5074303 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:36.632008 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f5087-0c06-4c94-a408-6461ab241556 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:36.640362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62ea0a-518d-42be-aec8-aa330871359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:36.641966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62ea0a-518d-42be-aec8-aa330871359f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:36.642255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62ea0a-518d-42be-aec8-aa330871359f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:36.642534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62ea0a-518d-42be-aec8-aa330871359f admin admin] PATH_INFO: `/v3/projects/92da346f8d2e4fb88efc74af2244b7cb` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:36.642658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63b0f9-0470-436b-8379-7091c5074303 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:36.644368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62ea0a-518d-42be-aec8-aa330871359f admin admin] RBAC: Authorizing `identity:delete_project(project_id=92da346f8d2e4fb88efc74af2244b7cb)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:36.648066 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62ea0a-518d-42be-aec8-aa330871359f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:36.649236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3a100-3325-402a-80e1-4196b5f6d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:36.650225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3a100-3325-402a-80e1-4196b5f6d34c admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:36.650511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3a100-3325-402a-80e1-4196b5f6d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:36.651362 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3a100-3325-402a-80e1-4196b5f6d34c admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:36.652116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3a100-3325-402a-80e1-4196b5f6d34c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:36.652424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3a100-3325-402a-80e1-4196b5f6d34c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:36.654244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3a100-3325-402a-80e1-4196b5f6d34c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:36.676399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1031/2052] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:36.681472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3a100-3325-402a-80e1-4196b5f6d34c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:36.692263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3a100-3325-402a-80e1-4196b5f6d34c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:36.700185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1672ce-be19-49ba-83a0-53def2f91520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:36.700901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1672ce-be19-49ba-83a0-53def2f91520 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:36.701306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1672ce-be19-49ba-83a0-53def2f91520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:36.701629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1672ce-be19-49ba-83a0-53def2f91520 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:36.702331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1672ce-be19-49ba-83a0-53def2f91520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:36.704663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1672ce-be19-49ba-83a0-53def2f91520 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:36.723155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ca62ea0a-518d-42be-aec8-aa330871359f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92da346f8d2e4fb88efc74af2244b7cb', 'request_id': 'req-ca62ea0a-518d-42be-aec8-aa330871359f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:36.732334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ca62ea0a-518d-42be-aec8-aa330871359f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92da346f8d2e4fb88efc74af2244b7cb', 'request_id': 'req-ca62ea0a-518d-42be-aec8-aa330871359f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:36.736135 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1032/2053] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:36 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:36.738593 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ca62ea0a-518d-42be-aec8-aa330871359f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92da346f8d2e4fb88efc74af2244b7cb', 'request_id': 'req-ca62ea0a-518d-42be-aec8-aa330871359f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:36.739935 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1672ce-be19-49ba-83a0-53def2f91520 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:36.751558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ca62ea0a-518d-42be-aec8-aa330871359f admin admin] The token cache is being invalidate because project 92da346f8d2e4fb88efc74af2244b7cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:36.752065 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ca62ea0a-518d-42be-aec8-aa330871359f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:36.752926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ca62ea0a-518d-42be-aec8-aa330871359f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:36.755043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1022/2054] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:36 2022] DELETE /identity/v3/projects/92da346f8d2e4fb88efc74af2244b7cb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:36.760467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b823f01-1dd3-4412-8256-4bbbd808238a None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:36.761051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b823f01-1dd3-4412-8256-4bbbd808238a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:36.761553 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b823f01-1dd3-4412-8256-4bbbd808238a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:36.786581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-9b823f01-1dd3-4412-8256-4bbbd808238a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:36.788096 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9b823f01-1dd3-4412-8256-4bbbd808238a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:36.821783 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1672ce-be19-49ba-83a0-53def2f91520 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:36.829998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05932bed-a679-4285-acc8-2551b39b06bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:36.831808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05932bed-a679-4285-acc8-2551b39b06bc admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:36.832138 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05932bed-a679-4285-acc8-2551b39b06bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:36.832485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05932bed-a679-4285-acc8-2551b39b06bc admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:36.833219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05932bed-a679-4285-acc8-2551b39b06bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:36.835185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05932bed-a679-4285-acc8-2551b39b06bc admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:36.862713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1033/2055] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:36 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:36.867931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05932bed-a679-4285-acc8-2551b39b06bc admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:36.870135 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-05932bed-a679-4285-acc8-2551b39b06bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:36.875794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1023/2056] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:36.884447 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d024a-dfe1-42cb-b39c-788b76d2a38c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:36.884743 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d024a-dfe1-42cb-b39c-788b76d2a38c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:36.885073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d024a-dfe1-42cb-b39c-788b76d2a38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:36.891997 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05932bed-a679-4285-acc8-2551b39b06bc admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:36.897481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99e031-20ea-4e40-ba81-5fec9bfd1fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:36.898221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99e031-20ea-4e40-ba81-5fec9bfd1fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:36.898509 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99e031-20ea-4e40-ba81-5fec9bfd1fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:36.899073 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99e031-20ea-4e40-ba81-5fec9bfd1fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:36.899815 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99e031-20ea-4e40-ba81-5fec9bfd1fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:36.901484 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99e031-20ea-4e40-ba81-5fec9bfd1fa9 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:36.908995 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-2f1d024a-dfe1-42cb-b39c-788b76d2a38c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:36.910231 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2f1d024a-dfe1-42cb-b39c-788b76d2a38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:36.912846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1034/2057] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:43:36.916535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99e031-20ea-4e40-ba81-5fec9bfd1fa9 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:36.919294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1024/2058] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:36.923327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d024a-dfe1-42cb-b39c-788b76d2a38c None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:36.926338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99e031-20ea-4e40-ba81-5fec9bfd1fa9 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:36.931845 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e61da-8df7-4201-8d00-5b6fb486146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:36.932508 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e61da-8df7-4201-8d00-5b6fb486146f admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:36.932792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e61da-8df7-4201-8d00-5b6fb486146f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:36.933192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e61da-8df7-4201-8d00-5b6fb486146f admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:36.933923 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e61da-8df7-4201-8d00-5b6fb486146f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:36.934317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d024a-dfe1-42cb-b39c-788b76d2a38c None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:36.935551 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e61da-8df7-4201-8d00-5b6fb486146f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:36.939377 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9abd34-e05d-4f81-921b-b07cc7887022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:36.940272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9abd34-e05d-4f81-921b-b07cc7887022 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:36.940559 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9abd34-e05d-4f81-921b-b07cc7887022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:36.941082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9abd34-e05d-4f81-921b-b07cc7887022 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:36.941635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9abd34-e05d-4f81-921b-b07cc7887022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:36.941998 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9abd34-e05d-4f81-921b-b07cc7887022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:36.943696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9abd34-e05d-4f81-921b-b07cc7887022 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:36.951499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1035/2059] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:43:36.952367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e61da-8df7-4201-8d00-5b6fb486146f admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:36.958627 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1025/2060] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:43:36.962886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9abd34-e05d-4f81-921b-b07cc7887022 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:36.964928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e61da-8df7-4201-8d00-5b6fb486146f admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:36.972510 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9abd34-e05d-4f81-921b-b07cc7887022 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:36.972622 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc8088-0c0e-47cf-aef4-2cfa70d6f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:36.973729 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc8088-0c0e-47cf-aef4-2cfa70d6f03f admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:36.974074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc8088-0c0e-47cf-aef4-2cfa70d6f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:36.974491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc8088-0c0e-47cf-aef4-2cfa70d6f03f admin admin] PATH_INFO: `/v3/projects/ae6e609986be4d93bbf496e2c3f9c844/users/4eaaa473eb23412f88b0019f9ebecd44/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:36.977873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ef4ad-5486-48a0-a6e3-83d43e081bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:36.978527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ef4ad-5486-48a0-a6e3-83d43e081bde admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:36.978846 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ef4ad-5486-48a0-a6e3-83d43e081bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:36.979124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ef4ad-5486-48a0-a6e3-83d43e081bde admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:36.979810 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ef4ad-5486-48a0-a6e3-83d43e081bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:36.982334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ef4ad-5486-48a0-a6e3-83d43e081bde admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:36.989445 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc8088-0c0e-47cf-aef4-2cfa70d6f03f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6e609986be4d93bbf496e2c3f9c844, user_id=4eaaa473eb23412f88b0019f9ebecd44, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:36.992167 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc8088-0c0e-47cf-aef4-2cfa70d6f03f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.006254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1036/2061] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:36 2022] PUT /identity/v3/projects/ae6e609986be4d93bbf496e2c3f9c844/users/4eaaa473eb23412f88b0019f9ebecd44/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:37.017560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1026/2062] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:36 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:37.018490 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454036d-6e00-40a4-96c3-f02c2b85bf46 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.018818 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454036d-6e00-40a4-96c3-f02c2b85bf46 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.019101 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454036d-6e00-40a4-96c3-f02c2b85bf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.021651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ef4ad-5486-48a0-a6e3-83d43e081bde admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.046505 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-2454036d-6e00-40a4-96c3-f02c2b85bf46 None None] MFA Rules not processed for user `4eaaa473eb23412f88b0019f9ebecd44`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:37.047673 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-2454036d-6e00-40a4-96c3-f02c2b85bf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:37.084275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ef4ad-5486-48a0-a6e3-83d43e081bde admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:37.089040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98d81f-434d-430c-a0c5-9bd2146bf878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:37.089718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d81f-434d-430c-a0c5-9bd2146bf878 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.089998 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d81f-434d-430c-a0c5-9bd2146bf878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.090273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98d81f-434d-430c-a0c5-9bd2146bf878 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.091006 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98d81f-434d-430c-a0c5-9bd2146bf878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:37.092971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98d81f-434d-430c-a0c5-9bd2146bf878 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.115758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1027/2063] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:37 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:37.121162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98d81f-434d-430c-a0c5-9bd2146bf878 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.122758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1037/2064] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:37.129085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454036d-6e00-40a4-96c3-f02c2b85bf46 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.137713 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98d81f-434d-430c-a0c5-9bd2146bf878 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:37.140701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454036d-6e00-40a4-96c3-f02c2b85bf46 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:37.142975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74221b47-2f10-4461-923c-bf010760bf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:37.143640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74221b47-2f10-4461-923c-bf010760bf27 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.143924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74221b47-2f10-4461-923c-bf010760bf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.144350 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74221b47-2f10-4461-923c-bf010760bf27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.145076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74221b47-2f10-4461-923c-bf010760bf27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:37.146712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74221b47-2f10-4461-923c-bf010760bf27 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.147667 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b265235-2b82-4396-b8df-92f4a77a0f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:37.148513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b265235-2b82-4396-b8df-92f4a77a0f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.150032 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b265235-2b82-4396-b8df-92f4a77a0f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.150032 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b265235-2b82-4396-b8df-92f4a77a0f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.150894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b265235-2b82-4396-b8df-92f4a77a0f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:37.153721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b265235-2b82-4396-b8df-92f4a77a0f4a admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.158702 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1028/2065] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:43:37.163201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74221b47-2f10-4461-923c-bf010760bf27 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.174085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74221b47-2f10-4461-923c-bf010760bf27 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:37.178741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533722d-6f44-40a2-955b-cf327515f782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:37.179381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533722d-6f44-40a2-955b-cf327515f782 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.179674 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533722d-6f44-40a2-955b-cf327515f782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.180474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533722d-6f44-40a2-955b-cf327515f782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.181390 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533722d-6f44-40a2-955b-cf327515f782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:37.183167 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533722d-6f44-40a2-955b-cf327515f782 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.191067 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1038/2066] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:37 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:37.194971 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b265235-2b82-4396-b8df-92f4a77a0f4a admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.198447 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1029/2067] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:37.202716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533722d-6f44-40a2-955b-cf327515f782 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.213226 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533722d-6f44-40a2-955b-cf327515f782 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:37.264321 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b265235-2b82-4396-b8df-92f4a77a0f4a admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:37.269294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721678b-e6ca-45b9-bd43-bbfe745a843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:37.269954 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721678b-e6ca-45b9-bd43-bbfe745a843c admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.270233 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721678b-e6ca-45b9-bd43-bbfe745a843c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.270617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721678b-e6ca-45b9-bd43-bbfe745a843c admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.270757 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96034e-6ef4-459f-be5e-e777ae2b0afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:37.271338 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721678b-e6ca-45b9-bd43-bbfe745a843c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:37.271547 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96034e-6ef4-459f-be5e-e777ae2b0afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.271823 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96034e-6ef4-459f-be5e-e777ae2b0afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.272091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96034e-6ef4-459f-be5e-e777ae2b0afe admin admin] PATH_INFO: `/v3/projects/bf6f10002a634eb7ab4519af389895d6/users/9b2a04f0f85a4cdfae96a14fc392073e/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.273383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721678b-e6ca-45b9-bd43-bbfe745a843c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.287186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96034e-6ef4-459f-be5e-e777ae2b0afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6f10002a634eb7ab4519af389895d6, user_id=9b2a04f0f85a4cdfae96a14fc392073e, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:37.291990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96034e-6ef4-459f-be5e-e777ae2b0afe admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.299579 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1039/2068] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:37 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:37.300973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721678b-e6ca-45b9-bd43-bbfe745a843c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.306043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1030/2069] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:37 2022] PUT /identity/v3/projects/bf6f10002a634eb7ab4519af389895d6/users/9b2a04f0f85a4cdfae96a14fc392073e/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:37.312976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721678b-e6ca-45b9-bd43-bbfe745a843c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:37.317226 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68973540-d44e-4f07-80d7-2e7adec69734 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.317514 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68973540-d44e-4f07-80d7-2e7adec69734 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.317792 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68973540-d44e-4f07-80d7-2e7adec69734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.344696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-68973540-d44e-4f07-80d7-2e7adec69734 None None] MFA Rules not processed for user `9b2a04f0f85a4cdfae96a14fc392073e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:37.345908 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-68973540-d44e-4f07-80d7-2e7adec69734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:37.372438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadfca8-f92d-425f-a4e4-3f0e17fa12fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:37.373114 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadfca8-f92d-425f-a4e4-3f0e17fa12fd admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.373401 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadfca8-f92d-425f-a4e4-3f0e17fa12fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.373678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadfca8-f92d-425f-a4e4-3f0e17fa12fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.374410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadfca8-f92d-425f-a4e4-3f0e17fa12fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:37.376252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadfca8-f92d-425f-a4e4-3f0e17fa12fd admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.389813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1040/2070] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:43:37.390651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadfca8-f92d-425f-a4e4-3f0e17fa12fd admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.401237 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadfca8-f92d-425f-a4e4-3f0e17fa12fd admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:37.413295 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dab88f-4020-4b7e-be7d-85877fd03346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:37.413970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dab88f-4020-4b7e-be7d-85877fd03346 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.414270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dab88f-4020-4b7e-be7d-85877fd03346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.415117 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dab88f-4020-4b7e-be7d-85877fd03346 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.415851 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dab88f-4020-4b7e-be7d-85877fd03346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:37.417572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dab88f-4020-4b7e-be7d-85877fd03346 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.421884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1031/2071] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:37.428021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1041/2072] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:43:37.432885 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68973540-d44e-4f07-80d7-2e7adec69734 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.437290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dab88f-4020-4b7e-be7d-85877fd03346 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.439218 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-29dab88f-4020-4b7e-be7d-85877fd03346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:37.443806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68973540-d44e-4f07-80d7-2e7adec69734 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:37.448786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3099d-2133-41ed-a4cf-eb78638b27ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:37.449685 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3099d-2133-41ed-a4cf-eb78638b27ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.450197 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3099d-2133-41ed-a4cf-eb78638b27ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.450491 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3099d-2133-41ed-a4cf-eb78638b27ba admin admin] PATH_INFO: `/v3/projects/f683d9602e4043d496f650173cf57102/users/97fec4650ab343e39ec33a936e065828/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.465958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3099d-2133-41ed-a4cf-eb78638b27ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f683d9602e4043d496f650173cf57102, user_id=97fec4650ab343e39ec33a936e065828, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:37.468968 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3099d-2133-41ed-a4cf-eb78638b27ba admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.485040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1032/2073] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:37 2022] PUT /identity/v3/projects/f683d9602e4043d496f650173cf57102/users/97fec4650ab343e39ec33a936e065828/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:37.496103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7aefb7-c33b-4feb-8b12-3b02795a4d38 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.496395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7aefb7-c33b-4feb-8b12-3b02795a4d38 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.496668 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7aefb7-c33b-4feb-8b12-3b02795a4d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.518189 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dab88f-4020-4b7e-be7d-85877fd03346 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:37.526988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ae7aefb7-c33b-4feb-8b12-3b02795a4d38 None None] MFA Rules not processed for user `97fec4650ab343e39ec33a936e065828`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:37.528159 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ae7aefb7-c33b-4feb-8b12-3b02795a4d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:37.597511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8da08-61cb-4fe2-8e79-cfde17f01417 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a003b6145fb4c5c8919020d9208afa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:37.598262 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8da08-61cb-4fe2-8e79-cfde17f01417 service glance] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.599119 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8da08-61cb-4fe2-8e79-cfde17f01417 service glance] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.599737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8da08-61cb-4fe2-8e79-cfde17f01417 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.603105 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1033/2074] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:37.607834 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7aefb7-c33b-4feb-8b12-3b02795a4d38 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.679725 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8da08-61cb-4fe2-8e79-cfde17f01417 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:37.681671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8da08-61cb-4fe2-8e79-cfde17f01417 service glance] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.692171 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1042/2075] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:37.702273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7aefb7-c33b-4feb-8b12-3b02795a4d38 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:37.707366 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960c6d3-3b54-4787-a1b3-2dd423f99859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:37.708028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960c6d3-3b54-4787-a1b3-2dd423f99859 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.708310 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960c6d3-3b54-4787-a1b3-2dd423f99859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.708584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960c6d3-3b54-4787-a1b3-2dd423f99859 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.709459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960c6d3-3b54-4787-a1b3-2dd423f99859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:37.712237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960c6d3-3b54-4787-a1b3-2dd423f99859 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.746511 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1034/2076] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:37 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:37.747999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8da08-61cb-4fe2-8e79-cfde17f01417 service glance] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.761154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8da08-61cb-4fe2-8e79-cfde17f01417 service glance] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:37.842287 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c90a06-3600-462f-b284-e994d88a9494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:37.843106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c90a06-3600-462f-b284-e994d88a9494 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.843592 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c90a06-3600-462f-b284-e994d88a9494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.843966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c90a06-3600-462f-b284-e994d88a9494 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.844989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c90a06-3600-462f-b284-e994d88a9494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:37.847876 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c90a06-3600-462f-b284-e994d88a9494 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.870926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1043/2077] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:37 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:37.874881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960c6d3-3b54-4787-a1b3-2dd423f99859 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.885512 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960c6d3-3b54-4787-a1b3-2dd423f99859 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:37.890170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d2f85-dedb-40e2-8595-16b0db02cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:37.890902 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d2f85-dedb-40e2-8595-16b0db02cc57 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.891184 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d2f85-dedb-40e2-8595-16b0db02cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.891900 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d2f85-dedb-40e2-8595-16b0db02cc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.892692 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d2f85-dedb-40e2-8595-16b0db02cc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:37.894291 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d2f85-dedb-40e2-8595-16b0db02cc57 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.910086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1035/2078] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:37.911213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c90a06-3600-462f-b284-e994d88a9494 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.921585 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c90a06-3600-462f-b284-e994d88a9494 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:37.926256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3a4a6-31c3-443c-9142-29699c2c37df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:37.927207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a4a6-31c3-443c-9142-29699c2c37df admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:37.927491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a4a6-31c3-443c-9142-29699c2c37df admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:37.927762 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3a4a6-31c3-443c-9142-29699c2c37df admin admin] PATH_INFO: `/v3/projects/0595a0ecaa834a8b825c539f46bd7588/users/1063a844da234597a0fde4cc5dd5a80f/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:37.944293 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3a4a6-31c3-443c-9142-29699c2c37df admin admin] RBAC: Authorizing `identity:create_grant(project_id=0595a0ecaa834a8b825c539f46bd7588, user_id=1063a844da234597a0fde4cc5dd5a80f, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:37.947989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3a4a6-31c3-443c-9142-29699c2c37df admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:37.961325 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1044/2079] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:37 2022] PUT /identity/v3/projects/0595a0ecaa834a8b825c539f46bd7588/users/1063a844da234597a0fde4cc5dd5a80f/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:37.965767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d2f85-dedb-40e2-8595-16b0db02cc57 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:37.976281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d2f85-dedb-40e2-8595-16b0db02cc57 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:38.047282 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11a3cb-8c8a-431f-8fa0-9d51039f94aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:38.048157 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a3cb-8c8a-431f-8fa0-9d51039f94aa admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:38.048463 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a3cb-8c8a-431f-8fa0-9d51039f94aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:38.048770 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a3cb-8c8a-431f-8fa0-9d51039f94aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:38.049551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11a3cb-8c8a-431f-8fa0-9d51039f94aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:38.051376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11a3cb-8c8a-431f-8fa0-9d51039f94aa admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:38.063608 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1036/2080] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:38.068862 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3a4a6-31c3-443c-9142-29699c2c37df admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:38.083032 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3a4a6-31c3-443c-9142-29699c2c37df admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:38.092153 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd614af9-82c8-435b-ac9b-9e167c9dcf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:38.093706 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd614af9-82c8-435b-ac9b-9e167c9dcf60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:38.094564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd614af9-82c8-435b-ac9b-9e167c9dcf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:38.095038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd614af9-82c8-435b-ac9b-9e167c9dcf60 admin admin] PATH_INFO: `/v3/projects/0595a0ecaa834a8b825c539f46bd7588/users/1063a844da234597a0fde4cc5dd5a80f/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:38.099159 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd614af9-82c8-435b-ac9b-9e167c9dcf60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0595a0ecaa834a8b825c539f46bd7588, user_id=1063a844da234597a0fde4cc5dd5a80f, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:38.102757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd614af9-82c8-435b-ac9b-9e167c9dcf60 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:38.114887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1045/2081] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:38 2022] PUT /identity/v3/projects/0595a0ecaa834a8b825c539f46bd7588/users/1063a844da234597a0fde4cc5dd5a80f/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:38.127474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba632dc-991f-4eab-99ed-2cdae20addbe None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:38.127771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba632dc-991f-4eab-99ed-2cdae20addbe None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:38.128052 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba632dc-991f-4eab-99ed-2cdae20addbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:38.157930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-2ba632dc-991f-4eab-99ed-2cdae20addbe None None] MFA Rules not processed for user `1063a844da234597a0fde4cc5dd5a80f`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:38.159540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2ba632dc-991f-4eab-99ed-2cdae20addbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:38.240907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1037/2082] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:38.254470 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd614af9-82c8-435b-ac9b-9e167c9dcf60 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:38.256717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-dd614af9-82c8-435b-ac9b-9e167c9dcf60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:38.320062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd614af9-82c8-435b-ac9b-9e167c9dcf60 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:38.324129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5542a-2f41-4713-82ea-1efaaf153bf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:38.324769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5542a-2f41-4713-82ea-1efaaf153bf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:38.325043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5542a-2f41-4713-82ea-1efaaf153bf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:38.325336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5542a-2f41-4713-82ea-1efaaf153bf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:38.383542 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5542a-2f41-4713-82ea-1efaaf153bf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:38.384813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5542a-2f41-4713-82ea-1efaaf153bf1 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:38.393782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1046/2083] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:39.150279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba632dc-991f-4eab-99ed-2cdae20addbe None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:39.152513 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2ba632dc-991f-4eab-99ed-2cdae20addbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:39.242914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba632dc-991f-4eab-99ed-2cdae20addbe None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:39.247493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0146766-1309-4d12-bb17-5cecb0653c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:39.248499 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0146766-1309-4d12-bb17-5cecb0653c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:39.248789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0146766-1309-4d12-bb17-5cecb0653c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:39.249064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0146766-1309-4d12-bb17-5cecb0653c4b admin admin] PATH_INFO: `/v3/users/3aa767912b9f4b19bd4d392c58940eff` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:39.250257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0146766-1309-4d12-bb17-5cecb0653c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa767912b9f4b19bd4d392c58940eff)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:39.252263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0146766-1309-4d12-bb17-5cecb0653c4b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:39.339073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c0146766-1309-4d12-bb17-5cecb0653c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa767912b9f4b19bd4d392c58940eff'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:39.340129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c0146766-1309-4d12-bb17-5cecb0653c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa767912b9f4b19bd4d392c58940eff'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:39.340806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c0146766-1309-4d12-bb17-5cecb0653c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa767912b9f4b19bd4d392c58940eff'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:39.355371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c0146766-1309-4d12-bb17-5cecb0653c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa767912b9f4b19bd4d392c58940eff'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:39.363072 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c0146766-1309-4d12-bb17-5cecb0653c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa767912b9f4b19bd4d392c58940eff'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:39.377533 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1038/2084] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:39 2022] DELETE /identity/v3/users/3aa767912b9f4b19bd4d392c58940eff => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:39.382082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266468b4-e907-46a7-acd5-7bafe17339bc None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:39.382590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266468b4-e907-46a7-acd5-7bafe17339bc None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:39.383110 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266468b4-e907-46a7-acd5-7bafe17339bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:39.403168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-266468b4-e907-46a7-acd5-7bafe17339bc None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:39.404473 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-266468b4-e907-46a7-acd5-7bafe17339bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:39.474301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1047/2085] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:39.486819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0146766-1309-4d12-bb17-5cecb0653c4b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:39.488307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c0146766-1309-4d12-bb17-5cecb0653c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:39.550345 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0146766-1309-4d12-bb17-5cecb0653c4b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:39.553959 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e01d3-ed2d-4477-b3de-bb17bcf2fda7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:39.554595 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e01d3-ed2d-4477-b3de-bb17bcf2fda7 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:39.554934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e01d3-ed2d-4477-b3de-bb17bcf2fda7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:39.555235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e01d3-ed2d-4477-b3de-bb17bcf2fda7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:39.564586 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e01d3-ed2d-4477-b3de-bb17bcf2fda7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:39.566253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e01d3-ed2d-4477-b3de-bb17bcf2fda7 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:39.576772 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1039/2086] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:39.715935 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266468b4-e907-46a7-acd5-7bafe17339bc None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:39.718069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-266468b4-e907-46a7-acd5-7bafe17339bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:39.736009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266468b4-e907-46a7-acd5-7bafe17339bc None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:39.743763 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c509a-4892-4dc2-b87a-2a0c53df7a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:39.745326 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c509a-4892-4dc2-b87a-2a0c53df7a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:39.745802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c509a-4892-4dc2-b87a-2a0c53df7a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:39.746518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c509a-4892-4dc2-b87a-2a0c53df7a74 admin admin] PATH_INFO: `/v3/users/ee6837a9c14d408c8b1da84f7862d144` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:39.748897 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c509a-4892-4dc2-b87a-2a0c53df7a74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6837a9c14d408c8b1da84f7862d144)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:39.752757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c509a-4892-4dc2-b87a-2a0c53df7a74 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:39.835484 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3a6c509a-4892-4dc2-b87a-2a0c53df7a74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6837a9c14d408c8b1da84f7862d144'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:39.836891 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3a6c509a-4892-4dc2-b87a-2a0c53df7a74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6837a9c14d408c8b1da84f7862d144'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:39.849476 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3a6c509a-4892-4dc2-b87a-2a0c53df7a74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6837a9c14d408c8b1da84f7862d144'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:39.850181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3a6c509a-4892-4dc2-b87a-2a0c53df7a74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6837a9c14d408c8b1da84f7862d144'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:39.862720 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3a6c509a-4892-4dc2-b87a-2a0c53df7a74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6837a9c14d408c8b1da84f7862d144'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:39.878148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1048/2087] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:39 2022] DELETE /identity/v3/users/ee6837a9c14d408c8b1da84f7862d144 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:39.886242 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e01d3-ed2d-4477-b3de-bb17bcf2fda7 service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:39.887737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-878e01d3-ed2d-4477-b3de-bb17bcf2fda7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:39.910072 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e01d3-ed2d-4477-b3de-bb17bcf2fda7 service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:39.968170 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c509a-4892-4dc2-b87a-2a0c53df7a74 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:39.969601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3a6c509a-4892-4dc2-b87a-2a0c53df7a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:39.979181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b6832-05df-47a4-9023-497da86cb4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:39.980142 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b6832-05df-47a4-9023-497da86cb4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:39.980504 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b6832-05df-47a4-9023-497da86cb4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:39.980845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b6832-05df-47a4-9023-497da86cb4af admin admin] PATH_INFO: `/v3/projects/b78f2909bbf4473698d472df75efa3fa` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:39.982192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b6832-05df-47a4-9023-497da86cb4af admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78f2909bbf4473698d472df75efa3fa)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:39.984225 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b6832-05df-47a4-9023-497da86cb4af admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.040196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c509a-4892-4dc2-b87a-2a0c53df7a74 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.042150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-097b6832-05df-47a4-9023-497da86cb4af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78f2909bbf4473698d472df75efa3fa', 'request_id': 'req-097b6832-05df-47a4-9023-497da86cb4af'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:40.050879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-097b6832-05df-47a4-9023-497da86cb4af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78f2909bbf4473698d472df75efa3fa', 'request_id': 'req-097b6832-05df-47a4-9023-497da86cb4af'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:40.058794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-097b6832-05df-47a4-9023-497da86cb4af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78f2909bbf4473698d472df75efa3fa', 'request_id': 'req-097b6832-05df-47a4-9023-497da86cb4af'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:40.076791 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-097b6832-05df-47a4-9023-497da86cb4af admin admin] The token cache is being invalidate because project b78f2909bbf4473698d472df75efa3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:40.077090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-097b6832-05df-47a4-9023-497da86cb4af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:40.077761 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-097b6832-05df-47a4-9023-497da86cb4af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:40.079475 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1040/2088] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:39 2022] DELETE /identity/v3/projects/b78f2909bbf4473698d472df75efa3fa => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:40.088099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee74a1-68ae-45f4-b709-1748efaf2c77 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.088397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee74a1-68ae-45f4-b709-1748efaf2c77 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.088692 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee74a1-68ae-45f4-b709-1748efaf2c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.097759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df97fe-255a-498f-8ac2-ebb63c8059bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.097759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df97fe-255a-498f-8ac2-ebb63c8059bd service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.098031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df97fe-255a-498f-8ac2-ebb63c8059bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.098428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df97fe-255a-498f-8ac2-ebb63c8059bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.100526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-36df97fe-255a-498f-8ac2-ebb63c8059bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:40.118734 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-f7ee74a1-68ae-45f4-b709-1748efaf2c77 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:40.120069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f7ee74a1-68ae-45f4-b709-1748efaf2c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:40.166153 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df97fe-255a-498f-8ac2-ebb63c8059bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.167623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df97fe-255a-498f-8ac2-ebb63c8059bd service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.178081 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1049/2089] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:40.178971 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df97fe-255a-498f-8ac2-ebb63c8059bd service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:40.181019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-36df97fe-255a-498f-8ac2-ebb63c8059bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:40.182787 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1041/2090] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:40.197148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df97fe-255a-498f-8ac2-ebb63c8059bd service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.199591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057705b-4ec7-4333-b326-88d24f09f27d None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.199875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057705b-4ec7-4333-b326-88d24f09f27d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.200237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057705b-4ec7-4333-b326-88d24f09f27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.206858 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c64ebc-35fe-4845-95db-6a8001a7871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.207719 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64ebc-35fe-4845-95db-6a8001a7871d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.207995 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64ebc-35fe-4845-95db-6a8001a7871d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.208263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64ebc-35fe-4845-95db-6a8001a7871d admin admin] PATH_INFO: `/v3/projects/502fa29d3bf3465d8616f5e9286733eb` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.212092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c64ebc-35fe-4845-95db-6a8001a7871d admin admin] RBAC: Authorizing `identity:delete_project(project_id=502fa29d3bf3465d8616f5e9286733eb)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.218920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c64ebc-35fe-4845-95db-6a8001a7871d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.226508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-6057705b-4ec7-4333-b326-88d24f09f27d None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:40.228819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-6057705b-4ec7-4333-b326-88d24f09f27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:40.244224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1042/2091] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:40.245547 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057705b-4ec7-4333-b326-88d24f09f27d None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:40.255243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057705b-4ec7-4333-b326-88d24f09f27d None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.266804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6a3a2-d8d3-46ec-8477-166c5be2cd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.268802 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a3a2-d8d3-46ec-8477-166c5be2cd5e admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.269240 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a3a2-d8d3-46ec-8477-166c5be2cd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.269753 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a3a2-d8d3-46ec-8477-166c5be2cd5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.271340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6a3a2-d8d3-46ec-8477-166c5be2cd5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:40.271823 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6a3a2-d8d3-46ec-8477-166c5be2cd5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.275329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6a3a2-d8d3-46ec-8477-166c5be2cd5e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.292108 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1043/2092] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:40.297215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6a3a2-d8d3-46ec-8477-166c5be2cd5e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:40.300490 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-21c64ebc-35fe-4845-95db-6a8001a7871d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502fa29d3bf3465d8616f5e9286733eb', 'request_id': 'req-21c64ebc-35fe-4845-95db-6a8001a7871d'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:40.310066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-21c64ebc-35fe-4845-95db-6a8001a7871d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502fa29d3bf3465d8616f5e9286733eb', 'request_id': 'req-21c64ebc-35fe-4845-95db-6a8001a7871d'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:40.317422 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6a3a2-d8d3-46ec-8477-166c5be2cd5e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.318024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-21c64ebc-35fe-4845-95db-6a8001a7871d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502fa29d3bf3465d8616f5e9286733eb', 'request_id': 'req-21c64ebc-35fe-4845-95db-6a8001a7871d'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:40.334980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-21c64ebc-35fe-4845-95db-6a8001a7871d admin admin] The token cache is being invalidate because project 502fa29d3bf3465d8616f5e9286733eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:40.335259 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-21c64ebc-35fe-4845-95db-6a8001a7871d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:40.336063 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-21c64ebc-35fe-4845-95db-6a8001a7871d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:40.342976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1050/2093] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:40 2022] DELETE /identity/v3/projects/502fa29d3bf3465d8616f5e9286733eb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:40.344379 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d8f5e-3a24-4817-883c-4ec9809c4052 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.344666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d8f5e-3a24-4817-883c-4ec9809c4052 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.344943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d8f5e-3a24-4817-883c-4ec9809c4052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.365675 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-905d8f5e-3a24-4817-883c-4ec9809c4052 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:40.367004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-905d8f5e-3a24-4817-883c-4ec9809c4052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:40.391694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d087e-db0a-4d2e-9a94-1ac6e1bbc404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.391970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d087e-db0a-4d2e-9a94-1ac6e1bbc404 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.392316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d087e-db0a-4d2e-9a94-1ac6e1bbc404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.392657 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d087e-db0a-4d2e-9a94-1ac6e1bbc404 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.393543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d087e-db0a-4d2e-9a94-1ac6e1bbc404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.395685 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d087e-db0a-4d2e-9a94-1ac6e1bbc404 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.432542 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1044/2094] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:40 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:40.439405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d087e-db0a-4d2e-9a94-1ac6e1bbc404 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:40.441696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-173d087e-db0a-4d2e-9a94-1ac6e1bbc404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:40.471651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1051/2095] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:40.476171 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c2950-a4fa-45da-8c4a-7da1fd313dd9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.476849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c2950-a4fa-45da-8c4a-7da1fd313dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.477277 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c2950-a4fa-45da-8c4a-7da1fd313dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.502428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-2e2c2950-a4fa-45da-8c4a-7da1fd313dd9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:40.503904 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-2e2c2950-a4fa-45da-8c4a-7da1fd313dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:40.537455 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d087e-db0a-4d2e-9a94-1ac6e1bbc404 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.547049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ef822-b8e8-41d5-b39c-9f5ee5f99aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.548207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ef822-b8e8-41d5-b39c-9f5ee5f99aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.548618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ef822-b8e8-41d5-b39c-9f5ee5f99aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.549035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ef822-b8e8-41d5-b39c-9f5ee5f99aeb admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.553603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ef822-b8e8-41d5-b39c-9f5ee5f99aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.553603 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ef822-b8e8-41d5-b39c-9f5ee5f99aeb admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.582172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1045/2096] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:40 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:40.586958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ef822-b8e8-41d5-b39c-9f5ee5f99aeb admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:40.591740 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1052/2097] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:40.597419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c2950-a4fa-45da-8c4a-7da1fd313dd9 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:40.604944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ef822-b8e8-41d5-b39c-9f5ee5f99aeb admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.608380 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c2950-a4fa-45da-8c4a-7da1fd313dd9 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.609876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cbf5b-5ab1-49f1-b4ab-8d86a2f195ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.610618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cbf5b-5ab1-49f1-b4ab-8d86a2f195ff admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.611062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cbf5b-5ab1-49f1-b4ab-8d86a2f195ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.611413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cbf5b-5ab1-49f1-b4ab-8d86a2f195ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.612265 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cbf5b-5ab1-49f1-b4ab-8d86a2f195ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.614144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cbf5b-5ab1-49f1-b4ab-8d86a2f195ff admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.614750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660cfdc-f7d4-49a4-890e-e7abf17092cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.615465 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660cfdc-f7d4-49a4-890e-e7abf17092cd admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.615753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660cfdc-f7d4-49a4-890e-e7abf17092cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.616030 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660cfdc-f7d4-49a4-890e-e7abf17092cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.616759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660cfdc-f7d4-49a4-890e-e7abf17092cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:40.617068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660cfdc-f7d4-49a4-890e-e7abf17092cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.619584 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660cfdc-f7d4-49a4-890e-e7abf17092cd admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.625776 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1046/2098] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:43:40.631555 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cbf5b-5ab1-49f1-b4ab-8d86a2f195ff admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:40.636691 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1053/2099] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:40.637840 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660cfdc-f7d4-49a4-890e-e7abf17092cd admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:40.641970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cbf5b-5ab1-49f1-b4ab-8d86a2f195ff admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.647302 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426c84e-c99a-44d5-b2d1-ef5a5a93a509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.647984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426c84e-c99a-44d5-b2d1-ef5a5a93a509 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.648316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426c84e-c99a-44d5-b2d1-ef5a5a93a509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.648458 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660cfdc-f7d4-49a4-890e-e7abf17092cd admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.649113 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426c84e-c99a-44d5-b2d1-ef5a5a93a509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.649939 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426c84e-c99a-44d5-b2d1-ef5a5a93a509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.651584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426c84e-c99a-44d5-b2d1-ef5a5a93a509 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.657848 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e3c84-fa3b-4137-ac02-39f182c3a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.658628 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e3c84-fa3b-4137-ac02-39f182c3a84a admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.659058 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e3c84-fa3b-4137-ac02-39f182c3a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.659842 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e3c84-fa3b-4137-ac02-39f182c3a84a admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.660401 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e3c84-fa3b-4137-ac02-39f182c3a84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.662125 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1047/2100] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:43:40.663521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e3c84-fa3b-4137-ac02-39f182c3a84a admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.667186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426c84e-c99a-44d5-b2d1-ef5a5a93a509 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:40.678094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426c84e-c99a-44d5-b2d1-ef5a5a93a509 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.683746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb9919-507f-4ab0-b90c-e41c223c2d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.684708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb9919-507f-4ab0-b90c-e41c223c2d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.684943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb9919-507f-4ab0-b90c-e41c223c2d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.685196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb9919-507f-4ab0-b90c-e41c223c2d43 admin admin] PATH_INFO: `/v3/projects/a8ddfd37f3a0434aadf94bbc2f0f3ba0/users/50b373d1b25d4dfea4b318769e1a40dd/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.695920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1054/2101] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:40 2022] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:40.699836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e3c84-fa3b-4137-ac02-39f182c3a84a admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:40.704611 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb9919-507f-4ab0-b90c-e41c223c2d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ddfd37f3a0434aadf94bbc2f0f3ba0, user_id=50b373d1b25d4dfea4b318769e1a40dd, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.707528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb9919-507f-4ab0-b90c-e41c223c2d43 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.736272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1048/2102] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:40 2022] PUT /identity/v3/projects/a8ddfd37f3a0434aadf94bbc2f0f3ba0/users/50b373d1b25d4dfea4b318769e1a40dd/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:40.737899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94b173-604e-4f41-929f-8c789dccba22 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.738186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94b173-604e-4f41-929f-8c789dccba22 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.738463 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94b173-604e-4f41-929f-8c789dccba22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.769954 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-4d94b173-604e-4f41-929f-8c789dccba22 None None] MFA Rules not processed for user `50b373d1b25d4dfea4b318769e1a40dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:40.771283 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4d94b173-604e-4f41-929f-8c789dccba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:40.780874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e3c84-fa3b-4137-ac02-39f182c3a84a admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.847370 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f23d38-e502-439c-9d81-b3299a1b3719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.847992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f23d38-e502-439c-9d81-b3299a1b3719 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.848407 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f23d38-e502-439c-9d81-b3299a1b3719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.848688 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f23d38-e502-439c-9d81-b3299a1b3719 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.849562 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f23d38-e502-439c-9d81-b3299a1b3719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.850056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1049/2103] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:40.851643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f23d38-e502-439c-9d81-b3299a1b3719 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.855090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94b173-604e-4f41-929f-8c789dccba22 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:40.867179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94b173-604e-4f41-929f-8c789dccba22 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.874358 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ee0ca-dd4f-41ea-9f33-a0337dd9273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.875272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ee0ca-dd4f-41ea-9f33-a0337dd9273e admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.875617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ee0ca-dd4f-41ea-9f33-a0337dd9273e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.875996 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ee0ca-dd4f-41ea-9f33-a0337dd9273e admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.876832 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ee0ca-dd4f-41ea-9f33-a0337dd9273e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.877822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1055/2104] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:40 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:40.878910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f23d38-e502-439c-9d81-b3299a1b3719 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:40.879310 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ee0ca-dd4f-41ea-9f33-a0337dd9273e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.889788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f23d38-e502-439c-9d81-b3299a1b3719 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.895433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472e2f0-cc88-42b3-884c-9c96803393c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.896101 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472e2f0-cc88-42b3-884c-9c96803393c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.896389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472e2f0-cc88-42b3-884c-9c96803393c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.896659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472e2f0-cc88-42b3-884c-9c96803393c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.897411 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472e2f0-cc88-42b3-884c-9c96803393c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.899139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472e2f0-cc88-42b3-884c-9c96803393c0 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.912311 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1050/2105] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:40 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:40.912419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1056/2106] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:40.913096 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ee0ca-dd4f-41ea-9f33-a0337dd9273e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:40.915326 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472e2f0-cc88-42b3-884c-9c96803393c0 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:40.926723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472e2f0-cc88-42b3-884c-9c96803393c0 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.980309 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ee0ca-dd4f-41ea-9f33-a0337dd9273e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:40.985013 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dddcf-278a-4f2d-aaf2-7db01aa2aefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.985676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dddcf-278a-4f2d-aaf2-7db01aa2aefe admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.985959 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dddcf-278a-4f2d-aaf2-7db01aa2aefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.986236 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dddcf-278a-4f2d-aaf2-7db01aa2aefe admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.987032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487dddcf-278a-4f2d-aaf2-7db01aa2aefe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.989089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487dddcf-278a-4f2d-aaf2-7db01aa2aefe admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:40.989538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cc21e-5026-48f5-837c-ef972fd0f782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:40.990207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc21e-5026-48f5-837c-ef972fd0f782 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:40.990480 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc21e-5026-48f5-837c-ef972fd0f782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:40.990787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc21e-5026-48f5-837c-ef972fd0f782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:40.991511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cc21e-5026-48f5-837c-ef972fd0f782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:40.993138 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cc21e-5026-48f5-837c-ef972fd0f782 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:41.004549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1057/2107] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:41.004549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cc21e-5026-48f5-837c-ef972fd0f782 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:41.006749 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-762cc21e-5026-48f5-837c-ef972fd0f782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:41.010051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1051/2108] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:40 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:41.010975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dddcf-278a-4f2d-aaf2-7db01aa2aefe admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:41.025094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dddcf-278a-4f2d-aaf2-7db01aa2aefe admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:41.029898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9b0a5-646b-41f3-8f20-bcc02c6be89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:41.030818 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9b0a5-646b-41f3-8f20-bcc02c6be89f admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.031101 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9b0a5-646b-41f3-8f20-bcc02c6be89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.031363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9b0a5-646b-41f3-8f20-bcc02c6be89f admin admin] PATH_INFO: `/v3/projects/bcee5099fd2b4df2adaa069af3a45733/users/ee532b08897148dd9ff0482a00f537f7/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:41.046752 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9b0a5-646b-41f3-8f20-bcc02c6be89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcee5099fd2b4df2adaa069af3a45733, user_id=ee532b08897148dd9ff0482a00f537f7, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:41.049392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9b0a5-646b-41f3-8f20-bcc02c6be89f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:41.075343 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1052/2109] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:41 2022] PUT /identity/v3/projects/bcee5099fd2b4df2adaa069af3a45733/users/ee532b08897148dd9ff0482a00f537f7/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:41.076556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9b0a5-646b-41f3-8f20-bcc02c6be89f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:41.078872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cc21e-5026-48f5-837c-ef972fd0f782 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:41.129248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b4c72-1cad-4125-88af-b5199a017ddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:41.129878 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b4c72-1cad-4125-88af-b5199a017ddf service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.130159 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b4c72-1cad-4125-88af-b5199a017ddf service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.130437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b4c72-1cad-4125-88af-b5199a017ddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:41.132298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-343b4c72-1cad-4125-88af-b5199a017ddf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:41.140314 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9b0a5-646b-41f3-8f20-bcc02c6be89f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:41.145412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34cef4-fff1-4a97-bb1b-e1e815ec8737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:41.146245 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34cef4-fff1-4a97-bb1b-e1e815ec8737 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.146352 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34cef4-fff1-4a97-bb1b-e1e815ec8737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.146619 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34cef4-fff1-4a97-bb1b-e1e815ec8737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:41.147380 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34cef4-fff1-4a97-bb1b-e1e815ec8737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:41.149039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34cef4-fff1-4a97-bb1b-e1e815ec8737 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:41.159856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1053/2110] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:41.161179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95fa43-205c-4c82-95b8-721367588d1e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.161465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95fa43-205c-4c82-95b8-721367588d1e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.161740 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95fa43-205c-4c82-95b8-721367588d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:41.179395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-5f95fa43-205c-4c82-95b8-721367588d1e None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:41.181199 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-5f95fa43-205c-4c82-95b8-721367588d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:41.188866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1054/2111] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:41.189746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95fa43-205c-4c82-95b8-721367588d1e None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:41.199111 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b4c72-1cad-4125-88af-b5199a017ddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:41.200576 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b4c72-1cad-4125-88af-b5199a017ddf service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:41.205039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95fa43-205c-4c82-95b8-721367588d1e None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:41.209890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ee5bb-2787-433e-b98b-d2e2b6bf651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:41.210697 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ee5bb-2787-433e-b98b-d2e2b6bf651e admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.210852 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1058/2112] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:41.211809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b4c72-1cad-4125-88af-b5199a017ddf service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:41.213164 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-343b4c72-1cad-4125-88af-b5199a017ddf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:41.215033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ee5bb-2787-433e-b98b-d2e2b6bf651e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.215455 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ee5bb-2787-433e-b98b-d2e2b6bf651e admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:41.216379 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ee5bb-2787-433e-b98b-d2e2b6bf651e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:41.218010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ee5bb-2787-433e-b98b-d2e2b6bf651e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:41.229372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1055/2113] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:41.233491 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ee5bb-2787-433e-b98b-d2e2b6bf651e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:41.245901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ee5bb-2787-433e-b98b-d2e2b6bf651e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:41.252541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176b025-680b-47da-8b6b-d64fb157be30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:41.253471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176b025-680b-47da-8b6b-d64fb157be30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.253751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176b025-680b-47da-8b6b-d64fb157be30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.254025 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176b025-680b-47da-8b6b-d64fb157be30 admin admin] PATH_INFO: `/v3/projects/4528ad23096b418087b8721ce74eac67/users/cab53f814192479eac410a1b07cfd79d/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:41.276029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176b025-680b-47da-8b6b-d64fb157be30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4528ad23096b418087b8721ce74eac67, user_id=cab53f814192479eac410a1b07cfd79d, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:41.278944 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b4c72-1cad-4125-88af-b5199a017ddf service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:41.279193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176b025-680b-47da-8b6b-d64fb157be30 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:41.282712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa54d4-807e-4dbb-a3d9-54fb20ff2f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:41.283360 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa54d4-807e-4dbb-a3d9-54fb20ff2f19 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.283680 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa54d4-807e-4dbb-a3d9-54fb20ff2f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.283947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa54d4-807e-4dbb-a3d9-54fb20ff2f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:41.295857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa54d4-807e-4dbb-a3d9-54fb20ff2f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:41.297296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa54d4-807e-4dbb-a3d9-54fb20ff2f19 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:41.300654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1056/2114] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:41 2022] PUT /identity/v3/projects/4528ad23096b418087b8721ce74eac67/users/cab53f814192479eac410a1b07cfd79d/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:41.310927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a02d6d-3a3d-4e88-a836-a520d4189d84 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.311443 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a02d6d-3a3d-4e88-a836-a520d4189d84 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.312019 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a02d6d-3a3d-4e88-a836-a520d4189d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:41.317191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1059/2115] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:41.348519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-01a02d6d-3a3d-4e88-a836-a520d4189d84 None None] MFA Rules not processed for user `cab53f814192479eac410a1b07cfd79d`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:41.349754 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-01a02d6d-3a3d-4e88-a836-a520d4189d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:41.428179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1057/2116] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:41.434062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa54d4-807e-4dbb-a3d9-54fb20ff2f19 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:41.444313 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa54d4-807e-4dbb-a3d9-54fb20ff2f19 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:41.507705 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4b0e9-9b42-444e-b030-987634c0d8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:41.509006 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4b0e9-9b42-444e-b030-987634c0d8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.509363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4b0e9-9b42-444e-b030-987634c0d8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.509636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4b0e9-9b42-444e-b030-987634c0d8b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:41.510337 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4b0e9-9b42-444e-b030-987634c0d8b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:41.512314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4b0e9-9b42-444e-b030-987634c0d8b6 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:41.545691 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1060/2117] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:41 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:41.546994 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a02d6d-3a3d-4e88-a836-a520d4189d84 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:41.558904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a02d6d-3a3d-4e88-a836-a520d4189d84 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:41.670904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a7161-c38c-43fa-a6ad-b58407902f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:41.671881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a7161-c38c-43fa-a6ad-b58407902f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.672987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a7161-c38c-43fa-a6ad-b58407902f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.673457 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a7161-c38c-43fa-a6ad-b58407902f7a admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:41.674453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a7161-c38c-43fa-a6ad-b58407902f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:41.680955 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a7161-c38c-43fa-a6ad-b58407902f7a admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:41.711860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1058/2118] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:41 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:41.716084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4b0e9-9b42-444e-b030-987634c0d8b6 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:41.729172 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4b0e9-9b42-444e-b030-987634c0d8b6 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:41.739044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac444b-cd00-4e53-8a2f-008ccd399cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:41.739802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac444b-cd00-4e53-8a2f-008ccd399cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.740041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac444b-cd00-4e53-8a2f-008ccd399cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.740317 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac444b-cd00-4e53-8a2f-008ccd399cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:41.741068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac444b-cd00-4e53-8a2f-008ccd399cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:41.743843 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac444b-cd00-4e53-8a2f-008ccd399cdd admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:41.758731 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1061/2119] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:41.763730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a7161-c38c-43fa-a6ad-b58407902f7a admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:41.775942 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a7161-c38c-43fa-a6ad-b58407902f7a admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:41.781114 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c028d7-e9f5-4d80-b80f-f63246ef9540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:41.782589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c028d7-e9f5-4d80-b80f-f63246ef9540 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.782589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c028d7-e9f5-4d80-b80f-f63246ef9540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.782589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c028d7-e9f5-4d80-b80f-f63246ef9540 admin admin] PATH_INFO: `/v3/projects/9adccd63bf0940bbb23a6a6a19c3ef04/users/313b9d0a6f214f55992d6a743254b7a6/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:41.801767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c028d7-e9f5-4d80-b80f-f63246ef9540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9adccd63bf0940bbb23a6a6a19c3ef04, user_id=313b9d0a6f214f55992d6a743254b7a6, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:41.805982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c028d7-e9f5-4d80-b80f-f63246ef9540 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:41.823814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1059/2120] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:41 2022] PUT /identity/v3/projects/9adccd63bf0940bbb23a6a6a19c3ef04/users/313b9d0a6f214f55992d6a743254b7a6/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:41.828022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac444b-cd00-4e53-8a2f-008ccd399cdd admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:41.838734 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac444b-cd00-4e53-8a2f-008ccd399cdd admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:41.906730 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80036915-e186-47e5-a962-cb806efb9846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:41.907241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80036915-e186-47e5-a962-cb806efb9846 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.907794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80036915-e186-47e5-a962-cb806efb9846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.908061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80036915-e186-47e5-a962-cb806efb9846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:41.908791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80036915-e186-47e5-a962-cb806efb9846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:41.910765 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80036915-e186-47e5-a962-cb806efb9846 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:41.928770 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1062/2121] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:41.930518 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c028d7-e9f5-4d80-b80f-f63246ef9540 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:41.943591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c028d7-e9f5-4d80-b80f-f63246ef9540 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:41.950467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ae0dd-444f-4201-ad9b-61031d3d5928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:41.951619 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ae0dd-444f-4201-ad9b-61031d3d5928 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.952066 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ae0dd-444f-4201-ad9b-61031d3d5928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.952418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ae0dd-444f-4201-ad9b-61031d3d5928 admin admin] PATH_INFO: `/v3/projects/9adccd63bf0940bbb23a6a6a19c3ef04/users/313b9d0a6f214f55992d6a743254b7a6/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:41.954908 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ae0dd-444f-4201-ad9b-61031d3d5928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9adccd63bf0940bbb23a6a6a19c3ef04, user_id=313b9d0a6f214f55992d6a743254b7a6, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:41.958218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ae0dd-444f-4201-ad9b-61031d3d5928 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:41.972562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1060/2122] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:41 2022] PUT /identity/v3/projects/9adccd63bf0940bbb23a6a6a19c3ef04/users/313b9d0a6f214f55992d6a743254b7a6/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:41.985465 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cd684-7ae0-40fd-8333-ea0a919cb5fc None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:41.985759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cd684-7ae0-40fd-8333-ea0a919cb5fc None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:41.986044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cd684-7ae0-40fd-8333-ea0a919cb5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:42.030187 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-cf5cd684-7ae0-40fd-8333-ea0a919cb5fc None None] MFA Rules not processed for user `313b9d0a6f214f55992d6a743254b7a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:42.031471 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-cf5cd684-7ae0-40fd-8333-ea0a919cb5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:42.130259 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1063/2123] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:42.139160 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ae0dd-444f-4201-ad9b-61031d3d5928 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:42.202229 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ae0dd-444f-4201-ad9b-61031d3d5928 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:42.206419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc965e-423f-45be-be8e-b4e0c1608dad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:42.207092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc965e-423f-45be-be8e-b4e0c1608dad service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:42.207372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc965e-423f-45be-be8e-b4e0c1608dad service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:42.207848 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc965e-423f-45be-be8e-b4e0c1608dad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:42.285711 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc965e-423f-45be-be8e-b4e0c1608dad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:42.290716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc965e-423f-45be-be8e-b4e0c1608dad service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:42.299327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1061/2124] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:44.032461 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cd684-7ae0-40fd-8333-ea0a919cb5fc None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:44.034138 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-cf5cd684-7ae0-40fd-8333-ea0a919cb5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:44.054301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cd684-7ae0-40fd-8333-ea0a919cb5fc None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:44.061972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e9bb-5d0e-4a97-82f2-0c25c4a84e91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:44.062824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e9bb-5d0e-4a97-82f2-0c25c4a84e91 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:44.063208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e9bb-5d0e-4a97-82f2-0c25c4a84e91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:44.063660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e9bb-5d0e-4a97-82f2-0c25c4a84e91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:44.138507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62e9bb-5d0e-4a97-82f2-0c25c4a84e91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:44.142041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62e9bb-5d0e-4a97-82f2-0c25c4a84e91 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:44.155160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1064/2125] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:45.062398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc965e-423f-45be-be8e-b4e0c1608dad service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:45.071963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc965e-423f-45be-be8e-b4e0c1608dad service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:45.075946 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df52d7e-6b50-4b3a-99a5-7cca22b1e8e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:45.076507 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df52d7e-6b50-4b3a-99a5-7cca22b1e8e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:45.076794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df52d7e-6b50-4b3a-99a5-7cca22b1e8e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:45.077286 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df52d7e-6b50-4b3a-99a5-7cca22b1e8e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:45.089641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df52d7e-6b50-4b3a-99a5-7cca22b1e8e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:45.091187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df52d7e-6b50-4b3a-99a5-7cca22b1e8e5 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:45.103641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1062/2126] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:45.536366 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e9bb-5d0e-4a97-82f2-0c25c4a84e91 service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:45.538622 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3b62e9bb-5d0e-4a97-82f2-0c25c4a84e91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:45.647141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e9bb-5d0e-4a97-82f2-0c25c4a84e91 service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:45.654417 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5fbc3-04ac-499e-86d7-86884735aac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:45.655440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5fbc3-04ac-499e-86d7-86884735aac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:45.655715 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5fbc3-04ac-499e-86d7-86884735aac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:45.656173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5fbc3-04ac-499e-86d7-86884735aac7 admin admin] PATH_INFO: `/v3/users/4eaaa473eb23412f88b0019f9ebecd44` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:45.660773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5fbc3-04ac-499e-86d7-86884735aac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eaaa473eb23412f88b0019f9ebecd44)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:45.662750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5fbc3-04ac-499e-86d7-86884735aac7 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:45.722017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7ac5fbc3-04ac-499e-86d7-86884735aac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eaaa473eb23412f88b0019f9ebecd44'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:45.723017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7ac5fbc3-04ac-499e-86d7-86884735aac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eaaa473eb23412f88b0019f9ebecd44'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:45.736076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7ac5fbc3-04ac-499e-86d7-86884735aac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eaaa473eb23412f88b0019f9ebecd44'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:45.737129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7ac5fbc3-04ac-499e-86d7-86884735aac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eaaa473eb23412f88b0019f9ebecd44'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:45.748318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7ac5fbc3-04ac-499e-86d7-86884735aac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eaaa473eb23412f88b0019f9ebecd44'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:45.765993 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1065/2127] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:45 2022] DELETE /identity/v3/users/4eaaa473eb23412f88b0019f9ebecd44 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:45.770683 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1938e61-0b16-4fc0-9879-c375e3f4a41c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:45.772077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1938e61-0b16-4fc0-9879-c375e3f4a41c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:45.772810 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1938e61-0b16-4fc0-9879-c375e3f4a41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:45.793586 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-b1938e61-0b16-4fc0-9879-c375e3f4a41c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:45.794823 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b1938e61-0b16-4fc0-9879-c375e3f4a41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:45.871494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1063/2128] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:45.880311 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5fbc3-04ac-499e-86d7-86884735aac7 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:45.882277 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-7ac5fbc3-04ac-499e-86d7-86884735aac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:46.052295 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5fbc3-04ac-499e-86d7-86884735aac7 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:46.073024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eee30-c2cd-479f-bd9e-f2469b75d42f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:46.073979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eee30-c2cd-479f-bd9e-f2469b75d42f service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:46.073979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eee30-c2cd-479f-bd9e-f2469b75d42f service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:46.074258 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eee30-c2cd-479f-bd9e-f2469b75d42f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:46.095063 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248eee30-c2cd-479f-bd9e-f2469b75d42f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:46.096588 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248eee30-c2cd-479f-bd9e-f2469b75d42f service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:46.119290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1066/2129] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:46.421587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d152f-938e-4d83-9801-afc0a46a64b7 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:46.421587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d152f-938e-4d83-9801-afc0a46a64b7 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:46.423112 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d152f-938e-4d83-9801-afc0a46a64b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:46.493760 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-549d152f-938e-4d83-9801-afc0a46a64b7 None None] MFA Rules not processed for user `ee532b08897148dd9ff0482a00f537f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:46.496558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-549d152f-938e-4d83-9801-afc0a46a64b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:46.619710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1064/2130] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:46.632422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd876a85-2bd7-4c2b-9512-8ef8b1c96c3e None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:46.633543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd876a85-2bd7-4c2b-9512-8ef8b1c96c3e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:46.633879 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd876a85-2bd7-4c2b-9512-8ef8b1c96c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:46.669208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-fd876a85-2bd7-4c2b-9512-8ef8b1c96c3e None None] MFA Rules not processed for user `ee532b08897148dd9ff0482a00f537f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:46.671042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-fd876a85-2bd7-4c2b-9512-8ef8b1c96c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:46.682301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d152f-938e-4d83-9801-afc0a46a64b7 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:46.684076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-549d152f-938e-4d83-9801-afc0a46a64b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:46.706335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d152f-938e-4d83-9801-afc0a46a64b7 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:46.708219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1067/2131] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:46.719696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd876a85-2bd7-4c2b-9512-8ef8b1c96c3e None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:46.721630 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-fd876a85-2bd7-4c2b-9512-8ef8b1c96c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:46.729764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:46.740249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:46.741033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:46.741737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] PATH_INFO: `/v3/projects/ae6e609986be4d93bbf496e2c3f9c844` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:46.744043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6e609986be4d93bbf496e2c3f9c844)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:46.746210 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:46.841235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6e609986be4d93bbf496e2c3f9c844', 'request_id': 'req-0e134751-e262-4d1d-aa97-20621a49dbdc'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:46.850051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6e609986be4d93bbf496e2c3f9c844', 'request_id': 'req-0e134751-e262-4d1d-aa97-20621a49dbdc'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:46.857110 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6e609986be4d93bbf496e2c3f9c844', 'request_id': 'req-0e134751-e262-4d1d-aa97-20621a49dbdc'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:46.864087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd876a85-2bd7-4c2b-9512-8ef8b1c96c3e None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:46.869744 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] The token cache is being invalidate because project ae6e609986be4d93bbf496e2c3f9c844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:46.870123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:46.871131 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:46.872835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1065/2132] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:46 2022] DELETE /identity/v3/projects/ae6e609986be4d93bbf496e2c3f9c844 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:46.876735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:46.878154 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:46.932744 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0de5ca-6c2c-4786-9421-32fcefc08be4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:46.933607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0de5ca-6c2c-4786-9421-32fcefc08be4 service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:46.933889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0de5ca-6c2c-4786-9421-32fcefc08be4 service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:46.934173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0de5ca-6c2c-4786-9421-32fcefc08be4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:46.937293 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-7a0de5ca-6c2c-4786-9421-32fcefc08be4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:46.949886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e134751-e262-4d1d-aa97-20621a49dbdc admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:46.957454 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1b377-a33f-4ba9-99e2-dc0e442415ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:46.958353 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b377-a33f-4ba9-99e2-dc0e442415ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:46.958645 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b377-a33f-4ba9-99e2-dc0e442415ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:46.958935 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b377-a33f-4ba9-99e2-dc0e442415ce admin admin] PATH_INFO: `/v3/users/97fec4650ab343e39ec33a936e065828` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:46.960158 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1b377-a33f-4ba9-99e2-dc0e442415ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=97fec4650ab343e39ec33a936e065828)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:46.962943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1b377-a33f-4ba9-99e2-dc0e442415ce admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:47.003744 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0de5ca-6c2c-4786-9421-32fcefc08be4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:47.005329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0de5ca-6c2c-4786-9421-32fcefc08be4 service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:47.011681 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-23f1b377-a33f-4ba9-99e2-dc0e442415ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97fec4650ab343e39ec33a936e065828'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:47.012349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-23f1b377-a33f-4ba9-99e2-dc0e442415ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97fec4650ab343e39ec33a936e065828'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:47.012974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-23f1b377-a33f-4ba9-99e2-dc0e442415ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97fec4650ab343e39ec33a936e065828'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:47.015115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1068/2133] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:47.026126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-23f1b377-a33f-4ba9-99e2-dc0e442415ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97fec4650ab343e39ec33a936e065828'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:47.032979 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-23f1b377-a33f-4ba9-99e2-dc0e442415ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97fec4650ab343e39ec33a936e065828'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:47.047903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1066/2134] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:46 2022] DELETE /identity/v3/users/97fec4650ab343e39ec33a936e065828 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:47.473674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0de5ca-6c2c-4786-9421-32fcefc08be4 service nova] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:47.492989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0de5ca-6c2c-4786-9421-32fcefc08be4 service nova] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:47.603452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98671e25-ebc1-4f72-a786-7eb076de47ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:47.604523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98671e25-ebc1-4f72-a786-7eb076de47ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:47.604802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98671e25-ebc1-4f72-a786-7eb076de47ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:47.605236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98671e25-ebc1-4f72-a786-7eb076de47ed admin admin] PATH_INFO: `/v3/projects/f683d9602e4043d496f650173cf57102` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:47.606422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98671e25-ebc1-4f72-a786-7eb076de47ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f683d9602e4043d496f650173cf57102)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:47.608411 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98671e25-ebc1-4f72-a786-7eb076de47ed admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:47.673127 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-98671e25-ebc1-4f72-a786-7eb076de47ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f683d9602e4043d496f650173cf57102', 'request_id': 'req-98671e25-ebc1-4f72-a786-7eb076de47ed'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:47.697007 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-98671e25-ebc1-4f72-a786-7eb076de47ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f683d9602e4043d496f650173cf57102', 'request_id': 'req-98671e25-ebc1-4f72-a786-7eb076de47ed'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:47.704496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-98671e25-ebc1-4f72-a786-7eb076de47ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f683d9602e4043d496f650173cf57102', 'request_id': 'req-98671e25-ebc1-4f72-a786-7eb076de47ed'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:47.723732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-98671e25-ebc1-4f72-a786-7eb076de47ed admin admin] The token cache is being invalidate because project f683d9602e4043d496f650173cf57102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:47.724023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-98671e25-ebc1-4f72-a786-7eb076de47ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:47.725612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-98671e25-ebc1-4f72-a786-7eb076de47ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:47.731038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1069/2135] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:47 2022] DELETE /identity/v3/projects/f683d9602e4043d496f650173cf57102 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:47.732451 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1b377-a33f-4ba9-99e2-dc0e442415ce admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:47.735679 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-23f1b377-a33f-4ba9-99e2-dc0e442415ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:47.751918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1b377-a33f-4ba9-99e2-dc0e442415ce admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:47.796053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba027cca-0c56-44c7-8cdc-c0108080a88a None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:47.796362 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba027cca-0c56-44c7-8cdc-c0108080a88a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:47.796615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba027cca-0c56-44c7-8cdc-c0108080a88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:47.829706 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ba027cca-0c56-44c7-8cdc-c0108080a88a None None] MFA Rules not processed for user `ee532b08897148dd9ff0482a00f537f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:47.832472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ba027cca-0c56-44c7-8cdc-c0108080a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:47.839080 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65855c70-062f-41e6-8d2a-482d794543aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:47.840295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65855c70-062f-41e6-8d2a-482d794543aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:47.840580 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65855c70-062f-41e6-8d2a-482d794543aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:47.840859 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65855c70-062f-41e6-8d2a-482d794543aa admin admin] PATH_INFO: `/v3/users/1063a844da234597a0fde4cc5dd5a80f` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:47.843972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65855c70-062f-41e6-8d2a-482d794543aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1063a844da234597a0fde4cc5dd5a80f)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:47.845984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65855c70-062f-41e6-8d2a-482d794543aa admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:47.934249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-65855c70-062f-41e6-8d2a-482d794543aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1063a844da234597a0fde4cc5dd5a80f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:47.935277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-65855c70-062f-41e6-8d2a-482d794543aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1063a844da234597a0fde4cc5dd5a80f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:47.936162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-65855c70-062f-41e6-8d2a-482d794543aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1063a844da234597a0fde4cc5dd5a80f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:47.947532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1070/2136] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:47.969019 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-65855c70-062f-41e6-8d2a-482d794543aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1063a844da234597a0fde4cc5dd5a80f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:47.978575 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-65855c70-062f-41e6-8d2a-482d794543aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1063a844da234597a0fde4cc5dd5a80f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:48.021626 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1067/2137] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:47 2022] DELETE /identity/v3/users/1063a844da234597a0fde4cc5dd5a80f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:49.304245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba027cca-0c56-44c7-8cdc-c0108080a88a None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:49.307304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ba027cca-0c56-44c7-8cdc-c0108080a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:49.332912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba027cca-0c56-44c7-8cdc-c0108080a88a None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:49.450613 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218f434-864b-478f-a89d-660c2693b6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:49.453630 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218f434-864b-478f-a89d-660c2693b6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:49.454160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218f434-864b-478f-a89d-660c2693b6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:49.455477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218f434-864b-478f-a89d-660c2693b6c0 admin admin] PATH_INFO: `/v3/projects/0595a0ecaa834a8b825c539f46bd7588` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:49.461160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218f434-864b-478f-a89d-660c2693b6c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0595a0ecaa834a8b825c539f46bd7588)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:49.465241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218f434-864b-478f-a89d-660c2693b6c0 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:49.578765 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6218f434-864b-478f-a89d-660c2693b6c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0595a0ecaa834a8b825c539f46bd7588', 'request_id': 'req-6218f434-864b-478f-a89d-660c2693b6c0'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:49.598296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6218f434-864b-478f-a89d-660c2693b6c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0595a0ecaa834a8b825c539f46bd7588', 'request_id': 'req-6218f434-864b-478f-a89d-660c2693b6c0'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:49.607299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6218f434-864b-478f-a89d-660c2693b6c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0595a0ecaa834a8b825c539f46bd7588', 'request_id': 'req-6218f434-864b-478f-a89d-660c2693b6c0'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:49.626174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6218f434-864b-478f-a89d-660c2693b6c0 admin admin] The token cache is being invalidate because project 0595a0ecaa834a8b825c539f46bd7588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:49.626545 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6218f434-864b-478f-a89d-660c2693b6c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:49.627764 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6218f434-864b-478f-a89d-660c2693b6c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:49.629977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1071/2138] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:49 2022] DELETE /identity/v3/projects/0595a0ecaa834a8b825c539f46bd7588 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:49.656202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65855c70-062f-41e6-8d2a-482d794543aa admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:49.658521 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-65855c70-062f-41e6-8d2a-482d794543aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:49.689183 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65855c70-062f-41e6-8d2a-482d794543aa admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:49.849302 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77daed22-e428-469d-8c8b-8a2756183a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:49.850224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daed22-e428-469d-8c8b-8a2756183a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:49.850508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daed22-e428-469d-8c8b-8a2756183a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:49.855665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daed22-e428-469d-8c8b-8a2756183a2c admin admin] PATH_INFO: `/v3/users/50b373d1b25d4dfea4b318769e1a40dd` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:49.861695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77daed22-e428-469d-8c8b-8a2756183a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50b373d1b25d4dfea4b318769e1a40dd)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:49.882409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77daed22-e428-469d-8c8b-8a2756183a2c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:49.999069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-77daed22-e428-469d-8c8b-8a2756183a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50b373d1b25d4dfea4b318769e1a40dd'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:50.000530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-77daed22-e428-469d-8c8b-8a2756183a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50b373d1b25d4dfea4b318769e1a40dd'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:50.001155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-77daed22-e428-469d-8c8b-8a2756183a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50b373d1b25d4dfea4b318769e1a40dd'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:50.035316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-77daed22-e428-469d-8c8b-8a2756183a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50b373d1b25d4dfea4b318769e1a40dd'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:50.066747 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-77daed22-e428-469d-8c8b-8a2756183a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50b373d1b25d4dfea4b318769e1a40dd'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:50.094228 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11067603-6a31-46b1-a2f6-f363d71e4828 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:50.094228 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11067603-6a31-46b1-a2f6-f363d71e4828 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:50.094228 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11067603-6a31-46b1-a2f6-f363d71e4828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:50.096609 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1068/2139] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:49 2022] DELETE /identity/v3/users/50b373d1b25d4dfea4b318769e1a40dd => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:50.115410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-11067603-6a31-46b1-a2f6-f363d71e4828 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:50.116859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-11067603-6a31-46b1-a2f6-f363d71e4828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:50.218241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1072/2140] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:50.228186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77daed22-e428-469d-8c8b-8a2756183a2c admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:50.231155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-77daed22-e428-469d-8c8b-8a2756183a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:50.353565 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77daed22-e428-469d-8c8b-8a2756183a2c admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:50.362361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4f511-5131-420b-8a56-627980840c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:50.363138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4f511-5131-420b-8a56-627980840c6d service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:50.363427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4f511-5131-420b-8a56-627980840c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:50.363730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4f511-5131-420b-8a56-627980840c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:50.385726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4f511-5131-420b-8a56-627980840c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:50.387213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4f511-5131-420b-8a56-627980840c6d service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:50.406068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1069/2141] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:50.448196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11067603-6a31-46b1-a2f6-f363d71e4828 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:50.451091 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-11067603-6a31-46b1-a2f6-f363d71e4828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:50.469191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11067603-6a31-46b1-a2f6-f363d71e4828 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:50.488663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf2327-a466-4e96-81d7-a3bc43378162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:50.489620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf2327-a466-4e96-81d7-a3bc43378162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:50.489852 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf2327-a466-4e96-81d7-a3bc43378162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:50.490425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf2327-a466-4e96-81d7-a3bc43378162 admin admin] PATH_INFO: `/v3/users/e81226dc11f7466d9645a2b95d628e17` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:50.496113 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf2327-a466-4e96-81d7-a3bc43378162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81226dc11f7466d9645a2b95d628e17)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:50.499001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf2327-a466-4e96-81d7-a3bc43378162 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:50.636569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-39bf2327-a466-4e96-81d7-a3bc43378162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81226dc11f7466d9645a2b95d628e17'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:50.637779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-39bf2327-a466-4e96-81d7-a3bc43378162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81226dc11f7466d9645a2b95d628e17'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:50.663594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-39bf2327-a466-4e96-81d7-a3bc43378162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81226dc11f7466d9645a2b95d628e17'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:50.671257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-39bf2327-a466-4e96-81d7-a3bc43378162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81226dc11f7466d9645a2b95d628e17'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:50.701655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-39bf2327-a466-4e96-81d7-a3bc43378162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81226dc11f7466d9645a2b95d628e17'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:50.730864 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1073/2142] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:50 2022] DELETE /identity/v3/users/e81226dc11f7466d9645a2b95d628e17 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:51.237180 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4f511-5131-420b-8a56-627980840c6d service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:51.243731 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-81d4f511-5131-420b-8a56-627980840c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:51.263922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4f511-5131-420b-8a56-627980840c6d service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:51.305859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf2327-a466-4e96-81d7-a3bc43378162 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:51.307351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-39bf2327-a466-4e96-81d7-a3bc43378162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:51.406110 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:51.407003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:51.407382 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:51.407775 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] PATH_INFO: `/v3/projects/a8ddfd37f3a0434aadf94bbc2f0f3ba0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:51.411758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ddfd37f3a0434aadf94bbc2f0f3ba0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:51.414115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:51.429371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf2327-a466-4e96-81d7-a3bc43378162 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:51.446590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:51.447736 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:51.448245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:51.448806 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] PATH_INFO: `/v3/projects/339a311338b349da9532e1f9f193c38b` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:51.450132 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=339a311338b349da9532e1f9f193c38b)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:51.454605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:51.531919 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ddfd37f3a0434aadf94bbc2f0f3ba0', 'request_id': 'req-ae4908bb-d2e8-4c21-b0d3-f090578066a7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.543411 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339a311338b349da9532e1f9f193c38b', 'request_id': 'req-6c1de38d-fbd2-4845-8495-8a278565c817'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.544536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ddfd37f3a0434aadf94bbc2f0f3ba0', 'request_id': 'req-ae4908bb-d2e8-4c21-b0d3-f090578066a7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.553810 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ddfd37f3a0434aadf94bbc2f0f3ba0', 'request_id': 'req-ae4908bb-d2e8-4c21-b0d3-f090578066a7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.557636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339a311338b349da9532e1f9f193c38b', 'request_id': 'req-6c1de38d-fbd2-4845-8495-8a278565c817'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.567579 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339a311338b349da9532e1f9f193c38b', 'request_id': 'req-6c1de38d-fbd2-4845-8495-8a278565c817'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.578852 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] The token cache is being invalidate because project a8ddfd37f3a0434aadf94bbc2f0f3ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:51.579155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.580412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.582930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] The token cache is being invalidate because project 339a311338b349da9532e1f9f193c38b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:51.583427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.584164 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1070/2143] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:51 2022] DELETE /identity/v3/projects/a8ddfd37f3a0434aadf94bbc2f0f3ba0 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:51.584417 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.588986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1074/2144] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:51 2022] DELETE /identity/v3/projects/339a311338b349da9532e1f9f193c38b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:51.592150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:51.593320 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:51.596178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:51.598769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:51.715060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4908bb-d2e8-4c21-b0d3-f090578066a7 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:51.763339 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1de38d-fbd2-4845-8495-8a278565c817 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:51.781498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4977d-a69b-423c-8015-2efc5b71f790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:51.783278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4977d-a69b-423c-8015-2efc5b71f790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:51.784720 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4977d-a69b-423c-8015-2efc5b71f790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:51.785570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4977d-a69b-423c-8015-2efc5b71f790 admin admin] PATH_INFO: `/v3/users/6ec753257d2b4007808a4206f0065861` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:51.795055 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4977d-a69b-423c-8015-2efc5b71f790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec753257d2b4007808a4206f0065861)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:51.797396 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4977d-a69b-423c-8015-2efc5b71f790 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:51.877064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769d512-1811-40a6-ba55-770b70b262f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:51.877963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d512-1811-40a6-ba55-770b70b262f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:51.878243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d512-1811-40a6-ba55-770b70b262f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:51.878511 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d512-1811-40a6-ba55-770b70b262f5 admin admin] PATH_INFO: `/v3/users/cab53f814192479eac410a1b07cfd79d` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:51.881742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769d512-1811-40a6-ba55-770b70b262f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab53f814192479eac410a1b07cfd79d)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:51.884945 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769d512-1811-40a6-ba55-770b70b262f5 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:51.912078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-2ab4977d-a69b-423c-8015-2efc5b71f790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec753257d2b4007808a4206f0065861'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.914126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-2ab4977d-a69b-423c-8015-2efc5b71f790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec753257d2b4007808a4206f0065861'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.939993 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-2ab4977d-a69b-423c-8015-2efc5b71f790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec753257d2b4007808a4206f0065861'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.940980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-2ab4977d-a69b-423c-8015-2efc5b71f790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec753257d2b4007808a4206f0065861'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.952981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-2ab4977d-a69b-423c-8015-2efc5b71f790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec753257d2b4007808a4206f0065861'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.984478 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1075/2145] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:51 2022] DELETE /identity/v3/users/6ec753257d2b4007808a4206f0065861 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:51.989688 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2769d512-1811-40a6-ba55-770b70b262f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab53f814192479eac410a1b07cfd79d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.990630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2769d512-1811-40a6-ba55-770b70b262f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab53f814192479eac410a1b07cfd79d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:51.991767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2769d512-1811-40a6-ba55-770b70b262f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab53f814192479eac410a1b07cfd79d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:52.014903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2769d512-1811-40a6-ba55-770b70b262f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab53f814192479eac410a1b07cfd79d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:52.026608 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2769d512-1811-40a6-ba55-770b70b262f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab53f814192479eac410a1b07cfd79d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:52.059811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1071/2146] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:51 2022] DELETE /identity/v3/users/cab53f814192479eac410a1b07cfd79d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:52.640165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4977d-a69b-423c-8015-2efc5b71f790 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:52.641895 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-2ab4977d-a69b-423c-8015-2efc5b71f790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:52.777328 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4977d-a69b-423c-8015-2efc5b71f790 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:52.889714 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18a9c7-c2f5-4722-b03a-295f2226b56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:52.890589 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18a9c7-c2f5-4722-b03a-295f2226b56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:52.891090 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18a9c7-c2f5-4722-b03a-295f2226b56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:52.891331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18a9c7-c2f5-4722-b03a-295f2226b56f admin admin] PATH_INFO: `/v3/projects/7b85aa3c24f5423d8c9a7b83ace994cc` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:52.892812 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18a9c7-c2f5-4722-b03a-295f2226b56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b85aa3c24f5423d8c9a7b83ace994cc)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:52.894744 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18a9c7-c2f5-4722-b03a-295f2226b56f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:52.899188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769d512-1811-40a6-ba55-770b70b262f5 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:52.901314 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2769d512-1811-40a6-ba55-770b70b262f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:52.915486 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769d512-1811-40a6-ba55-770b70b262f5 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:52.921067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:52.922318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:52.922837 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:52.923246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] PATH_INFO: `/v3/projects/4528ad23096b418087b8721ce74eac67` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:52.924656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4528ad23096b418087b8721ce74eac67)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:52.926946 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:53.007074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4528ad23096b418087b8721ce74eac67', 'request_id': 'req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.022355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4528ad23096b418087b8721ce74eac67', 'request_id': 'req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.028386 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-2f18a9c7-c2f5-4722-b03a-295f2226b56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b85aa3c24f5423d8c9a7b83ace994cc', 'request_id': 'req-2f18a9c7-c2f5-4722-b03a-295f2226b56f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.035183 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4528ad23096b418087b8721ce74eac67', 'request_id': 'req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.051276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-2f18a9c7-c2f5-4722-b03a-295f2226b56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b85aa3c24f5423d8c9a7b83ace994cc', 'request_id': 'req-2f18a9c7-c2f5-4722-b03a-295f2226b56f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.056836 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] The token cache is being invalidate because project 4528ad23096b418087b8721ce74eac67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:53.057085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.057801 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.059820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1072/2147] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:52 2022] DELETE /identity/v3/projects/4528ad23096b418087b8721ce74eac67 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:53.060859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-2f18a9c7-c2f5-4722-b03a-295f2226b56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b85aa3c24f5423d8c9a7b83ace994cc', 'request_id': 'req-2f18a9c7-c2f5-4722-b03a-295f2226b56f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.064178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:53.066012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:53.074635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-2f18a9c7-c2f5-4722-b03a-295f2226b56f admin admin] The token cache is being invalidate because project 7b85aa3c24f5423d8c9a7b83ace994cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:53.075071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-2f18a9c7-c2f5-4722-b03a-295f2226b56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.076071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-2f18a9c7-c2f5-4722-b03a-295f2226b56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.077995 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1076/2148] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:52 2022] DELETE /identity/v3/projects/7b85aa3c24f5423d8c9a7b83ace994cc => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:53.082861 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0f390-e06c-4a47-aa60-f6ef6c78ced9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:53.083247 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0f390-e06c-4a47-aa60-f6ef6c78ced9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:53.083507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0f390-e06c-4a47-aa60-f6ef6c78ced9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:53.107754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-4ce0f390-e06c-4a47-aa60-f6ef6c78ced9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:53.108911 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4ce0f390-e06c-4a47-aa60-f6ef6c78ced9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:53.143643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d72e3-a6a2-40ed-aca2-bf6546932aa7 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:53.181967 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1077/2149] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:53.189279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a9cc8-3b46-4953-8717-506bc8c66738 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:53.189566 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a9cc8-3b46-4953-8717-506bc8c66738 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:53.189847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a9cc8-3b46-4953-8717-506bc8c66738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:53.208919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-405a9cc8-3b46-4953-8717-506bc8c66738 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:53.210128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-405a9cc8-3b46-4953-8717-506bc8c66738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:53.218450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57bd4c-d31d-4913-abd1-5dfd390519b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:53.219361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57bd4c-d31d-4913-abd1-5dfd390519b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:53.219639 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57bd4c-d31d-4913-abd1-5dfd390519b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:53.219917 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57bd4c-d31d-4913-abd1-5dfd390519b7 admin admin] PATH_INFO: `/v3/users/313b9d0a6f214f55992d6a743254b7a6` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:53.223862 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1078/2150] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:53.223987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57bd4c-d31d-4913-abd1-5dfd390519b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=313b9d0a6f214f55992d6a743254b7a6)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:53.223987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57bd4c-d31d-4913-abd1-5dfd390519b7 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:53.224986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a9cc8-3b46-4953-8717-506bc8c66738 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:53.244384 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a9cc8-3b46-4953-8717-506bc8c66738 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:53.251555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae891db7-bf4a-4595-8a8f-cc842b01beff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:53.252296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891db7-bf4a-4595-8a8f-cc842b01beff admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:53.252579 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891db7-bf4a-4595-8a8f-cc842b01beff admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:53.252853 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891db7-bf4a-4595-8a8f-cc842b01beff admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:53.253608 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae891db7-bf4a-4595-8a8f-cc842b01beff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:53.253916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae891db7-bf4a-4595-8a8f-cc842b01beff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:53.255635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae891db7-bf4a-4595-8a8f-cc842b01beff admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:53.271561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1079/2151] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:43:53.272435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae891db7-bf4a-4595-8a8f-cc842b01beff admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:53.277948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ac57bd4c-d31d-4913-abd1-5dfd390519b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313b9d0a6f214f55992d6a743254b7a6'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.278625 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ac57bd4c-d31d-4913-abd1-5dfd390519b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313b9d0a6f214f55992d6a743254b7a6'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.279526 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ac57bd4c-d31d-4913-abd1-5dfd390519b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313b9d0a6f214f55992d6a743254b7a6'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.284128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae891db7-bf4a-4595-8a8f-cc842b01beff admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:53.294885 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ac57bd4c-d31d-4913-abd1-5dfd390519b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313b9d0a6f214f55992d6a743254b7a6'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.295804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb5682-bc2a-401d-8a45-0173a55d5798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:53.296968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5682-bc2a-401d-8a45-0173a55d5798 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:53.296968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5682-bc2a-401d-8a45-0173a55d5798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:53.297107 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5682-bc2a-401d-8a45-0173a55d5798 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:53.297829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb5682-bc2a-401d-8a45-0173a55d5798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:53.299883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb5682-bc2a-401d-8a45-0173a55d5798 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:53.304342 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ac57bd4c-d31d-4913-abd1-5dfd390519b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313b9d0a6f214f55992d6a743254b7a6'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.322141 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1073/2152] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:53 2022] DELETE /identity/v3/users/313b9d0a6f214f55992d6a743254b7a6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:53.331012 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1080/2153] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:53 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:53.335073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57bd4c-d31d-4913-abd1-5dfd390519b7 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:53.338168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ac57bd4c-d31d-4913-abd1-5dfd390519b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:53.430747 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57bd4c-d31d-4913-abd1-5dfd390519b7 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:53.515647 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eded0a8-8d6e-4c88-9211-acce8908961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:53.516962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eded0a8-8d6e-4c88-9211-acce8908961c admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:53.517464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eded0a8-8d6e-4c88-9211-acce8908961c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:53.518103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eded0a8-8d6e-4c88-9211-acce8908961c admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:53.519063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eded0a8-8d6e-4c88-9211-acce8908961c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:53.521298 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eded0a8-8d6e-4c88-9211-acce8908961c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:53.562521 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1074/2154] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:53 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:53.563802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb5682-bc2a-401d-8a45-0173a55d5798 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:53.584818 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb5682-bc2a-401d-8a45-0173a55d5798 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:53.592665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399cf4d-b092-494c-87c3-9cee2d525eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:53.593613 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399cf4d-b092-494c-87c3-9cee2d525eed admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:53.593906 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399cf4d-b092-494c-87c3-9cee2d525eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:53.594285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399cf4d-b092-494c-87c3-9cee2d525eed admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:53.595257 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399cf4d-b092-494c-87c3-9cee2d525eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:53.597326 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399cf4d-b092-494c-87c3-9cee2d525eed admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:53.616531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1081/2155] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:53.618665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eded0a8-8d6e-4c88-9211-acce8908961c admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:53.630601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eded0a8-8d6e-4c88-9211-acce8908961c admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:53.637875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3182848-a4c0-484a-9834-296a448756bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:53.638720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3182848-a4c0-484a-9834-296a448756bf admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:53.639037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3182848-a4c0-484a-9834-296a448756bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:53.639321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3182848-a4c0-484a-9834-296a448756bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:53.640056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3182848-a4c0-484a-9834-296a448756bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:53.641924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3182848-a4c0-484a-9834-296a448756bf admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:53.657592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1075/2156] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:53.659814 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399cf4d-b092-494c-87c3-9cee2d525eed admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:53.671677 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399cf4d-b092-494c-87c3-9cee2d525eed admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:53.680666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81403ebf-0977-4fa0-8848-04a4671c8eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:53.681668 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81403ebf-0977-4fa0-8848-04a4671c8eab admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:53.681951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81403ebf-0977-4fa0-8848-04a4671c8eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:53.682227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81403ebf-0977-4fa0-8848-04a4671c8eab admin admin] PATH_INFO: `/v3/projects/e3288337df204f9ea9a68ee3b481aebf/users/b6fa0a24c0b24829a05973f9120d4692/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:53.697924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81403ebf-0977-4fa0-8848-04a4671c8eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3288337df204f9ea9a68ee3b481aebf, user_id=b6fa0a24c0b24829a05973f9120d4692, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:53.700623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81403ebf-0977-4fa0-8848-04a4671c8eab admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:53.714987 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1082/2157] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:53 2022] PUT /identity/v3/projects/e3288337df204f9ea9a68ee3b481aebf/users/b6fa0a24c0b24829a05973f9120d4692/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:43:53.727250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0066d54-70a7-4fa7-b1f6-707774da2dc7 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:53.727666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0066d54-70a7-4fa7-b1f6-707774da2dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:53.727947 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0066d54-70a7-4fa7-b1f6-707774da2dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:53.768066 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-a0066d54-70a7-4fa7-b1f6-707774da2dc7 None None] MFA Rules not processed for user `b6fa0a24c0b24829a05973f9120d4692`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:53.772355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a0066d54-70a7-4fa7-b1f6-707774da2dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:53.823387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81403ebf-0977-4fa0-8848-04a4671c8eab admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:53.825508 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-81403ebf-0977-4fa0-8848-04a4671c8eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:53.896901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1076/2158] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:53.909249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0066d54-70a7-4fa7-b1f6-707774da2dc7 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:53.910883 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a0066d54-70a7-4fa7-b1f6-707774da2dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:53.918988 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81403ebf-0977-4fa0-8848-04a4671c8eab admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:53.923963 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ae4ce-527e-469b-8605-f90e6c77c430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:53.924924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ae4ce-527e-469b-8605-f90e6c77c430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:53.925280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ae4ce-527e-469b-8605-f90e6c77c430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:53.925632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ae4ce-527e-469b-8605-f90e6c77c430 admin admin] PATH_INFO: `/v3/projects/9adccd63bf0940bbb23a6a6a19c3ef04` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:53.926954 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ae4ce-527e-469b-8605-f90e6c77c430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9adccd63bf0940bbb23a6a6a19c3ef04)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:53.928980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ae4ce-527e-469b-8605-f90e6c77c430 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:53.978610 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0066d54-70a7-4fa7-b1f6-707774da2dc7 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:53.986179 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fd1ae4ce-527e-469b-8605-f90e6c77c430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9adccd63bf0940bbb23a6a6a19c3ef04', 'request_id': 'req-fd1ae4ce-527e-469b-8605-f90e6c77c430'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:53.995108 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fd1ae4ce-527e-469b-8605-f90e6c77c430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9adccd63bf0940bbb23a6a6a19c3ef04', 'request_id': 'req-fd1ae4ce-527e-469b-8605-f90e6c77c430'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:54.002617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fd1ae4ce-527e-469b-8605-f90e6c77c430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9adccd63bf0940bbb23a6a6a19c3ef04', 'request_id': 'req-fd1ae4ce-527e-469b-8605-f90e6c77c430'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:54.015455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fd1ae4ce-527e-469b-8605-f90e6c77c430 admin admin] The token cache is being invalidate because project 9adccd63bf0940bbb23a6a6a19c3ef04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:54.015958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fd1ae4ce-527e-469b-8605-f90e6c77c430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:54.017056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fd1ae4ce-527e-469b-8605-f90e6c77c430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:54.022635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1083/2159] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:53 2022] DELETE /identity/v3/projects/9adccd63bf0940bbb23a6a6a19c3ef04 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:54.027990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8462f-aeac-4e9c-b4a6-008ff2b9d0f5 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:54.028370 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8462f-aeac-4e9c-b4a6-008ff2b9d0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:54.028726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8462f-aeac-4e9c-b4a6-008ff2b9d0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:54.039780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51baad8-ee8a-42a4-bdcc-3f877302cdb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:54.040524 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51baad8-ee8a-42a4-bdcc-3f877302cdb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:54.040905 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51baad8-ee8a-42a4-bdcc-3f877302cdb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:54.041304 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51baad8-ee8a-42a4-bdcc-3f877302cdb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:54.043363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d51baad8-ee8a-42a4-bdcc-3f877302cdb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:54.050087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-09a8462f-aeac-4e9c-b4a6-008ff2b9d0f5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:54.051302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-09a8462f-aeac-4e9c-b4a6-008ff2b9d0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:54.112023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51baad8-ee8a-42a4-bdcc-3f877302cdb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:54.113564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51baad8-ee8a-42a4-bdcc-3f877302cdb4 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:54.121065 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1084/2160] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:54.127410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1077/2161] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:54.132233 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d906-e8cd-478c-9ba8-7ddfcce1c221 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:54.132523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d906-e8cd-478c-9ba8-7ddfcce1c221 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:54.132868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d906-e8cd-478c-9ba8-7ddfcce1c221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:54.148988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51baad8-ee8a-42a4-bdcc-3f877302cdb4 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:54.151243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d51baad8-ee8a-42a4-bdcc-3f877302cdb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:54.164155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-5bf8d906-e8cd-478c-9ba8-7ddfcce1c221 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:54.166192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5bf8d906-e8cd-478c-9ba8-7ddfcce1c221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:54.167726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51baad8-ee8a-42a4-bdcc-3f877302cdb4 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:54.172913 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019dca4-463a-4e87-8bbe-7f033e7a26be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:54.173816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019dca4-463a-4e87-8bbe-7f033e7a26be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:54.174095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019dca4-463a-4e87-8bbe-7f033e7a26be admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:54.174365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019dca4-463a-4e87-8bbe-7f033e7a26be admin admin] PATH_INFO: `/v3/users/b6fa0a24c0b24829a05973f9120d4692` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:54.175596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019dca4-463a-4e87-8bbe-7f033e7a26be admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6fa0a24c0b24829a05973f9120d4692)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:54.177506 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019dca4-463a-4e87-8bbe-7f033e7a26be admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:54.187973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1085/2162] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:54.187973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8d906-e8cd-478c-9ba8-7ddfcce1c221 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:54.192444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8d906-e8cd-478c-9ba8-7ddfcce1c221 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:54.198714 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3904ebe-8012-4bea-8fb0-84c2c161a2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:54.199124 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904ebe-8012-4bea-8fb0-84c2c161a2db admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:54.203161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904ebe-8012-4bea-8fb0-84c2c161a2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:54.203161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904ebe-8012-4bea-8fb0-84c2c161a2db admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:54.203161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3904ebe-8012-4bea-8fb0-84c2c161a2db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:54.203161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3904ebe-8012-4bea-8fb0-84c2c161a2db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:54.203161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3904ebe-8012-4bea-8fb0-84c2c161a2db admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:54.219486 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1086/2163] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:43:54.220709 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3904ebe-8012-4bea-8fb0-84c2c161a2db admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:54.228858 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4019dca4-463a-4e87-8bbe-7f033e7a26be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6fa0a24c0b24829a05973f9120d4692'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:54.229565 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4019dca4-463a-4e87-8bbe-7f033e7a26be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6fa0a24c0b24829a05973f9120d4692'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:54.230183 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4019dca4-463a-4e87-8bbe-7f033e7a26be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6fa0a24c0b24829a05973f9120d4692'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:54.231375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3904ebe-8012-4bea-8fb0-84c2c161a2db admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:54.238924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267031c8-2a37-4083-be9a-87f2bfcd5cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:54.238924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267031c8-2a37-4083-be9a-87f2bfcd5cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:54.238924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267031c8-2a37-4083-be9a-87f2bfcd5cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:54.238924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267031c8-2a37-4083-be9a-87f2bfcd5cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:54.239312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267031c8-2a37-4083-be9a-87f2bfcd5cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:54.240061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267031c8-2a37-4083-be9a-87f2bfcd5cf5 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:54.244059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4019dca4-463a-4e87-8bbe-7f033e7a26be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6fa0a24c0b24829a05973f9120d4692'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:54.251883 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4019dca4-463a-4e87-8bbe-7f033e7a26be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6fa0a24c0b24829a05973f9120d4692'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:54.267304 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1078/2164] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:43:54 2022] DELETE /identity/v3/users/b6fa0a24c0b24829a05973f9120d4692 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:54.270856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1087/2165] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:54 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:54.271691 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267031c8-2a37-4083-be9a-87f2bfcd5cf5 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:54.272136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b628bc-10f7-4532-8203-dcab33c43749 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:54.272407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b628bc-10f7-4532-8203-dcab33c43749 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:54.272680 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b628bc-10f7-4532-8203-dcab33c43749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:54.273798 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-267031c8-2a37-4083-be9a-87f2bfcd5cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:54.290221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-f0b628bc-10f7-4532-8203-dcab33c43749 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:54.291443 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f0b628bc-10f7-4532-8203-dcab33c43749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:54.340204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267031c8-2a37-4083-be9a-87f2bfcd5cf5 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:54.345119 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe953c-9660-4e39-ac5b-4db3a303e5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:54.345808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe953c-9660-4e39-ac5b-4db3a303e5df admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:54.346095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe953c-9660-4e39-ac5b-4db3a303e5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:54.346828 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe953c-9660-4e39-ac5b-4db3a303e5df admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:54.347097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe953c-9660-4e39-ac5b-4db3a303e5df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:54.349017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe953c-9660-4e39-ac5b-4db3a303e5df admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:54.355429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1079/2166] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:54.366158 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b628bc-10f7-4532-8203-dcab33c43749 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:54.367684 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f0b628bc-10f7-4532-8203-dcab33c43749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:54.370250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1088/2167] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:54 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:54.374027 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe953c-9660-4e39-ac5b-4db3a303e5df admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:54.383357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe953c-9660-4e39-ac5b-4db3a303e5df admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:54.388095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46a340-ad53-421f-a95b-28be38a31f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:54.389217 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46a340-ad53-421f-a95b-28be38a31f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:54.389217 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46a340-ad53-421f-a95b-28be38a31f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:54.389392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46a340-ad53-421f-a95b-28be38a31f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:54.390044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46a340-ad53-421f-a95b-28be38a31f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:54.392026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46a340-ad53-421f-a95b-28be38a31f57 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:54.407686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1089/2168] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:54.411522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46a340-ad53-421f-a95b-28be38a31f57 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:54.421939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46a340-ad53-421f-a95b-28be38a31f57 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:54.426838 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa0a52-68f1-4d7e-a4ce-97ec86502d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:54.427493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa0a52-68f1-4d7e-a4ce-97ec86502d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:54.427775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa0a52-68f1-4d7e-a4ce-97ec86502d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:54.428054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa0a52-68f1-4d7e-a4ce-97ec86502d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:54.428769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa0a52-68f1-4d7e-a4ce-97ec86502d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:54.430964 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa0a52-68f1-4d7e-a4ce-97ec86502d40 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:54.433570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b628bc-10f7-4532-8203-dcab33c43749 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:54.437498 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d4f66-585c-4106-b6d1-14d5f476d380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:54.438138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d4f66-585c-4106-b6d1-14d5f476d380 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:54.438436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d4f66-585c-4106-b6d1-14d5f476d380 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:54.438740 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d4f66-585c-4106-b6d1-14d5f476d380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:54.441197 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1090/2169] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:43:54.447703 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa0a52-68f1-4d7e-a4ce-97ec86502d40 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:54.452223 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d4f66-585c-4106-b6d1-14d5f476d380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:54.454805 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d4f66-585c-4106-b6d1-14d5f476d380 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:54.467658 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1080/2170] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:43:54.471794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa0a52-68f1-4d7e-a4ce-97ec86502d40 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:54.476694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25e6ae-5a2d-4db7-a529-f515766ecdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:54.477712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25e6ae-5a2d-4db7-a529-f515766ecdd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:54.478005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25e6ae-5a2d-4db7-a529-f515766ecdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:54.478283 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25e6ae-5a2d-4db7-a529-f515766ecdd8 admin admin] PATH_INFO: `/v3/projects/ca830c9eae6240aa9b2076fac638457b/users/77f1996fbcfa41c2af04aabe2841953b/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:54.496914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25e6ae-5a2d-4db7-a529-f515766ecdd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca830c9eae6240aa9b2076fac638457b, user_id=77f1996fbcfa41c2af04aabe2841953b, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:54.499813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25e6ae-5a2d-4db7-a529-f515766ecdd8 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:54.515336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1091/2171] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:54 2022] PUT /identity/v3/projects/ca830c9eae6240aa9b2076fac638457b/users/77f1996fbcfa41c2af04aabe2841953b/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:54.525768 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30c455-52b1-4256-8dd3-fa7f9ef0541d None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:54.526067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30c455-52b1-4256-8dd3-fa7f9ef0541d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:54.526342 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30c455-52b1-4256-8dd3-fa7f9ef0541d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:54.560433 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-7b30c455-52b1-4256-8dd3-fa7f9ef0541d None None] MFA Rules not processed for user `77f1996fbcfa41c2af04aabe2841953b`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:54.561893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-7b30c455-52b1-4256-8dd3-fa7f9ef0541d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:54.658854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1081/2172] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:54.670502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25e6ae-5a2d-4db7-a529-f515766ecdd8 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:54.672353 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-da25e6ae-5a2d-4db7-a529-f515766ecdd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:54.736873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25e6ae-5a2d-4db7-a529-f515766ecdd8 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:54.752624 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248e207-9465-48e7-af25-7b974ad42051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:54.753386 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248e207-9465-48e7-af25-7b974ad42051 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:54.753755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248e207-9465-48e7-af25-7b974ad42051 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:54.754100 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248e207-9465-48e7-af25-7b974ad42051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:54.766344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248e207-9465-48e7-af25-7b974ad42051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:54.769944 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248e207-9465-48e7-af25-7b974ad42051 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:54.783314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1092/2173] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:43:55.103405 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30c455-52b1-4256-8dd3-fa7f9ef0541d None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:55.105006 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-7b30c455-52b1-4256-8dd3-fa7f9ef0541d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:55.225858 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30c455-52b1-4256-8dd3-fa7f9ef0541d None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:55.239806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:55.240695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:55.243354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:55.243664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f admin admin] PATH_INFO: `/v3/projects/e3288337df204f9ea9a68ee3b481aebf` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:55.246043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3288337df204f9ea9a68ee3b481aebf)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:55.251087 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:55.317659 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3288337df204f9ea9a68ee3b481aebf', 'request_id': 'req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:55.326124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3288337df204f9ea9a68ee3b481aebf', 'request_id': 'req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:55.331854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3288337df204f9ea9a68ee3b481aebf', 'request_id': 'req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:55.344822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f admin admin] The token cache is being invalidate because project e3288337df204f9ea9a68ee3b481aebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:43:55.345105 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:55.345759 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-83f8b652-2ed9-4959-a560-bd75e7d9ab7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:43:55.347331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1082/2174] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:43:55 2022] DELETE /identity/v3/projects/e3288337df204f9ea9a68ee3b481aebf => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:55.352244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c6a07-6e87-4d37-a63b-8b71cbf6b70c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:55.352524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c6a07-6e87-4d37-a63b-8b71cbf6b70c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:55.352799 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c6a07-6e87-4d37-a63b-8b71cbf6b70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:55.370423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-656c6a07-6e87-4d37-a63b-8b71cbf6b70c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:55.371660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-656c6a07-6e87-4d37-a63b-8b71cbf6b70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:55.448876 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1093/2175] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:55.456526 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a05bbf-b866-43ca-96f8-1e1c33e25515 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:55.456815 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a05bbf-b866-43ca-96f8-1e1c33e25515 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:55.457086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a05bbf-b866-43ca-96f8-1e1c33e25515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:55.475726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c4a05bbf-b866-43ca-96f8-1e1c33e25515 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:55.477518 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c4a05bbf-b866-43ca-96f8-1e1c33e25515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:55.488176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1083/2176] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:43:55.493405 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c6a07-6e87-4d37-a63b-8b71cbf6b70c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:55.503652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c6a07-6e87-4d37-a63b-8b71cbf6b70c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:55.508280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc3e95-f5da-428a-a7da-16a501e4e589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:55.508941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3e95-f5da-428a-a7da-16a501e4e589 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:55.509220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3e95-f5da-428a-a7da-16a501e4e589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:55.509496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3e95-f5da-428a-a7da-16a501e4e589 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:55.510222 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc3e95-f5da-428a-a7da-16a501e4e589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:43:55.510554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc3e95-f5da-428a-a7da-16a501e4e589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:55.512254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc3e95-f5da-428a-a7da-16a501e4e589 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:55.524431 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1094/2177] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:43:55.528719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a05bbf-b866-43ca-96f8-1e1c33e25515 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:55.538111 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a05bbf-b866-43ca-96f8-1e1c33e25515 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:55.543428 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279142b4-49bd-4608-8dfc-203e482119e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:55.544080 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279142b4-49bd-4608-8dfc-203e482119e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:55.544360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279142b4-49bd-4608-8dfc-203e482119e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:55.544635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279142b4-49bd-4608-8dfc-203e482119e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:55.545321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279142b4-49bd-4608-8dfc-203e482119e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:55.547347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279142b4-49bd-4608-8dfc-203e482119e4 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:55.575279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1084/2178] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:43:55 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:43:55.579573 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc3e95-f5da-428a-a7da-16a501e4e589 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:55.589682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc3e95-f5da-428a-a7da-16a501e4e589 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:55.647208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64a2d5-f51d-44ed-9ee5-1c7204ec2ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:55.647873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64a2d5-f51d-44ed-9ee5-1c7204ec2ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:55.648159 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64a2d5-f51d-44ed-9ee5-1c7204ec2ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:55.648930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64a2d5-f51d-44ed-9ee5-1c7204ec2ebe admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:55.649718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64a2d5-f51d-44ed-9ee5-1c7204ec2ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:55.651730 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64a2d5-f51d-44ed-9ee5-1c7204ec2ebe admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:55.674317 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1095/2179] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:43:55 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:43:55.676324 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279142b4-49bd-4608-8dfc-203e482119e4 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:55.688184 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279142b4-49bd-4608-8dfc-203e482119e4 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:55.693944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae31fd-98d7-420d-afee-4e5b3294ecdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:55.694616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae31fd-98d7-420d-afee-4e5b3294ecdf admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:55.694965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae31fd-98d7-420d-afee-4e5b3294ecdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:55.695250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae31fd-98d7-420d-afee-4e5b3294ecdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:55.696187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae31fd-98d7-420d-afee-4e5b3294ecdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:55.697788 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae31fd-98d7-420d-afee-4e5b3294ecdf admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:55.714825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1085/2180] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:55.716953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64a2d5-f51d-44ed-9ee5-1c7204ec2ebe admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:55.727731 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64a2d5-f51d-44ed-9ee5-1c7204ec2ebe admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:55.732535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cf52c-c56a-41c3-a4c0-49c4809a230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:55.733369 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf52c-c56a-41c3-a4c0-49c4809a230f admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:55.733653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf52c-c56a-41c3-a4c0-49c4809a230f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:55.733933 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf52c-c56a-41c3-a4c0-49c4809a230f admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:55.734659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cf52c-c56a-41c3-a4c0-49c4809a230f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:55.736361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cf52c-c56a-41c3-a4c0-49c4809a230f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:55.747410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1096/2181] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:43:55.751453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae31fd-98d7-420d-afee-4e5b3294ecdf admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:55.763014 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae31fd-98d7-420d-afee-4e5b3294ecdf admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:55.767896 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb333281-29f5-489b-b225-672afb3ff10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:55.768795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb333281-29f5-489b-b225-672afb3ff10b admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:55.769080 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb333281-29f5-489b-b225-672afb3ff10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:55.769349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb333281-29f5-489b-b225-672afb3ff10b admin admin] PATH_INFO: `/v3/projects/3d681b6f58434818bd35fdf80cd331fd/users/53ea4c7e96cc4162badcba6b3844d721/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:55.783700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb333281-29f5-489b-b225-672afb3ff10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d681b6f58434818bd35fdf80cd331fd, user_id=53ea4c7e96cc4162badcba6b3844d721, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:55.786342 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb333281-29f5-489b-b225-672afb3ff10b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:55.799299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1086/2182] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:43:55 2022] PUT /identity/v3/projects/3d681b6f58434818bd35fdf80cd331fd/users/53ea4c7e96cc4162badcba6b3844d721/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:43:55.811049 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba337b-7aec-4352-901a-8807fe985c2d None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:55.811337 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba337b-7aec-4352-901a-8807fe985c2d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:55.811615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba337b-7aec-4352-901a-8807fe985c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:55.838131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-a4ba337b-7aec-4352-901a-8807fe985c2d None None] MFA Rules not processed for user `53ea4c7e96cc4162badcba6b3844d721`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:43:55.839404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a4ba337b-7aec-4352-901a-8807fe985c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:55.901984 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1097/2183] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:43:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:43:55.912894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb333281-29f5-489b-b225-672afb3ff10b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:43:55.915345 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-fb333281-29f5-489b-b225-672afb3ff10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:43:55.970436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb333281-29f5-489b-b225-672afb3ff10b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:43:55.974005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e3ffe-7fa6-473c-92f8-9489b40596e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a003b6145fb4c5c8919020d9208afa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:43:55.974644 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e3ffe-7fa6-473c-92f8-9489b40596e0 service glance] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:43:55.974953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e3ffe-7fa6-473c-92f8-9489b40596e0 service glance] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:43:55.975227 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e3ffe-7fa6-473c-92f8-9489b40596e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:43:55.984125 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e3ffe-7fa6-473c-92f8-9489b40596e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:43:55.985548 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e3ffe-7fa6-473c-92f8-9489b40596e0 service glance] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:43:55.994125 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1087/2184] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:43:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:44:04.676238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba337b-7aec-4352-901a-8807fe985c2d None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:04.677647 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a4ba337b-7aec-4352-901a-8807fe985c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:04.740910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba337b-7aec-4352-901a-8807fe985c2d None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:04.745589 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7a78b-c03a-4327-89b3-37f82dd37bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:04.746453 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7a78b-c03a-4327-89b3-37f82dd37bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:04.746768 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7a78b-c03a-4327-89b3-37f82dd37bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:04.747047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7a78b-c03a-4327-89b3-37f82dd37bbf admin admin] PATH_INFO: `/v3/users/77f1996fbcfa41c2af04aabe2841953b` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:04.748241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7a78b-c03a-4327-89b3-37f82dd37bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f1996fbcfa41c2af04aabe2841953b)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:04.750160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7a78b-c03a-4327-89b3-37f82dd37bbf admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:04.797651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8fa7a78b-c03a-4327-89b3-37f82dd37bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f1996fbcfa41c2af04aabe2841953b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:04.798555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8fa7a78b-c03a-4327-89b3-37f82dd37bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f1996fbcfa41c2af04aabe2841953b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:04.814067 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8fa7a78b-c03a-4327-89b3-37f82dd37bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f1996fbcfa41c2af04aabe2841953b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:04.815098 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8fa7a78b-c03a-4327-89b3-37f82dd37bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f1996fbcfa41c2af04aabe2841953b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:04.824528 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8fa7a78b-c03a-4327-89b3-37f82dd37bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f1996fbcfa41c2af04aabe2841953b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:04.840179 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1098/2185] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:44:04 2022] DELETE /identity/v3/users/77f1996fbcfa41c2af04aabe2841953b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:44:04.847416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eb578-4bde-4beb-bb41-6e526c714ceb None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:04.847932 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eb578-4bde-4beb-bb41-6e526c714ceb None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:04.848049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eb578-4bde-4beb-bb41-6e526c714ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:04.870623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-eb1eb578-4bde-4beb-bb41-6e526c714ceb None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:04.871954 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-eb1eb578-4bde-4beb-bb41-6e526c714ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:04.939699 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1088/2186] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:04.949549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7a78b-c03a-4327-89b3-37f82dd37bbf admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:04.951042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8fa7a78b-c03a-4327-89b3-37f82dd37bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:05.008183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7a78b-c03a-4327-89b3-37f82dd37bbf admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:05.011950 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98616c0-6865-4e4b-82a2-12c75e7e6e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:05.012579 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98616c0-6865-4e4b-82a2-12c75e7e6e58 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:05.012859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98616c0-6865-4e4b-82a2-12c75e7e6e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:05.013132 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98616c0-6865-4e4b-82a2-12c75e7e6e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:05.022577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98616c0-6865-4e4b-82a2-12c75e7e6e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:05.024166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98616c0-6865-4e4b-82a2-12c75e7e6e58 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:05.033877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1099/2187] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:44:05.329256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eb578-4bde-4beb-bb41-6e526c714ceb None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:05.330690 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-eb1eb578-4bde-4beb-bb41-6e526c714ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:05.343285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eb578-4bde-4beb-bb41-6e526c714ceb None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:05.348409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:05.349337 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:05.349708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:05.350050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9 admin admin] PATH_INFO: `/v3/projects/ca830c9eae6240aa9b2076fac638457b` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:05.351352 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca830c9eae6240aa9b2076fac638457b)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:05.354065 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:05.404547 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca830c9eae6240aa9b2076fac638457b', 'request_id': 'req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:05.411098 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca830c9eae6240aa9b2076fac638457b', 'request_id': 'req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:05.418303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca830c9eae6240aa9b2076fac638457b', 'request_id': 'req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:05.430893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9 admin admin] The token cache is being invalidate because project ca830c9eae6240aa9b2076fac638457b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:44:05.431354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:05.432017 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d2b0e278-4d54-4fde-91e8-55f31e6b2ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:05.433575 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1089/2188] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:44:05 2022] DELETE /identity/v3/projects/ca830c9eae6240aa9b2076fac638457b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:44:05.438488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41292f28-023e-448c-8909-54350a495bf6 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:05.438759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41292f28-023e-448c-8909-54350a495bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:05.439040 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41292f28-023e-448c-8909-54350a495bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:05.456846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-41292f28-023e-448c-8909-54350a495bf6 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:05.458050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-41292f28-023e-448c-8909-54350a495bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:05.515881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1100/2189] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:05.524888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9963-431f-41d4-8f48-0f25769ed4b4 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:05.525170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9963-431f-41d4-8f48-0f25769ed4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:05.525446 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9963-431f-41d4-8f48-0f25769ed4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:05.544129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-203d9963-431f-41d4-8f48-0f25769ed4b4 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:05.545338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-203d9963-431f-41d4-8f48-0f25769ed4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:05.553235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1090/2190] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:05.558062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41292f28-023e-448c-8909-54350a495bf6 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:05.567491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41292f28-023e-448c-8909-54350a495bf6 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:05.572662 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420037fd-c77c-4f62-a0ea-03f79d87f68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:05.573302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420037fd-c77c-4f62-a0ea-03f79d87f68f admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:05.573580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420037fd-c77c-4f62-a0ea-03f79d87f68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:05.573849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420037fd-c77c-4f62-a0ea-03f79d87f68f admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:05.574562 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420037fd-c77c-4f62-a0ea-03f79d87f68f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:44:05.574903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420037fd-c77c-4f62-a0ea-03f79d87f68f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:05.576526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420037fd-c77c-4f62-a0ea-03f79d87f68f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:05.588163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1101/2191] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:44:05.592238 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d9963-431f-41d4-8f48-0f25769ed4b4 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:05.601224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d9963-431f-41d4-8f48-0f25769ed4b4 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:05.606002 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2c4c5-c012-4b97-8d61-38d8d777f0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:05.606664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2c4c5-c012-4b97-8d61-38d8d777f0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:05.606974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2c4c5-c012-4b97-8d61-38d8d777f0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:05.607254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2c4c5-c012-4b97-8d61-38d8d777f0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:05.607962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2c4c5-c012-4b97-8d61-38d8d777f0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:05.609946 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2c4c5-c012-4b97-8d61-38d8d777f0c6 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:05.636441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1091/2192] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:44:05 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:44:05.640518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420037fd-c77c-4f62-a0ea-03f79d87f68f admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:05.651147 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420037fd-c77c-4f62-a0ea-03f79d87f68f admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:05.705530 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47640f-c462-4071-95a4-7acf6f6b7874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:05.706198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47640f-c462-4071-95a4-7acf6f6b7874 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:05.706404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47640f-c462-4071-95a4-7acf6f6b7874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:05.706731 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47640f-c462-4071-95a4-7acf6f6b7874 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:05.707405 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47640f-c462-4071-95a4-7acf6f6b7874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:05.709333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47640f-c462-4071-95a4-7acf6f6b7874 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:05.732397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1102/2193] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:44:05 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:44:05.736513 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2c4c5-c012-4b97-8d61-38d8d777f0c6 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:05.747633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2c4c5-c012-4b97-8d61-38d8d777f0c6 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:05.752356 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789cd58-0dbb-4860-9d5b-b71617635ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:05.753014 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789cd58-0dbb-4860-9d5b-b71617635ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:05.753294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789cd58-0dbb-4860-9d5b-b71617635ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:05.753566 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789cd58-0dbb-4860-9d5b-b71617635ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:05.754285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789cd58-0dbb-4860-9d5b-b71617635ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:05.755952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789cd58-0dbb-4860-9d5b-b71617635ba4 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:05.768102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1092/2194] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:44:05.772035 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47640f-c462-4071-95a4-7acf6f6b7874 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:05.782087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47640f-c462-4071-95a4-7acf6f6b7874 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:05.788126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcecc1-a069-439b-9abf-e3d45eeb420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:05.788790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcecc1-a069-439b-9abf-e3d45eeb420c admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:05.789624 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcecc1-a069-439b-9abf-e3d45eeb420c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:05.789945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcecc1-a069-439b-9abf-e3d45eeb420c admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:05.790857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcecc1-a069-439b-9abf-e3d45eeb420c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:05.792474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcecc1-a069-439b-9abf-e3d45eeb420c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:05.802834 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1103/2195] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:44:05.807368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789cd58-0dbb-4860-9d5b-b71617635ba4 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:05.817805 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789cd58-0dbb-4860-9d5b-b71617635ba4 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:05.822574 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4fb87-ed53-419f-8f11-b28f6f65e082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:05.823481 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4fb87-ed53-419f-8f11-b28f6f65e082 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:05.823786 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4fb87-ed53-419f-8f11-b28f6f65e082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:05.824059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4fb87-ed53-419f-8f11-b28f6f65e082 admin admin] PATH_INFO: `/v3/projects/4e9154d1a4c44c6b8a42001c659d069b/users/7802c329d4ca4eccb28fdec9f8082cc1/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:05.838773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4fb87-ed53-419f-8f11-b28f6f65e082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9154d1a4c44c6b8a42001c659d069b, user_id=7802c329d4ca4eccb28fdec9f8082cc1, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:05.841699 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4fb87-ed53-419f-8f11-b28f6f65e082 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:05.859618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1093/2196] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:44:05 2022] PUT /identity/v3/projects/4e9154d1a4c44c6b8a42001c659d069b/users/7802c329d4ca4eccb28fdec9f8082cc1/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:44:05.864374 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d990f4-9d7c-4dc7-98e0-32b97add76eb None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:05.864662 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d990f4-9d7c-4dc7-98e0-32b97add76eb None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:05.864938 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d990f4-9d7c-4dc7-98e0-32b97add76eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:05.884423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-f3d990f4-9d7c-4dc7-98e0-32b97add76eb None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:05.885630 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f3d990f4-9d7c-4dc7-98e0-32b97add76eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:05.944413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1104/2197] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:05.955435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4fb87-ed53-419f-8f11-b28f6f65e082 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:05.957222 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-e2f4fb87-ed53-419f-8f11-b28f6f65e082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:06.018826 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4fb87-ed53-419f-8f11-b28f6f65e082 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:06.022631 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9553d5-68d8-47e2-85d2-bba4bcbf0071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:06.023304 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9553d5-68d8-47e2-85d2-bba4bcbf0071 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:06.023601 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9553d5-68d8-47e2-85d2-bba4bcbf0071 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:06.023874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9553d5-68d8-47e2-85d2-bba4bcbf0071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:06.033241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9553d5-68d8-47e2-85d2-bba4bcbf0071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:06.034729 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9553d5-68d8-47e2-85d2-bba4bcbf0071 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:06.045897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1094/2198] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:44:11.014033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5cf50-6af8-4893-b40a-b552bc43c3b2 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:11.014524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5cf50-6af8-4893-b40a-b552bc43c3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:11.014602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5cf50-6af8-4893-b40a-b552bc43c3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:11.042852 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-c9f5cf50-6af8-4893-b40a-b552bc43c3b2 None None] MFA Rules not processed for user `7802c329d4ca4eccb28fdec9f8082cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:11.044071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c9f5cf50-6af8-4893-b40a-b552bc43c3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:11.117809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1105/2199] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:44:11.122448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9553d5-68d8-47e2-85d2-bba4bcbf0071 service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:11.135193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9553d5-68d8-47e2-85d2-bba4bcbf0071 service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:11.140001 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7454f-f9b5-4acb-9448-116b712514a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:11.140741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7454f-f9b5-4acb-9448-116b712514a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:11.141107 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7454f-f9b5-4acb-9448-116b712514a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:11.141452 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7454f-f9b5-4acb-9448-116b712514a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:11.142489 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7454f-f9b5-4acb-9448-116b712514a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:11.144437 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7454f-f9b5-4acb-9448-116b712514a5 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:11.170454 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1095/2200] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:44:11 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:44:11.180963 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5cf50-6af8-4893-b40a-b552bc43c3b2 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:11.191905 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5cf50-6af8-4893-b40a-b552bc43c3b2 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:11.249958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d89ac-66d7-4024-a204-37a4592b6a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:11.250619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d89ac-66d7-4024-a204-37a4592b6a74 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:11.250930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d89ac-66d7-4024-a204-37a4592b6a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:11.251200 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d89ac-66d7-4024-a204-37a4592b6a74 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:11.251952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d89ac-66d7-4024-a204-37a4592b6a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:11.253864 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d89ac-66d7-4024-a204-37a4592b6a74 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:11.275434 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1106/2201] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:44:11 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:44:11.279474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7454f-f9b5-4acb-9448-116b712514a5 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:11.289749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7454f-f9b5-4acb-9448-116b712514a5 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:11.294358 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be089887-7e09-429a-bff1-4b08e2b6f92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:11.295050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089887-7e09-429a-bff1-4b08e2b6f92f admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:11.295332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089887-7e09-429a-bff1-4b08e2b6f92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:11.295606 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089887-7e09-429a-bff1-4b08e2b6f92f admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:11.296326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be089887-7e09-429a-bff1-4b08e2b6f92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:11.297915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be089887-7e09-429a-bff1-4b08e2b6f92f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:11.308662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1096/2202] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:44:11.312980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d89ac-66d7-4024-a204-37a4592b6a74 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:11.325415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d89ac-66d7-4024-a204-37a4592b6a74 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:11.329766 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb9fd9-80a7-4801-8a50-0f8dd912c954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:11.330794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb9fd9-80a7-4801-8a50-0f8dd912c954 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:11.331074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb9fd9-80a7-4801-8a50-0f8dd912c954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:11.331358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb9fd9-80a7-4801-8a50-0f8dd912c954 admin admin] PATH_INFO: `/v3/projects/224cb7122bad49d89bd72e8250e2d8f6/users/d41e016e2e7e4caaab8fdef9a1f6bc66/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:11.347690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb9fd9-80a7-4801-8a50-0f8dd912c954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=224cb7122bad49d89bd72e8250e2d8f6, user_id=d41e016e2e7e4caaab8fdef9a1f6bc66, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:11.350374 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb9fd9-80a7-4801-8a50-0f8dd912c954 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:11.364216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1107/2203] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:44:11 2022] PUT /identity/v3/projects/224cb7122bad49d89bd72e8250e2d8f6/users/d41e016e2e7e4caaab8fdef9a1f6bc66/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:44:11.369306 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be089887-7e09-429a-bff1-4b08e2b6f92f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:11.379315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be089887-7e09-429a-bff1-4b08e2b6f92f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:11.446547 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef36ec-26b3-40fe-b8af-3a895a69fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:11.448874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef36ec-26b3-40fe-b8af-3a895a69fd3c admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:11.449241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef36ec-26b3-40fe-b8af-3a895a69fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:11.449590 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef36ec-26b3-40fe-b8af-3a895a69fd3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:11.450437 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef36ec-26b3-40fe-b8af-3a895a69fd3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:11.452463 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef36ec-26b3-40fe-b8af-3a895a69fd3c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:11.464722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1097/2204] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:44:11.469936 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb9fd9-80a7-4801-8a50-0f8dd912c954 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:11.480795 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb9fd9-80a7-4801-8a50-0f8dd912c954 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:11.485502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d062738-ff0c-4143-ae24-f703c739eb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:11.486398 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d062738-ff0c-4143-ae24-f703c739eb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:11.486702 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d062738-ff0c-4143-ae24-f703c739eb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:11.486984 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d062738-ff0c-4143-ae24-f703c739eb73 admin admin] PATH_INFO: `/v3/projects/224cb7122bad49d89bd72e8250e2d8f6/users/d41e016e2e7e4caaab8fdef9a1f6bc66/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:11.488990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d062738-ff0c-4143-ae24-f703c739eb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=224cb7122bad49d89bd72e8250e2d8f6, user_id=d41e016e2e7e4caaab8fdef9a1f6bc66, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:11.491701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d062738-ff0c-4143-ae24-f703c739eb73 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:11.503423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1108/2205] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:44:11 2022] PUT /identity/v3/projects/224cb7122bad49d89bd72e8250e2d8f6/users/d41e016e2e7e4caaab8fdef9a1f6bc66/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:44:12.744478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef36ec-26b3-40fe-b8af-3a895a69fd3c admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:12.747677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f7ef36ec-26b3-40fe-b8af-3a895a69fd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:12.770339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef36ec-26b3-40fe-b8af-3a895a69fd3c admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:12.848546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad6927-2f72-4057-9163-e9629f1bae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:12.849314 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad6927-2f72-4057-9163-e9629f1bae65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:12.849599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad6927-2f72-4057-9163-e9629f1bae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:12.850003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad6927-2f72-4057-9163-e9629f1bae65 admin admin] PATH_INFO: `/v3/users/9b2a04f0f85a4cdfae96a14fc392073e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:12.851318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad6927-2f72-4057-9163-e9629f1bae65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b2a04f0f85a4cdfae96a14fc392073e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:12.853793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad6927-2f72-4057-9163-e9629f1bae65 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:12.911567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1dad6927-2f72-4057-9163-e9629f1bae65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2a04f0f85a4cdfae96a14fc392073e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:12.912247 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1dad6927-2f72-4057-9163-e9629f1bae65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2a04f0f85a4cdfae96a14fc392073e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:12.912876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1dad6927-2f72-4057-9163-e9629f1bae65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2a04f0f85a4cdfae96a14fc392073e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:12.925709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1dad6927-2f72-4057-9163-e9629f1bae65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2a04f0f85a4cdfae96a14fc392073e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:12.933161 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1dad6927-2f72-4057-9163-e9629f1bae65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2a04f0f85a4cdfae96a14fc392073e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:12.949758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1098/2206] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:44:12 2022] DELETE /identity/v3/users/9b2a04f0f85a4cdfae96a14fc392073e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:44:12.954191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b79f5-019b-48d6-b5f4-e8f8c270f569 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:12.954732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b79f5-019b-48d6-b5f4-e8f8c270f569 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:12.954834 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b79f5-019b-48d6-b5f4-e8f8c270f569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:12.976081 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-4c7b79f5-019b-48d6-b5f4-e8f8c270f569 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:12.977563 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4c7b79f5-019b-48d6-b5f4-e8f8c270f569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:13.045481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1109/2207] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:13.052598 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad6927-2f72-4057-9163-e9629f1bae65 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:13.055530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1dad6927-2f72-4057-9163-e9629f1bae65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:13.133426 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad6927-2f72-4057-9163-e9629f1bae65 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:13.137923 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232e407-a319-42cf-9f2e-6d5e773710d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:13.138654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232e407-a319-42cf-9f2e-6d5e773710d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:13.139164 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232e407-a319-42cf-9f2e-6d5e773710d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:13.139725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232e407-a319-42cf-9f2e-6d5e773710d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:13.155456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232e407-a319-42cf-9f2e-6d5e773710d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:13.158401 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232e407-a319-42cf-9f2e-6d5e773710d0 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:13.174985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1099/2208] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:44:13.746711 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b79f5-019b-48d6-b5f4-e8f8c270f569 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:13.748444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4c7b79f5-019b-48d6-b5f4-e8f8c270f569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:13.764126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b79f5-019b-48d6-b5f4-e8f8c270f569 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:13.774057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:13.775306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:13.775822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:13.776406 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8 admin admin] PATH_INFO: `/v3/projects/bf6f10002a634eb7ab4519af389895d6` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:13.777997 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf6f10002a634eb7ab4519af389895d6)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:13.781334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:13.862375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf6f10002a634eb7ab4519af389895d6', 'request_id': 'req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:13.875803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf6f10002a634eb7ab4519af389895d6', 'request_id': 'req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:13.908472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf6f10002a634eb7ab4519af389895d6', 'request_id': 'req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:13.958334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8 admin admin] The token cache is being invalidate because project bf6f10002a634eb7ab4519af389895d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:44:13.959419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:13.963689 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-b61c0939-1e61-40b9-b4a1-71fd0a4bc6f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:13.973248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1110/2209] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:44:13 2022] DELETE /identity/v3/projects/bf6f10002a634eb7ab4519af389895d6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:44:13.975118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a1fb8-0a1e-4ddf-bcea-da953c658152 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:13.976257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a1fb8-0a1e-4ddf-bcea-da953c658152 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:13.977544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a1fb8-0a1e-4ddf-bcea-da953c658152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:14.007445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-888a1fb8-0a1e-4ddf-bcea-da953c658152 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:14.009128 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-888a1fb8-0a1e-4ddf-bcea-da953c658152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:14.097543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239d035-0f71-4591-98b3-99901b7ea76d None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:14.098267 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239d035-0f71-4591-98b3-99901b7ea76d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:14.098788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239d035-0f71-4591-98b3-99901b7ea76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:14.101217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1100/2210] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:14.124128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-7239d035-0f71-4591-98b3-99901b7ea76d None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:14.125826 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-7239d035-0f71-4591-98b3-99901b7ea76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:14.140315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a1fb8-0a1e-4ddf-bcea-da953c658152 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:14.157825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a1fb8-0a1e-4ddf-bcea-da953c658152 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:14.158218 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1111/2211] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:44:14.165563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dc095-0328-47fa-9bd5-8e94abcd6cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:14.166495 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dc095-0328-47fa-9bd5-8e94abcd6cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:14.166932 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dc095-0328-47fa-9bd5-8e94abcd6cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:14.169068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dc095-0328-47fa-9bd5-8e94abcd6cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:14.169068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dc095-0328-47fa-9bd5-8e94abcd6cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:44:14.169068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dc095-0328-47fa-9bd5-8e94abcd6cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:14.170650 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dc095-0328-47fa-9bd5-8e94abcd6cd8 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:14.200049 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239d035-0f71-4591-98b3-99901b7ea76d None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:14.210628 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239d035-0f71-4591-98b3-99901b7ea76d None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:14.210917 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1101/2212] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:44:14.222549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7df2b5-d111-4ff2-ba55-1446212a4345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:14.223470 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df2b5-d111-4ff2-ba55-1446212a4345 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:14.226040 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df2b5-d111-4ff2-ba55-1446212a4345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:14.227088 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df2b5-d111-4ff2-ba55-1446212a4345 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:14.229056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7df2b5-d111-4ff2-ba55-1446212a4345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:14.233059 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7df2b5-d111-4ff2-ba55-1446212a4345 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:14.287717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1112/2213] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:44:14 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:44:14.291365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dc095-0328-47fa-9bd5-8e94abcd6cd8 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:14.308331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dc095-0328-47fa-9bd5-8e94abcd6cd8 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:14.408844 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f924bd6-9bb4-4f09-b36c-c24dccc9a4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:14.409391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f924bd6-9bb4-4f09-b36c-c24dccc9a4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:14.409676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f924bd6-9bb4-4f09-b36c-c24dccc9a4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:14.411431 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f924bd6-9bb4-4f09-b36c-c24dccc9a4f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:14.412149 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f924bd6-9bb4-4f09-b36c-c24dccc9a4f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:14.416427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f924bd6-9bb4-4f09-b36c-c24dccc9a4f9 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:14.468513 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1102/2214] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:44:14 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:44:14.473965 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7df2b5-d111-4ff2-ba55-1446212a4345 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:14.487019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7df2b5-d111-4ff2-ba55-1446212a4345 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:14.495080 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88920894-c537-443d-907f-ddcf8bfdb5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:14.496048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88920894-c537-443d-907f-ddcf8bfdb5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:14.496552 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88920894-c537-443d-907f-ddcf8bfdb5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:14.497011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88920894-c537-443d-907f-ddcf8bfdb5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:14.498213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88920894-c537-443d-907f-ddcf8bfdb5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:14.500543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88920894-c537-443d-907f-ddcf8bfdb5b2 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:14.518854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f924bd6-9bb4-4f09-b36c-c24dccc9a4f9 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:14.527192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1113/2215] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:44:14.532078 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f924bd6-9bb4-4f09-b36c-c24dccc9a4f9 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:14.537318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e46814-fdf9-485a-8dca-a256760d1ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:14.538248 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e46814-fdf9-485a-8dca-a256760d1ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:14.539487 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e46814-fdf9-485a-8dca-a256760d1ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:14.539892 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e46814-fdf9-485a-8dca-a256760d1ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:14.541185 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e46814-fdf9-485a-8dca-a256760d1ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:14.542714 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e46814-fdf9-485a-8dca-a256760d1ef8 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:14.558816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88920894-c537-443d-907f-ddcf8bfdb5b2 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:14.560461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1103/2216] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:44:14.571667 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88920894-c537-443d-907f-ddcf8bfdb5b2 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:14.578630 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5ec91-48f6-402e-9e8f-3ed2ebbe7bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:14.580239 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5ec91-48f6-402e-9e8f-3ed2ebbe7bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:14.580674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5ec91-48f6-402e-9e8f-3ed2ebbe7bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:14.581102 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5ec91-48f6-402e-9e8f-3ed2ebbe7bd7 admin admin] PATH_INFO: `/v3/projects/5efa2685b0ca4a4e86626fddbd68e4ed/users/588930f5618c4d7d92de82a89a17d923/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:14.600312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5ec91-48f6-402e-9e8f-3ed2ebbe7bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efa2685b0ca4a4e86626fddbd68e4ed, user_id=588930f5618c4d7d92de82a89a17d923, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:14.604538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5ec91-48f6-402e-9e8f-3ed2ebbe7bd7 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:14.628583 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1114/2217] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:44:14 2022] PUT /identity/v3/projects/5efa2685b0ca4a4e86626fddbd68e4ed/users/588930f5618c4d7d92de82a89a17d923/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:44:14.634953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91b008-a1e4-492b-81f6-11e5a29e9010 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:14.635234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91b008-a1e4-492b-81f6-11e5a29e9010 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:14.635512 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91b008-a1e4-492b-81f6-11e5a29e9010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:14.663154 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-3b91b008-a1e4-492b-81f6-11e5a29e9010 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:14.671062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3b91b008-a1e4-492b-81f6-11e5a29e9010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:14.801087 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1104/2218] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:14.825476 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5ec91-48f6-402e-9e8f-3ed2ebbe7bd7 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:14.828477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5fa5ec91-48f6-402e-9e8f-3ed2ebbe7bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:14.943667 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5ec91-48f6-402e-9e8f-3ed2ebbe7bd7 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:14.951996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a079fa3-2f4d-4f46-abe9-0598d5aec395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:14.952991 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a079fa3-2f4d-4f46-abe9-0598d5aec395 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:14.953492 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a079fa3-2f4d-4f46-abe9-0598d5aec395 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:14.953963 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a079fa3-2f4d-4f46-abe9-0598d5aec395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:14.975130 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a079fa3-2f4d-4f46-abe9-0598d5aec395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:14.976629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a079fa3-2f4d-4f46-abe9-0598d5aec395 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:14.988535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1115/2219] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:44:16.238984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a42d9d-c844-4ee9-8d1e-28f8cd20d4ec None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:16.239982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a42d9d-c844-4ee9-8d1e-28f8cd20d4ec None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:16.240472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a42d9d-c844-4ee9-8d1e-28f8cd20d4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:16.333648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-51a42d9d-c844-4ee9-8d1e-28f8cd20d4ec None None] MFA Rules not processed for user `588930f5618c4d7d92de82a89a17d923`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:16.335124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-51a42d9d-c844-4ee9-8d1e-28f8cd20d4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:16.476522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1105/2220] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:16.492577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a079fa3-2f4d-4f46-abe9-0598d5aec395 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:16.495537 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6a079fa3-2f4d-4f46-abe9-0598d5aec395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:16.576431 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a079fa3-2f4d-4f46-abe9-0598d5aec395 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:16.583159 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb9c8d-1c1e-4926-a854-3858daeb272d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:16.583816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb9c8d-1c1e-4926-a854-3858daeb272d service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:16.587137 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb9c8d-1c1e-4926-a854-3858daeb272d service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:16.587430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb9c8d-1c1e-4926-a854-3858daeb272d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:16.603230 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb9c8d-1c1e-4926-a854-3858daeb272d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:16.604857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb9c8d-1c1e-4926-a854-3858daeb272d service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:16.615576 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1116/2221] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:44:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:44:17.290750 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2c038-7f85-4c4c-9539-480561ed0042 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:17.291690 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2c038-7f85-4c4c-9539-480561ed0042 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:17.292188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2c038-7f85-4c4c-9539-480561ed0042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:17.324630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-70b2c038-7f85-4c4c-9539-480561ed0042 None None] MFA Rules not processed for user `d41e016e2e7e4caaab8fdef9a1f6bc66`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:17.325865 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-70b2c038-7f85-4c4c-9539-480561ed0042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:17.410589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1106/2222] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:17.419134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb9c8d-1c1e-4926-a854-3858daeb272d service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:17.420806 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8acb9c8d-1c1e-4926-a854-3858daeb272d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:17.514824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb9c8d-1c1e-4926-a854-3858daeb272d service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:17.521302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01d573-26a7-4a38-bc09-b1f4561794ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:17.522163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01d573-26a7-4a38-bc09-b1f4561794ed service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:17.522591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01d573-26a7-4a38-bc09-b1f4561794ed service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:17.523048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01d573-26a7-4a38-bc09-b1f4561794ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:17.526319 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ee01d573-26a7-4a38-bc09-b1f4561794ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:17.596791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01d573-26a7-4a38-bc09-b1f4561794ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:17.598406 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01d573-26a7-4a38-bc09-b1f4561794ed service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:17.608635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1117/2223] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:44:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:44:18.081227 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73a6ef-99d9-4dcd-bf72-3eafe57aa036 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:18.081527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73a6ef-99d9-4dcd-bf72-3eafe57aa036 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:18.081806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73a6ef-99d9-4dcd-bf72-3eafe57aa036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:18.121096 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-0b73a6ef-99d9-4dcd-bf72-3eafe57aa036 None None] MFA Rules not processed for user `588930f5618c4d7d92de82a89a17d923`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:18.122703 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0b73a6ef-99d9-4dcd-bf72-3eafe57aa036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:18.135320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1107/2224] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:19.113021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01d573-26a7-4a38-bc09-b1f4561794ed service nova] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:19.115021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ee01d573-26a7-4a38-bc09-b1f4561794ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:19.146461 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01d573-26a7-4a38-bc09-b1f4561794ed service nova] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:19.151344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe9ca-5532-4865-a107-03c64f150129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:19.152228 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe9ca-5532-4865-a107-03c64f150129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:19.152511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe9ca-5532-4865-a107-03c64f150129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:19.152788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe9ca-5532-4865-a107-03c64f150129 admin admin] PATH_INFO: `/v3/users/53ea4c7e96cc4162badcba6b3844d721` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:19.154502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fe9ca-5532-4865-a107-03c64f150129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ea4c7e96cc4162badcba6b3844d721)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:19.156622 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fe9ca-5532-4865-a107-03c64f150129 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:19.231894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1c3fe9ca-5532-4865-a107-03c64f150129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ea4c7e96cc4162badcba6b3844d721'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:19.233105 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1c3fe9ca-5532-4865-a107-03c64f150129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ea4c7e96cc4162badcba6b3844d721'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:19.251180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1c3fe9ca-5532-4865-a107-03c64f150129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ea4c7e96cc4162badcba6b3844d721'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:19.252047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1c3fe9ca-5532-4865-a107-03c64f150129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ea4c7e96cc4162badcba6b3844d721'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:19.260621 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1c3fe9ca-5532-4865-a107-03c64f150129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ea4c7e96cc4162badcba6b3844d721'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:19.280038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1118/2225] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:44:19 2022] DELETE /identity/v3/users/53ea4c7e96cc4162badcba6b3844d721 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:44:19.284478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eb45d-64d3-43f9-a774-ff113b04d6fa None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:19.290325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eb45d-64d3-43f9-a774-ff113b04d6fa None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:19.290524 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eb45d-64d3-43f9-a774-ff113b04d6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:19.309569 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-003eb45d-64d3-43f9-a774-ff113b04d6fa None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:19.310946 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-003eb45d-64d3-43f9-a774-ff113b04d6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:19.444407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1108/2226] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:19.453340 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe9ca-5532-4865-a107-03c64f150129 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:19.454869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-1c3fe9ca-5532-4865-a107-03c64f150129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:19.542767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe9ca-5532-4865-a107-03c64f150129 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:19.546599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc152fe-1955-4abc-83d1-f7475077f22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:19.547502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc152fe-1955-4abc-83d1-f7475077f22b service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:19.548128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc152fe-1955-4abc-83d1-f7475077f22b service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:19.548416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc152fe-1955-4abc-83d1-f7475077f22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:19.571312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc152fe-1955-4abc-83d1-f7475077f22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:19.573120 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc152fe-1955-4abc-83d1-f7475077f22b service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:19.583914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1119/2227] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:44:19.907912 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eb45d-64d3-43f9-a774-ff113b04d6fa None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:19.909811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-003eb45d-64d3-43f9-a774-ff113b04d6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:19.925047 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eb45d-64d3-43f9-a774-ff113b04d6fa None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:19.932026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:19.934857 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:19.935260 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:19.935642 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0 admin admin] PATH_INFO: `/v3/projects/3d681b6f58434818bd35fdf80cd331fd` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:19.937362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d681b6f58434818bd35fdf80cd331fd)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:19.939476 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:20.006846 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d681b6f58434818bd35fdf80cd331fd', 'request_id': 'req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:20.017584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d681b6f58434818bd35fdf80cd331fd', 'request_id': 'req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:20.024814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d681b6f58434818bd35fdf80cd331fd', 'request_id': 'req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:20.038194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0 admin admin] The token cache is being invalidate because project 3d681b6f58434818bd35fdf80cd331fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:44:20.038358 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:20.039227 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a8cc1ff9-e8f4-4185-bc06-6dc4b559f7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:20.041718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1109/2228] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:44:19 2022] DELETE /identity/v3/projects/3d681b6f58434818bd35fdf80cd331fd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:44:20.046582 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068163c8-95d9-49bb-af71-ed1b62db0316 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:20.046909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068163c8-95d9-49bb-af71-ed1b62db0316 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:20.047193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068163c8-95d9-49bb-af71-ed1b62db0316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:20.066932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-068163c8-95d9-49bb-af71-ed1b62db0316 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:20.068247 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-068163c8-95d9-49bb-af71-ed1b62db0316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:20.167670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1120/2229] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:20.175279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11578c60-87d6-45bd-86f5-e6f6708ecd4a None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:20.175903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11578c60-87d6-45bd-86f5-e6f6708ecd4a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:20.176406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11578c60-87d6-45bd-86f5-e6f6708ecd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:20.207878 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-11578c60-87d6-45bd-86f5-e6f6708ecd4a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:20.210058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-11578c60-87d6-45bd-86f5-e6f6708ecd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:20.220359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1110/2230] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:20.224747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068163c8-95d9-49bb-af71-ed1b62db0316 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:20.236413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068163c8-95d9-49bb-af71-ed1b62db0316 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:20.245108 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64be857-140a-43e6-bd35-720fef75b7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:20.246040 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64be857-140a-43e6-bd35-720fef75b7dd admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:20.246506 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64be857-140a-43e6-bd35-720fef75b7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:20.246999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64be857-140a-43e6-bd35-720fef75b7dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:20.247962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64be857-140a-43e6-bd35-720fef75b7dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:44:20.248451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64be857-140a-43e6-bd35-720fef75b7dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:20.250302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64be857-140a-43e6-bd35-720fef75b7dd admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:20.267062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1121/2231] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:44:20.268700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11578c60-87d6-45bd-86f5-e6f6708ecd4a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:20.280402 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11578c60-87d6-45bd-86f5-e6f6708ecd4a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:20.291912 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7a639-7eb2-40f5-bad3-2a593e013be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:20.292631 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7a639-7eb2-40f5-bad3-2a593e013be5 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:20.292856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7a639-7eb2-40f5-bad3-2a593e013be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:20.293321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7a639-7eb2-40f5-bad3-2a593e013be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:20.294192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7a639-7eb2-40f5-bad3-2a593e013be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:20.296144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7a639-7eb2-40f5-bad3-2a593e013be5 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:20.327192 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1111/2232] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:44:20 2022] POST /identity/v3/projects => generated 361 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:44:20.328744 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64be857-140a-43e6-bd35-720fef75b7dd admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:20.339993 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64be857-140a-43e6-bd35-720fef75b7dd admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:20.411873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b642572-2851-47cb-91af-e0b9a36389fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:20.412560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b642572-2851-47cb-91af-e0b9a36389fe admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:20.412835 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b642572-2851-47cb-91af-e0b9a36389fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:20.413108 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b642572-2851-47cb-91af-e0b9a36389fe admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:20.413958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b642572-2851-47cb-91af-e0b9a36389fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:20.416036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b642572-2851-47cb-91af-e0b9a36389fe admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:20.450714 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1122/2233] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:44:20 2022] POST /identity/v3/users => generated 281 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:44:20.453503 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7a639-7eb2-40f5-bad3-2a593e013be5 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:20.467721 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7a639-7eb2-40f5-bad3-2a593e013be5 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:20.473782 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360b6a8-f11e-4502-a829-2cec65b1a36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:20.474775 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360b6a8-f11e-4502-a829-2cec65b1a36a admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:20.475411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360b6a8-f11e-4502-a829-2cec65b1a36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:20.475847 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360b6a8-f11e-4502-a829-2cec65b1a36a admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:20.476887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360b6a8-f11e-4502-a829-2cec65b1a36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:20.478690 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360b6a8-f11e-4502-a829-2cec65b1a36a admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:20.489999 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1112/2234] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:44:20.494643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b642572-2851-47cb-91af-e0b9a36389fe admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:20.506092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b642572-2851-47cb-91af-e0b9a36389fe admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:20.517551 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620cc7d-3c08-41af-bf77-a9033c2ef551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:20.519474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620cc7d-3c08-41af-bf77-a9033c2ef551 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:20.520117 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620cc7d-3c08-41af-bf77-a9033c2ef551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:20.520645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620cc7d-3c08-41af-bf77-a9033c2ef551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:20.522228 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620cc7d-3c08-41af-bf77-a9033c2ef551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:20.524859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620cc7d-3c08-41af-bf77-a9033c2ef551 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:20.537522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1123/2235] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:44:20.541703 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360b6a8-f11e-4502-a829-2cec65b1a36a admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:20.553617 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360b6a8-f11e-4502-a829-2cec65b1a36a admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:20.572030 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febea7b-b247-4dfc-9bf7-27404603bf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:20.572970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febea7b-b247-4dfc-9bf7-27404603bf5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:20.573290 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febea7b-b247-4dfc-9bf7-27404603bf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:20.573775 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febea7b-b247-4dfc-9bf7-27404603bf5d admin admin] PATH_INFO: `/v3/projects/bf3177fb55854bbfb58e3481760bd365/users/c880903316b34d3d9b19f57eebfbe5a5/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:20.612961 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febea7b-b247-4dfc-9bf7-27404603bf5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3177fb55854bbfb58e3481760bd365, user_id=c880903316b34d3d9b19f57eebfbe5a5, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:20.616770 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febea7b-b247-4dfc-9bf7-27404603bf5d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:20.647213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1113/2236] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:44:20 2022] PUT /identity/v3/projects/bf3177fb55854bbfb58e3481760bd365/users/c880903316b34d3d9b19f57eebfbe5a5/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:44:20.656073 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ec67-1dd2-489b-8ae0-3edad09bd775 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:20.656715 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ec67-1dd2-489b-8ae0-3edad09bd775 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:20.657304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980ec67-1dd2-489b-8ae0-3edad09bd775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:20.714155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-6980ec67-1dd2-489b-8ae0-3edad09bd775 None None] MFA Rules not processed for user `c880903316b34d3d9b19f57eebfbe5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:20.723924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6980ec67-1dd2-489b-8ae0-3edad09bd775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:20.891708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1124/2237] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:20.930872 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febea7b-b247-4dfc-9bf7-27404603bf5d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:20.932758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9febea7b-b247-4dfc-9bf7-27404603bf5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:21.001910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febea7b-b247-4dfc-9bf7-27404603bf5d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:21.006190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8137-39e1-4c34-86c4-546f7de4f8e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:21.006975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8137-39e1-4c34-86c4-546f7de4f8e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:21.007321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8137-39e1-4c34-86c4-546f7de4f8e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:21.008202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8137-39e1-4c34-86c4-546f7de4f8e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:21.018002 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b8137-39e1-4c34-86c4-546f7de4f8e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:21.019708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b8137-39e1-4c34-86c4-546f7de4f8e8 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:21.032032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1114/2238] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:44:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:44:21.047165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980ec67-1dd2-489b-8ae0-3edad09bd775 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:21.129880 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980ec67-1dd2-489b-8ae0-3edad09bd775 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:21.135967 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8772b8-c70c-47b9-8150-0c65d0218373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:21.136861 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8772b8-c70c-47b9-8150-0c65d0218373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:21.137135 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8772b8-c70c-47b9-8150-0c65d0218373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:21.137403 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8772b8-c70c-47b9-8150-0c65d0218373 admin admin] PATH_INFO: `/v3/users/c880903316b34d3d9b19f57eebfbe5a5` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:21.138876 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8772b8-c70c-47b9-8150-0c65d0218373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c880903316b34d3d9b19f57eebfbe5a5)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:21.140989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8772b8-c70c-47b9-8150-0c65d0218373 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:21.205804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-0c8772b8-c70c-47b9-8150-0c65d0218373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c880903316b34d3d9b19f57eebfbe5a5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:21.206452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-0c8772b8-c70c-47b9-8150-0c65d0218373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c880903316b34d3d9b19f57eebfbe5a5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:21.222045 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-0c8772b8-c70c-47b9-8150-0c65d0218373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c880903316b34d3d9b19f57eebfbe5a5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:21.222836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-0c8772b8-c70c-47b9-8150-0c65d0218373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c880903316b34d3d9b19f57eebfbe5a5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:21.232735 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-0c8772b8-c70c-47b9-8150-0c65d0218373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c880903316b34d3d9b19f57eebfbe5a5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:21.256629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1125/2239] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:44:21 2022] DELETE /identity/v3/users/c880903316b34d3d9b19f57eebfbe5a5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:44:21.259280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56edd9-cf0f-4641-8d8e-90b5a3652e64 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:21.259612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56edd9-cf0f-4641-8d8e-90b5a3652e64 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:21.259875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56edd9-cf0f-4641-8d8e-90b5a3652e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:21.288802 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-9c56edd9-cf0f-4641-8d8e-90b5a3652e64 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:21.290943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9c56edd9-cf0f-4641-8d8e-90b5a3652e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:21.360385 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1115/2240] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:44:21.370627 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8772b8-c70c-47b9-8150-0c65d0218373 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:21.372321 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-0c8772b8-c70c-47b9-8150-0c65d0218373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:21.463629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8772b8-c70c-47b9-8150-0c65d0218373 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:21.470961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26153a5-393d-4c61-a886-d7c3ba9a9e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:21.471744 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26153a5-393d-4c61-a886-d7c3ba9a9e96 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:21.472123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26153a5-393d-4c61-a886-d7c3ba9a9e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:21.474342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26153a5-393d-4c61-a886-d7c3ba9a9e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:21.487926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26153a5-393d-4c61-a886-d7c3ba9a9e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:21.491563 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26153a5-393d-4c61-a886-d7c3ba9a9e96 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:21.516727 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1126/2241] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:44:21.872074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56edd9-cf0f-4641-8d8e-90b5a3652e64 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:21.873682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9c56edd9-cf0f-4641-8d8e-90b5a3652e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:21.887459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56edd9-cf0f-4641-8d8e-90b5a3652e64 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:21.893058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0032847-fccf-4562-94fd-52fb9a2e135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:21.894330 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0032847-fccf-4562-94fd-52fb9a2e135f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:21.894843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0032847-fccf-4562-94fd-52fb9a2e135f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:21.895271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0032847-fccf-4562-94fd-52fb9a2e135f admin admin] PATH_INFO: `/v3/projects/bf3177fb55854bbfb58e3481760bd365` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:21.897128 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0032847-fccf-4562-94fd-52fb9a2e135f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3177fb55854bbfb58e3481760bd365)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:21.900023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0032847-fccf-4562-94fd-52fb9a2e135f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:21.956714 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a0032847-fccf-4562-94fd-52fb9a2e135f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3177fb55854bbfb58e3481760bd365', 'request_id': 'req-a0032847-fccf-4562-94fd-52fb9a2e135f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:21.975048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a0032847-fccf-4562-94fd-52fb9a2e135f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3177fb55854bbfb58e3481760bd365', 'request_id': 'req-a0032847-fccf-4562-94fd-52fb9a2e135f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:21.988963 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a0032847-fccf-4562-94fd-52fb9a2e135f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3177fb55854bbfb58e3481760bd365', 'request_id': 'req-a0032847-fccf-4562-94fd-52fb9a2e135f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:22.000932 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a0032847-fccf-4562-94fd-52fb9a2e135f admin admin] The token cache is being invalidate because project bf3177fb55854bbfb58e3481760bd365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:44:22.001213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a0032847-fccf-4562-94fd-52fb9a2e135f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:22.001881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a0032847-fccf-4562-94fd-52fb9a2e135f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:44:22.003896 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1116/2242] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:44:21 2022] DELETE /identity/v3/projects/bf3177fb55854bbfb58e3481760bd365 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:44:22.008544 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2c05-816b-4acf-895b-1880a04b177b None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:22.009022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2c05-816b-4acf-895b-1880a04b177b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:22.009324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2c05-816b-4acf-895b-1880a04b177b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:22.028329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-3ffd2c05-816b-4acf-895b-1880a04b177b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:22.029636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3ffd2c05-816b-4acf-895b-1880a04b177b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:22.106826 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1127/2243] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:44:22.115532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e018087-4283-4e36-9bdc-604d9cd58e9f None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:22.116137 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e018087-4283-4e36-9bdc-604d9cd58e9f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:22.116423 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e018087-4283-4e36-9bdc-604d9cd58e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:22.138340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-0e018087-4283-4e36-9bdc-604d9cd58e9f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:22.139594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0e018087-4283-4e36-9bdc-604d9cd58e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:22.148651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1117/2244] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:22.153131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd2c05-816b-4acf-895b-1880a04b177b None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:22.164093 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd2c05-816b-4acf-895b-1880a04b177b None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:22.169121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b7559-b390-43a6-8d1c-cbee8c86496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:22.170286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7559-b390-43a6-8d1c-cbee8c86496f admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:22.170705 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7559-b390-43a6-8d1c-cbee8c86496f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:22.171024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7559-b390-43a6-8d1c-cbee8c86496f admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:22.172443 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b7559-b390-43a6-8d1c-cbee8c86496f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:44:22.172756 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b7559-b390-43a6-8d1c-cbee8c86496f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:22.174563 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b7559-b390-43a6-8d1c-cbee8c86496f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:22.192158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1128/2245] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:44:22.193503 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e018087-4283-4e36-9bdc-604d9cd58e9f None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:22.203191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e018087-4283-4e36-9bdc-604d9cd58e9f None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:22.207914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227168-1953-473c-8242-868d3574b296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:22.208544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227168-1953-473c-8242-868d3574b296 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:22.208829 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227168-1953-473c-8242-868d3574b296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:22.215682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227168-1953-473c-8242-868d3574b296 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:22.216612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca227168-1953-473c-8242-868d3574b296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:22.218947 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca227168-1953-473c-8242-868d3574b296 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:22.255654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1118/2246] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:44:22 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:44:22.260546 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b7559-b390-43a6-8d1c-cbee8c86496f admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:22.271209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b7559-b390-43a6-8d1c-cbee8c86496f admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:22.357878 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e5ab3-4ae5-4fa0-b163-9e624ca58048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:22.358654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e5ab3-4ae5-4fa0-b163-9e624ca58048 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:22.359128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e5ab3-4ae5-4fa0-b163-9e624ca58048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:22.359285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e5ab3-4ae5-4fa0-b163-9e624ca58048 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:22.359986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e5ab3-4ae5-4fa0-b163-9e624ca58048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:22.362008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e5ab3-4ae5-4fa0-b163-9e624ca58048 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:22.391648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1129/2247] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:44:22 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:44:22.395841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227168-1953-473c-8242-868d3574b296 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:22.409937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227168-1953-473c-8242-868d3574b296 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:22.415433 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570116c-aee9-4da4-8463-c12fcd530de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:22.416190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570116c-aee9-4da4-8463-c12fcd530de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:22.416539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570116c-aee9-4da4-8463-c12fcd530de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:22.416878 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570116c-aee9-4da4-8463-c12fcd530de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:22.417921 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570116c-aee9-4da4-8463-c12fcd530de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:22.419758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570116c-aee9-4da4-8463-c12fcd530de6 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:22.436044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1119/2248] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:44:22.439908 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e5ab3-4ae5-4fa0-b163-9e624ca58048 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:22.457796 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e5ab3-4ae5-4fa0-b163-9e624ca58048 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:22.465588 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f27c64-7d70-4b72-b372-f41423eb544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:22.466326 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f27c64-7d70-4b72-b372-f41423eb544c admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:22.467192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f27c64-7d70-4b72-b372-f41423eb544c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:22.467192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f27c64-7d70-4b72-b372-f41423eb544c admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:22.468081 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f27c64-7d70-4b72-b372-f41423eb544c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:22.470165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f27c64-7d70-4b72-b372-f41423eb544c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:22.494724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1130/2249] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:44:22.497058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570116c-aee9-4da4-8463-c12fcd530de6 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:22.512717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570116c-aee9-4da4-8463-c12fcd530de6 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:22.529245 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972db69a-fb70-4426-8ae7-70b464ef4731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:22.530145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972db69a-fb70-4426-8ae7-70b464ef4731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:22.530426 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972db69a-fb70-4426-8ae7-70b464ef4731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:22.530722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972db69a-fb70-4426-8ae7-70b464ef4731 admin admin] PATH_INFO: `/v3/projects/75736e80e44a481484d88e394c5269d6/users/967a537eb434465e8294c324a83ef5b0/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:22.548757 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972db69a-fb70-4426-8ae7-70b464ef4731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75736e80e44a481484d88e394c5269d6, user_id=967a537eb434465e8294c324a83ef5b0, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:22.552771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972db69a-fb70-4426-8ae7-70b464ef4731 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:22.570631 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1120/2250] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:44:22 2022] PUT /identity/v3/projects/75736e80e44a481484d88e394c5269d6/users/967a537eb434465e8294c324a83ef5b0/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:44:22.575664 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f67b7e-a85c-492e-a45b-7b338d130ecc None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:22.576052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f67b7e-a85c-492e-a45b-7b338d130ecc None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:22.576428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f67b7e-a85c-492e-a45b-7b338d130ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:22.596225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-42f67b7e-a85c-492e-a45b-7b338d130ecc None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:22.602943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-42f67b7e-a85c-492e-a45b-7b338d130ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:22.672062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1131/2251] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:22.682012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972db69a-fb70-4426-8ae7-70b464ef4731 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:22.684057 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-972db69a-fb70-4426-8ae7-70b464ef4731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:22.755429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972db69a-fb70-4426-8ae7-70b464ef4731 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:22.759779 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab93cb-ad74-43ac-97f1-1405c13ddf6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:22.760440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab93cb-ad74-43ac-97f1-1405c13ddf6c service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:22.760719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab93cb-ad74-43ac-97f1-1405c13ddf6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:22.761027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab93cb-ad74-43ac-97f1-1405c13ddf6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:22.771510 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab93cb-ad74-43ac-97f1-1405c13ddf6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:22.772956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab93cb-ad74-43ac-97f1-1405c13ddf6c service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:22.785393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1121/2252] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:44:23.461576 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1635d9-b895-46b7-b212-25b2e63101f3 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:23.462118 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1635d9-b895-46b7-b212-25b2e63101f3 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:23.462327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1635d9-b895-46b7-b212-25b2e63101f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:23.488634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ff1635d9-b895-46b7-b212-25b2e63101f3 None None] MFA Rules not processed for user `967a537eb434465e8294c324a83ef5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:23.489943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ff1635d9-b895-46b7-b212-25b2e63101f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:23.563142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1132/2253] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:23.577946 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab93cb-ad74-43ac-97f1-1405c13ddf6c service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:23.580687 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-bbab93cb-ad74-43ac-97f1-1405c13ddf6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:23.656683 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab93cb-ad74-43ac-97f1-1405c13ddf6c service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:23.660564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467b4d3-195e-422d-b63a-efc200bbf340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:23.661218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467b4d3-195e-422d-b63a-efc200bbf340 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:23.661496 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467b4d3-195e-422d-b63a-efc200bbf340 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:23.661773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467b4d3-195e-422d-b63a-efc200bbf340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:23.672025 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467b4d3-195e-422d-b63a-efc200bbf340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:23.673995 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467b4d3-195e-422d-b63a-efc200bbf340 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:23.686767 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1122/2254] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:44:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:44:25.033330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705b08f-dd7f-4515-af47-9bcb7387b9cd None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:25.033760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705b08f-dd7f-4515-af47-9bcb7387b9cd None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:25.033836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705b08f-dd7f-4515-af47-9bcb7387b9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:25.051236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-e705b08f-dd7f-4515-af47-9bcb7387b9cd None None] MFA Rules not processed for user `967a537eb434465e8294c324a83ef5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:25.052444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e705b08f-dd7f-4515-af47-9bcb7387b9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:25.060340 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1133/2255] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:36.340278 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad874d-7f7d-4061-a512-008bb3e72f5c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:36.340811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad874d-7f7d-4061-a512-008bb3e72f5c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:36.340811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad874d-7f7d-4061-a512-008bb3e72f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:36.366804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c6ad874d-7f7d-4061-a512-008bb3e72f5c None None] MFA Rules not processed for user `ac1708b4ee7e43afaac75452be3b195e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:36.368788 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c6ad874d-7f7d-4061-a512-008bb3e72f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:36.438289 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1123/2256] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:43.786579 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a78bb4-01ea-4918-b2ce-482142b066cc None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:43.787156 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a78bb4-01ea-4918-b2ce-482142b066cc None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:43.787280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a78bb4-01ea-4918-b2ce-482142b066cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:43.807617 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-a0a78bb4-01ea-4918-b2ce-482142b066cc None None] MFA Rules not processed for user `7802c329d4ca4eccb28fdec9f8082cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:43.808826 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a0a78bb4-01ea-4918-b2ce-482142b066cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:43.883671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1134/2257] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:48.686751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488c47-d9ff-44ed-9f0b-fed620a2c499 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:48.687797 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488c47-d9ff-44ed-9f0b-fed620a2c499 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:48.688234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488c47-d9ff-44ed-9f0b-fed620a2c499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:48.712467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-1e488c47-d9ff-44ed-9f0b-fed620a2c499 None None] MFA Rules not processed for user `967a537eb434465e8294c324a83ef5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:48.714173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1e488c47-d9ff-44ed-9f0b-fed620a2c499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:48.731046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1124/2258] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:44:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:57.428894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d64755-ca1c-4e15-a915-931ad574d1de None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:57.429490 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d64755-ca1c-4e15-a915-931ad574d1de None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:57.429490 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d64755-ca1c-4e15-a915-931ad574d1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:57.458185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-b8d64755-ca1c-4e15-a915-931ad574d1de None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:44:57.459496 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b8d64755-ca1c-4e15-a915-931ad574d1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:57.540144 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1135/2259] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:44:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:44:57.581460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e488c47-d9ff-44ed-9f0b-fed620a2c499 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:44:57.582901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1e488c47-d9ff-44ed-9f0b-fed620a2c499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:44:57.656074 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e488c47-d9ff-44ed-9f0b-fed620a2c499 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:44:57.661001 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe01739-8ca8-4c99-ad9f-dc48ec01d631 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:44:57.661639 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe01739-8ca8-4c99-ad9f-dc48ec01d631 service swift] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:44:57.661914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe01739-8ca8-4c99-ad9f-dc48ec01d631 service swift] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:44:57.662184 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe01739-8ca8-4c99-ad9f-dc48ec01d631 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:44:57.670755 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe01739-8ca8-4c99-ad9f-dc48ec01d631 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:44:57.672354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe01739-8ca8-4c99-ad9f-dc48ec01d631 service swift] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:44:57.680833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1125/2260] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:44:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:45:15.372298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d64755-ca1c-4e15-a915-931ad574d1de None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:15.391245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d64755-ca1c-4e15-a915-931ad574d1de None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:15.395144 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bd01c-9d60-49b8-9cb6-8cb459737591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:15.395784 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bd01c-9d60-49b8-9cb6-8cb459737591 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:15.396068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bd01c-9d60-49b8-9cb6-8cb459737591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:15.396345 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bd01c-9d60-49b8-9cb6-8cb459737591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:15.398717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b24bd01c-9d60-49b8-9cb6-8cb459737591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:15.463441 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bd01c-9d60-49b8-9cb6-8cb459737591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:15.464884 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bd01c-9d60-49b8-9cb6-8cb459737591 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:15.474732 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1136/2261] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:45:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:45:28.882318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bd249-c1ad-4be2-bbb1-235f9db68b83 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:28.882318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bd249-c1ad-4be2-bbb1-235f9db68b83 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:28.882318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bd249-c1ad-4be2-bbb1-235f9db68b83 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:28.882318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1126/2262] 10.222.0.76 () {54 vars in 921 bytes} [Thu May 12 17:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:45:28.891909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3ef99-738b-4525-a027-2c6bc690a652 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:28.892328 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3ef99-738b-4525-a027-2c6bc690a652 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:28.892328 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3ef99-738b-4525-a027-2c6bc690a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:28.962079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-a3d3ef99-738b-4525-a027-2c6bc690a652 None None] MFA Rules not processed for user `04ad234318ad47589b844351cd3bb3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:45:28.964034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a3d3ef99-738b-4525-a027-2c6bc690a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:29.098530 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1137/2263] 10.222.0.76 () {58 vars in 1018 bytes} [Thu May 12 17:45:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:45:29.114000 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bd249-c1ad-4be2-bbb1-235f9db68b83 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:29.115978 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-219bd249-c1ad-4be2-bbb1-235f9db68b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:29.216231 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bd249-c1ad-4be2-bbb1-235f9db68b83 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:29.220920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595958ad-8542-4597-bd2f-fae256fb6469 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a003b6145fb4c5c8919020d9208afa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:29.221567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595958ad-8542-4597-bd2f-fae256fb6469 service glance] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:29.221851 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595958ad-8542-4597-bd2f-fae256fb6469 service glance] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:29.222123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595958ad-8542-4597-bd2f-fae256fb6469 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:29.237498 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595958ad-8542-4597-bd2f-fae256fb6469 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:29.238976 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595958ad-8542-4597-bd2f-fae256fb6469 service glance] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:29.256740 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1127/2264] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:45:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:45:29.346820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88d14-76e1-4895-9821-4580d26819e2 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:29.347363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88d14-76e1-4895-9821-4580d26819e2 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:29.348305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88d14-76e1-4895-9821-4580d26819e2 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:29.350794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1138/2265] 10.222.0.76 () {54 vars in 921 bytes} [Thu May 12 17:45:29 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:45:29.359947 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70947912-76e0-4d63-a75d-e6de859b3574 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:29.360306 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70947912-76e0-4d63-a75d-e6de859b3574 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:29.360695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70947912-76e0-4d63-a75d-e6de859b3574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:29.393909 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-70947912-76e0-4d63-a75d-e6de859b3574 None None] MFA Rules not processed for user `731d9124a2294b95a7cf1127e5362b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:45:29.395376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-70947912-76e0-4d63-a75d-e6de859b3574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:29.402961 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1128/2266] 10.222.0.76 () {58 vars in 1018 bytes} [Thu May 12 17:45:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:45:29.420645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88d14-76e1-4895-9821-4580d26819e2 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:29.422899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-afe88d14-76e1-4895-9821-4580d26819e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:29.441644 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88d14-76e1-4895-9821-4580d26819e2 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:29.447041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdacb01-700d-4397-9ec1-add0f7b0d16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:29.447890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdacb01-700d-4397-9ec1-add0f7b0d16c service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:29.448409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdacb01-700d-4397-9ec1-add0f7b0d16c service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:29.448682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdacb01-700d-4397-9ec1-add0f7b0d16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:29.457465 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdacb01-700d-4397-9ec1-add0f7b0d16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:29.459039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdacb01-700d-4397-9ec1-add0f7b0d16c service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:29.471240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1139/2267] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:45:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:45:29.575088 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24418e9-6cba-4d5b-b160-c4d0f76bd4ea None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:29.575568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24418e9-6cba-4d5b-b160-c4d0f76bd4ea None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:29.575969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24418e9-6cba-4d5b-b160-c4d0f76bd4ea None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:29.577590 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1129/2268] 10.222.0.76 () {54 vars in 921 bytes} [Thu May 12 17:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:45:29.583760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124ce9c-9514-4ca9-be1c-6b31d680817c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:29.584221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124ce9c-9514-4ca9-be1c-6b31d680817c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:29.584762 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124ce9c-9514-4ca9-be1c-6b31d680817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:29.604689 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-e124ce9c-9514-4ca9-be1c-6b31d680817c None None] MFA Rules not processed for user `04ad234318ad47589b844351cd3bb3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:45:29.605893 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e124ce9c-9514-4ca9-be1c-6b31d680817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:29.615661 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1140/2269] 10.222.0.76 () {58 vars in 1018 bytes} [Thu May 12 17:45:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:45:29.627452 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24418e9-6cba-4d5b-b160-c4d0f76bd4ea None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:29.639089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24418e9-6cba-4d5b-b160-c4d0f76bd4ea None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:29.643054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021b19d-d01d-4515-8cb2-1c5afca23e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:29.643989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021b19d-d01d-4515-8cb2-1c5afca23e49 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:29.644272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021b19d-d01d-4515-8cb2-1c5afca23e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:29.644548 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021b19d-d01d-4515-8cb2-1c5afca23e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:29.655279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021b19d-d01d-4515-8cb2-1c5afca23e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:29.656728 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021b19d-d01d-4515-8cb2-1c5afca23e49 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:29.667776 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1130/2270] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:45:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:45:31.177957 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa1fd7-24ed-4dcf-b0e6-862647cae454 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:31.178466 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa1fd7-24ed-4dcf-b0e6-862647cae454 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:31.178565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa1fd7-24ed-4dcf-b0e6-862647cae454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:31.196271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-25aa1fd7-24ed-4dcf-b0e6-862647cae454 None None] MFA Rules not processed for user `ee532b08897148dd9ff0482a00f537f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:45:31.197598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-25aa1fd7-24ed-4dcf-b0e6-862647cae454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:31.250860 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1141/2271] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:45:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:45:34.000201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cc566-0fa7-4c03-b1b6-bce66f823f92 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:34.000699 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cc566-0fa7-4c03-b1b6-bce66f823f92 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:34.000796 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cc566-0fa7-4c03-b1b6-bce66f823f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:34.050467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-705cc566-0fa7-4c03-b1b6-bce66f823f92 None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:45:34.051726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-705cc566-0fa7-4c03-b1b6-bce66f823f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:34.068418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1131/2272] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:45:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:45:34.080861 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa1fd7-24ed-4dcf-b0e6-862647cae454 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:34.104235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa1fd7-24ed-4dcf-b0e6-862647cae454 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:34.109336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a3a7e-87f3-4c46-a9b3-ba902a96541c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:34.110190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3a7e-87f3-4c46-a9b3-ba902a96541c service swift] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:34.110638 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3a7e-87f3-4c46-a9b3-ba902a96541c service swift] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:34.111227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3a7e-87f3-4c46-a9b3-ba902a96541c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:34.120889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a3a7e-87f3-4c46-a9b3-ba902a96541c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:34.122472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a3a7e-87f3-4c46-a9b3-ba902a96541c service swift] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:34.131079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1142/2273] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:45:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:45:38.821958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cc566-0fa7-4c03-b1b6-bce66f823f92 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:38.823812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-705cc566-0fa7-4c03-b1b6-bce66f823f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:38.979114 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cc566-0fa7-4c03-b1b6-bce66f823f92 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:38.994294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f4562-8c5d-44b0-b2f5-e295d17a7120 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01fa037b14c456eb533b5a86da0a370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:38.995138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f4562-8c5d-44b0-b2f5-e295d17a7120 service placement] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:38.995425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f4562-8c5d-44b0-b2f5-e295d17a7120 service placement] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:38.995697 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f4562-8c5d-44b0-b2f5-e295d17a7120 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:38.999567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-547f4562-8c5d-44b0-b2f5-e295d17a7120 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:39.028594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f4562-8c5d-44b0-b2f5-e295d17a7120 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:39.030376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f4562-8c5d-44b0-b2f5-e295d17a7120 service placement] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:39.053657 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1132/2274] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:45:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:45:47.957577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c030-f31f-42bd-9e83-f263c9eb8b44 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:47.958129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c030-f31f-42bd-9e83-f263c9eb8b44 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:47.958664 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c030-f31f-42bd-9e83-f263c9eb8b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:47.983283 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-5cf8c030-f31f-42bd-9e83-f263c9eb8b44 None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:45:47.984777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5cf8c030-f31f-42bd-9e83-f263c9eb8b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:47.994781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1143/2275] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:45:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:45:48.009401 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f4562-8c5d-44b0-b2f5-e295d17a7120 service placement] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:48.026759 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f4562-8c5d-44b0-b2f5-e295d17a7120 service placement] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:48.041920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d56f23-33a6-4df0-82ce-91cb13c776f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:48.042712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d56f23-33a6-4df0-82ce-91cb13c776f0 service swift] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:48.044132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d56f23-33a6-4df0-82ce-91cb13c776f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:48.044132 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d56f23-33a6-4df0-82ce-91cb13c776f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:48.053956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d56f23-33a6-4df0-82ce-91cb13c776f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:48.056539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d56f23-33a6-4df0-82ce-91cb13c776f0 service swift] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:48.071221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1133/2276] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:45:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:45:53.753824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf75156-e770-4379-bbb6-f78c2e9890f3 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:53.754462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf75156-e770-4379-bbb6-f78c2e9890f3 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:53.754462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf75156-e770-4379-bbb6-f78c2e9890f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:53.775093 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-6cf75156-e770-4379-bbb6-f78c2e9890f3 None None] MFA Rules not processed for user `588930f5618c4d7d92de82a89a17d923`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:45:53.776722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6cf75156-e770-4379-bbb6-f78c2e9890f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:53.833659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1144/2277] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:45:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:45:54.822534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ecc79-4bb9-4457-98cc-5c5d3f305f28 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:54.823084 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ecc79-4bb9-4457-98cc-5c5d3f305f28 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:54.823176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ecc79-4bb9-4457-98cc-5c5d3f305f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:54.842524 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-507ecc79-4bb9-4457-98cc-5c5d3f305f28 None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:45:54.843790 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-507ecc79-4bb9-4457-98cc-5c5d3f305f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:54.852436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1134/2278] 10.222.0.76 () {58 vars in 967 bytes} [Thu May 12 17:45:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:45:54.865214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf75156-e770-4379-bbb6-f78c2e9890f3 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:54.877072 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf75156-e770-4379-bbb6-f78c2e9890f3 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:54.881951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105b8a5-e46f-4fbf-9ac4-1aa2caa1e2aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:54.882714 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105b8a5-e46f-4fbf-9ac4-1aa2caa1e2aa service swift] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:54.883001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105b8a5-e46f-4fbf-9ac4-1aa2caa1e2aa service swift] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:54.883273 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105b8a5-e46f-4fbf-9ac4-1aa2caa1e2aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:54.891255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105b8a5-e46f-4fbf-9ac4-1aa2caa1e2aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:54.892865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105b8a5-e46f-4fbf-9ac4-1aa2caa1e2aa service swift] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:54.902307 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1145/2279] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:45:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:45:57.065588 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ecc79-4bb9-4457-98cc-5c5d3f305f28 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:57.107932 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ecc79-4bb9-4457-98cc-5c5d3f305f28 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:57.112578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012894b7-3c4a-4200-badb-6e2f563ca8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:57.113545 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012894b7-3c4a-4200-badb-6e2f563ca8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:57.113893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012894b7-3c4a-4200-badb-6e2f563ca8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:57.114237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012894b7-3c4a-4200-badb-6e2f563ca8a9 admin admin] PATH_INFO: `/v3/users/967a537eb434465e8294c324a83ef5b0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:57.115725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012894b7-3c4a-4200-badb-6e2f563ca8a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=967a537eb434465e8294c324a83ef5b0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:57.117747 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012894b7-3c4a-4200-badb-6e2f563ca8a9 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:57.165936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-012894b7-3c4a-4200-badb-6e2f563ca8a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967a537eb434465e8294c324a83ef5b0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:45:57.167067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-012894b7-3c4a-4200-badb-6e2f563ca8a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967a537eb434465e8294c324a83ef5b0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:45:57.167884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-012894b7-3c4a-4200-badb-6e2f563ca8a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967a537eb434465e8294c324a83ef5b0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:45:57.179778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-012894b7-3c4a-4200-badb-6e2f563ca8a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967a537eb434465e8294c324a83ef5b0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:45:57.187244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-012894b7-3c4a-4200-badb-6e2f563ca8a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967a537eb434465e8294c324a83ef5b0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:45:57.200972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1135/2280] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:45:57 2022] DELETE /identity/v3/users/967a537eb434465e8294c324a83ef5b0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:45:57.394742 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105b8a5-e46f-4fbf-9ac4-1aa2caa1e2aa service swift] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:57.406168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105b8a5-e46f-4fbf-9ac4-1aa2caa1e2aa service swift] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:57.471609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2be15-f63d-4467-8238-e1690aaf90c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:57.472569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2be15-f63d-4467-8238-e1690aaf90c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:57.472932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2be15-f63d-4467-8238-e1690aaf90c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:57.473285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2be15-f63d-4467-8238-e1690aaf90c2 admin admin] PATH_INFO: `/v3/projects/75736e80e44a481484d88e394c5269d6` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:57.474742 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2be15-f63d-4467-8238-e1690aaf90c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75736e80e44a481484d88e394c5269d6)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:57.476658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2be15-f63d-4467-8238-e1690aaf90c2 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:57.524646 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-53f2be15-f63d-4467-8238-e1690aaf90c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75736e80e44a481484d88e394c5269d6', 'request_id': 'req-53f2be15-f63d-4467-8238-e1690aaf90c2'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:45:57.533066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-53f2be15-f63d-4467-8238-e1690aaf90c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75736e80e44a481484d88e394c5269d6', 'request_id': 'req-53f2be15-f63d-4467-8238-e1690aaf90c2'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:45:57.539117 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-53f2be15-f63d-4467-8238-e1690aaf90c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75736e80e44a481484d88e394c5269d6', 'request_id': 'req-53f2be15-f63d-4467-8238-e1690aaf90c2'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:45:57.563161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-53f2be15-f63d-4467-8238-e1690aaf90c2 admin admin] The token cache is being invalidate because project 75736e80e44a481484d88e394c5269d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:45:57.563453 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-53f2be15-f63d-4467-8238-e1690aaf90c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:45:57.564106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-53f2be15-f63d-4467-8238-e1690aaf90c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:45:57.565675 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1146/2281] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:45:57 2022] DELETE /identity/v3/projects/75736e80e44a481484d88e394c5269d6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:45:57.571133 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93702a4-d843-4baa-8c02-87ed11e081f0 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:57.571949 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93702a4-d843-4baa-8c02-87ed11e081f0 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:57.572350 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93702a4-d843-4baa-8c02-87ed11e081f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:57.619247 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-e93702a4-d843-4baa-8c02-87ed11e081f0 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:45:57.620763 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-e93702a4-d843-4baa-8c02-87ed11e081f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:57.687225 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1136/2282] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:45:57.695082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc694d-4a6d-4f95-b15a-85fcb36ee32f None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:57.695374 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc694d-4a6d-4f95-b15a-85fcb36ee32f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:57.695656 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc694d-4a6d-4f95-b15a-85fcb36ee32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:57.714951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-cbdc694d-4a6d-4f95-b15a-85fcb36ee32f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:45:57.716520 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-cbdc694d-4a6d-4f95-b15a-85fcb36ee32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:57.724599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1147/2283] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:45:57.729504 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93702a4-d843-4baa-8c02-87ed11e081f0 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:57.739349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93702a4-d843-4baa-8c02-87ed11e081f0 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:57.744689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b48aa-5354-4b86-b63b-dd94e80372f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:57.745344 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b48aa-5354-4b86-b63b-dd94e80372f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:57.745626 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b48aa-5354-4b86-b63b-dd94e80372f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:57.745902 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b48aa-5354-4b86-b63b-dd94e80372f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:57.746643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b48aa-5354-4b86-b63b-dd94e80372f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:45:57.746989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b48aa-5354-4b86-b63b-dd94e80372f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:57.748588 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b48aa-5354-4b86-b63b-dd94e80372f8 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:57.765060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1137/2284] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:45:57.766141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc694d-4a6d-4f95-b15a-85fcb36ee32f None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:57.778151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc694d-4a6d-4f95-b15a-85fcb36ee32f None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:57.793924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349d9c6-01e4-4eb7-ae71-b677a767cae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:57.794610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349d9c6-01e4-4eb7-ae71-b677a767cae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:57.794926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349d9c6-01e4-4eb7-ae71-b677a767cae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:57.795201 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349d9c6-01e4-4eb7-ae71-b677a767cae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:57.795899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349d9c6-01e4-4eb7-ae71-b677a767cae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:57.797847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349d9c6-01e4-4eb7-ae71-b677a767cae0 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:57.835236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1148/2285] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:45:57 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:45:57.839962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b48aa-5354-4b86-b63b-dd94e80372f8 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:57.850105 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b48aa-5354-4b86-b63b-dd94e80372f8 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:57.908478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60979d3-c1ac-4d3c-9fe4-9f455b03cea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:57.909148 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60979d3-c1ac-4d3c-9fe4-9f455b03cea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:57.909431 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60979d3-c1ac-4d3c-9fe4-9f455b03cea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:57.909708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60979d3-c1ac-4d3c-9fe4-9f455b03cea9 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:57.910394 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60979d3-c1ac-4d3c-9fe4-9f455b03cea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:57.912524 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60979d3-c1ac-4d3c-9fe4-9f455b03cea9 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:57.936816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1138/2286] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:45:57 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:45:57.941397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349d9c6-01e4-4eb7-ae71-b677a767cae0 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:57.952152 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349d9c6-01e4-4eb7-ae71-b677a767cae0 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:57.960820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b77cef-fd44-4504-a704-b71b3cc8c32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:57.962548 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b77cef-fd44-4504-a704-b71b3cc8c32a admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:57.963318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b77cef-fd44-4504-a704-b71b3cc8c32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:57.963697 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b77cef-fd44-4504-a704-b71b3cc8c32a admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:57.965270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b77cef-fd44-4504-a704-b71b3cc8c32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:57.968382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b77cef-fd44-4504-a704-b71b3cc8c32a admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:57.998640 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1149/2287] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:45:58.003521 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60979d3-c1ac-4d3c-9fe4-9f455b03cea9 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:58.018802 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60979d3-c1ac-4d3c-9fe4-9f455b03cea9 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:58.026724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd041974-2fef-4baf-8a8f-ba4ebb7dc85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:58.026724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd041974-2fef-4baf-8a8f-ba4ebb7dc85c admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:58.026724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd041974-2fef-4baf-8a8f-ba4ebb7dc85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:58.026724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd041974-2fef-4baf-8a8f-ba4ebb7dc85c admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:58.027293 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd041974-2fef-4baf-8a8f-ba4ebb7dc85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:58.029460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd041974-2fef-4baf-8a8f-ba4ebb7dc85c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:58.041895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1139/2288] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:45:58.045875 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b77cef-fd44-4504-a704-b71b3cc8c32a admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:58.059173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b77cef-fd44-4504-a704-b71b3cc8c32a admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:58.073748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123957f8-6c08-4ea4-8a43-8978be44d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:58.073748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123957f8-6c08-4ea4-8a43-8978be44d5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:58.073748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123957f8-6c08-4ea4-8a43-8978be44d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:58.073748 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123957f8-6c08-4ea4-8a43-8978be44d5e5 admin admin] PATH_INFO: `/v3/projects/667ee24fd13d4432a040a745bf2a0d0e/users/2afcd57a10c14963acd187bd2aabb229/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:58.091144 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123957f8-6c08-4ea4-8a43-8978be44d5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=667ee24fd13d4432a040a745bf2a0d0e, user_id=2afcd57a10c14963acd187bd2aabb229, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:58.093966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123957f8-6c08-4ea4-8a43-8978be44d5e5 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:58.115590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1150/2289] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:45:58 2022] PUT /identity/v3/projects/667ee24fd13d4432a040a745bf2a0d0e/users/2afcd57a10c14963acd187bd2aabb229/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:45:58.121281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cd7fb-7ce7-4024-8725-0c533dc2a1a8 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:58.121785 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cd7fb-7ce7-4024-8725-0c533dc2a1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:58.121884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cd7fb-7ce7-4024-8725-0c533dc2a1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:58.151334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-3e2cd7fb-7ce7-4024-8725-0c533dc2a1a8 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:45:58.152824 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3e2cd7fb-7ce7-4024-8725-0c533dc2a1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:58.219176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1140/2290] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:45:58.228755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123957f8-6c08-4ea4-8a43-8978be44d5e5 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:45:58.230497 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-123957f8-6c08-4ea4-8a43-8978be44d5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:45:58.288286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123957f8-6c08-4ea4-8a43-8978be44d5e5 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:45:58.292252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f1635-3794-47c8-8c3a-6d47ea0a3e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:45:58.292912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1635-3794-47c8-8c3a-6d47ea0a3e95 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:45:58.293196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1635-3794-47c8-8c3a-6d47ea0a3e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:45:58.293472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f1635-3794-47c8-8c3a-6d47ea0a3e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:45:58.303343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f1635-3794-47c8-8c3a-6d47ea0a3e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:45:58.304793 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f1635-3794-47c8-8c3a-6d47ea0a3e95 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:45:58.315486 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1151/2291] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:46:03.377763 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22cc2a-09c6-4da1-8d87-1932321d7217 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:46:03.379093 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22cc2a-09c6-4da1-8d87-1932321d7217 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:46:03.379587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22cc2a-09c6-4da1-8d87-1932321d7217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:46:03.416418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-7b22cc2a-09c6-4da1-8d87-1932321d7217 None None] MFA Rules not processed for user `2afcd57a10c14963acd187bd2aabb229`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:46:03.417871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-7b22cc2a-09c6-4da1-8d87-1932321d7217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:46:03.548386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1141/2292] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:46:03.552407 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f1635-3794-47c8-8c3a-6d47ea0a3e95 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:46:03.563916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f1635-3794-47c8-8c3a-6d47ea0a3e95 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:46:03.569683 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69115973-0812-4ddf-92b4-0e847bbaff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:46:03.574887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69115973-0812-4ddf-92b4-0e847bbaff59 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:46:03.575556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69115973-0812-4ddf-92b4-0e847bbaff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:46:03.576009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69115973-0812-4ddf-92b4-0e847bbaff59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:46:03.577059 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69115973-0812-4ddf-92b4-0e847bbaff59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:46:03.583437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69115973-0812-4ddf-92b4-0e847bbaff59 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:46:03.620619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1152/2293] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:46:03 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:46:03.624899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22cc2a-09c6-4da1-8d87-1932321d7217 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:46:03.638372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22cc2a-09c6-4da1-8d87-1932321d7217 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:46:03.711138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce407f-2c83-489a-a5a4-1debf903073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:46:03.711825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce407f-2c83-489a-a5a4-1debf903073f admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:46:03.712332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce407f-2c83-489a-a5a4-1debf903073f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:46:03.712611 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce407f-2c83-489a-a5a4-1debf903073f admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:46:03.713538 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce407f-2c83-489a-a5a4-1debf903073f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:46:03.715671 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce407f-2c83-489a-a5a4-1debf903073f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:46:03.755016 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1142/2294] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:46:03 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:46:03.759234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69115973-0812-4ddf-92b4-0e847bbaff59 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:46:03.770990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69115973-0812-4ddf-92b4-0e847bbaff59 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:46:03.777089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7c770-5e4c-471e-8da1-9a76ee4be665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:46:03.777746 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7c770-5e4c-471e-8da1-9a76ee4be665 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:46:03.778235 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7c770-5e4c-471e-8da1-9a76ee4be665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:46:03.778513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7c770-5e4c-471e-8da1-9a76ee4be665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:46:03.779313 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7c770-5e4c-471e-8da1-9a76ee4be665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:46:03.780920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7c770-5e4c-471e-8da1-9a76ee4be665 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:46:03.793035 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1153/2295] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:46:03.797050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce407f-2c83-489a-a5a4-1debf903073f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:46:03.809940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce407f-2c83-489a-a5a4-1debf903073f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:46:03.817064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5624cdd-36bd-42d5-aa88-1db8fbf17479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:46:03.818103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5624cdd-36bd-42d5-aa88-1db8fbf17479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:46:03.818491 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5624cdd-36bd-42d5-aa88-1db8fbf17479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:46:03.818885 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5624cdd-36bd-42d5-aa88-1db8fbf17479 admin admin] PATH_INFO: `/v3/projects/a713f90ee77741869a29b5d07e572178/users/9787d26723ea428d80ce740584600fd9/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:46:03.844136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5624cdd-36bd-42d5-aa88-1db8fbf17479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a713f90ee77741869a29b5d07e572178, user_id=9787d26723ea428d80ce740584600fd9, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:46:03.847196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5624cdd-36bd-42d5-aa88-1db8fbf17479 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:46:03.873677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1143/2296] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:46:03 2022] PUT /identity/v3/projects/a713f90ee77741869a29b5d07e572178/users/9787d26723ea428d80ce740584600fd9/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:46:03.877422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7c770-5e4c-471e-8da1-9a76ee4be665 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:46:03.892358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7c770-5e4c-471e-8da1-9a76ee4be665 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:46:03.954050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2a995-13a3-440c-9242-d4250354cd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:46:03.954750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2a995-13a3-440c-9242-d4250354cd75 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:46:03.955036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2a995-13a3-440c-9242-d4250354cd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:46:03.955319 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2a995-13a3-440c-9242-d4250354cd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:46:03.956045 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2a995-13a3-440c-9242-d4250354cd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:46:03.957650 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2a995-13a3-440c-9242-d4250354cd75 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:46:03.968194 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1154/2297] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:46:03.972374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5624cdd-36bd-42d5-aa88-1db8fbf17479 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:46:03.983055 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5624cdd-36bd-42d5-aa88-1db8fbf17479 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:46:03.987865 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a14a73-0d7f-4a9d-a17a-9c08ffc2bfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:46:03.988737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a14a73-0d7f-4a9d-a17a-9c08ffc2bfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:46:03.989018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a14a73-0d7f-4a9d-a17a-9c08ffc2bfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:46:03.989289 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a14a73-0d7f-4a9d-a17a-9c08ffc2bfd2 admin admin] PATH_INFO: `/v3/projects/a713f90ee77741869a29b5d07e572178/users/9787d26723ea428d80ce740584600fd9/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:46:03.991313 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a14a73-0d7f-4a9d-a17a-9c08ffc2bfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a713f90ee77741869a29b5d07e572178, user_id=9787d26723ea428d80ce740584600fd9, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:46:03.994417 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a14a73-0d7f-4a9d-a17a-9c08ffc2bfd2 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:46:04.005404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1144/2298] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:46:03 2022] PUT /identity/v3/projects/a713f90ee77741869a29b5d07e572178/users/9787d26723ea428d80ce740584600fd9/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:46:10.888428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f3e2a-1e59-43d7-a36e-dd9ce7983943 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:46:10.888894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f3e2a-1e59-43d7-a36e-dd9ce7983943 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:46:10.888894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f3e2a-1e59-43d7-a36e-dd9ce7983943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:46:10.923795 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-167f3e2a-1e59-43d7-a36e-dd9ce7983943 None None] MFA Rules not processed for user `9787d26723ea428d80ce740584600fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:46:10.925013 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-167f3e2a-1e59-43d7-a36e-dd9ce7983943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:46:11.012645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1155/2299] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:46:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:46:11.036536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a14a73-0d7f-4a9d-a17a-9c08ffc2bfd2 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:46:11.038474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-e5a14a73-0d7f-4a9d-a17a-9c08ffc2bfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:46:11.139457 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a14a73-0d7f-4a9d-a17a-9c08ffc2bfd2 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:46:11.147262 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1feb8c-1bf0-4b53-9235-b7cf068fc8f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:46:11.147923 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1feb8c-1bf0-4b53-9235-b7cf068fc8f7 service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:46:11.148204 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1feb8c-1bf0-4b53-9235-b7cf068fc8f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:46:11.148480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1feb8c-1bf0-4b53-9235-b7cf068fc8f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:46:11.216809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1feb8c-1bf0-4b53-9235-b7cf068fc8f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:46:11.218541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1feb8c-1bf0-4b53-9235-b7cf068fc8f7 service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:46:11.240484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1145/2300] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:46:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:46:12.916181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da49de-ee54-4c3e-b283-f6c2d5f808fb None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:46:12.916733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da49de-ee54-4c3e-b283-f6c2d5f808fb None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:46:12.916733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da49de-ee54-4c3e-b283-f6c2d5f808fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:46:12.939507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-60da49de-ee54-4c3e-b283-f6c2d5f808fb None None] MFA Rules not processed for user `2afcd57a10c14963acd187bd2aabb229`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:46:12.942289 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-60da49de-ee54-4c3e-b283-f6c2d5f808fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:46:12.951927 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1156/2301] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:46:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:46:18.172088 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844279d-cde6-4c5d-b60a-04ceb329cefe None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:46:18.172657 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844279d-cde6-4c5d-b60a-04ceb329cefe None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:46:18.172657 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844279d-cde6-4c5d-b60a-04ceb329cefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:46:18.190823 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-e844279d-cde6-4c5d-b60a-04ceb329cefe None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:46:18.192051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-e844279d-cde6-4c5d-b60a-04ceb329cefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:46:18.247536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1146/2302] 10.222.0.76 () {58 vars in 967 bytes} [Thu May 12 17:46:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:46:18.268918 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da49de-ee54-4c3e-b283-f6c2d5f808fb None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:46:18.270608 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-60da49de-ee54-4c3e-b283-f6c2d5f808fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:46:18.351213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da49de-ee54-4c3e-b283-f6c2d5f808fb None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:46:18.356972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff82656-0828-433c-9a69-287af21123b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:46:18.357724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82656-0828-433c-9a69-287af21123b3 service swift] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:46:18.358006 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82656-0828-433c-9a69-287af21123b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:46:18.358278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82656-0828-433c-9a69-287af21123b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:46:18.366511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff82656-0828-433c-9a69-287af21123b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:46:18.368134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff82656-0828-433c-9a69-287af21123b3 service swift] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:46:18.376683 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1157/2303] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:46:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:46:54.076183 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295835f-0310-4aa3-be6f-54974b31e6eb None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:46:54.076891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295835f-0310-4aa3-be6f-54974b31e6eb None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:46:54.076891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295835f-0310-4aa3-be6f-54974b31e6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:46:54.095846 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-0295835f-0310-4aa3-be6f-54974b31e6eb None None] MFA Rules not processed for user `ac1708b4ee7e43afaac75452be3b195e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:46:54.097064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0295835f-0310-4aa3-be6f-54974b31e6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:46:54.157344 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1147/2304] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:46:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:47:14.289863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff82656-0828-433c-9a69-287af21123b3 service swift] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:47:14.350285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff82656-0828-433c-9a69-287af21123b3 service swift] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:47:14.355086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de515cf3-561e-422a-8908-d49f0f6e4616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:47:14.355744 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de515cf3-561e-422a-8908-d49f0f6e4616 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:47:14.356024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de515cf3-561e-422a-8908-d49f0f6e4616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:47:14.356296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de515cf3-561e-422a-8908-d49f0f6e4616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:47:14.366534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de515cf3-561e-422a-8908-d49f0f6e4616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:47:14.368004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de515cf3-561e-422a-8908-d49f0f6e4616 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:47:14.378434 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1158/2305] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:47:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:47:21.121727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295835f-0310-4aa3-be6f-54974b31e6eb None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:47:21.123417 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0295835f-0310-4aa3-be6f-54974b31e6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:47:21.193392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295835f-0310-4aa3-be6f-54974b31e6eb None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:47:21.197808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefdedf-9c37-4fa2-934f-6d9cf337977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:47:21.198722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefdedf-9c37-4fa2-934f-6d9cf337977f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:47:21.198983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefdedf-9c37-4fa2-934f-6d9cf337977f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:47:21.199270 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefdedf-9c37-4fa2-934f-6d9cf337977f admin admin] PATH_INFO: `/v3/users/588930f5618c4d7d92de82a89a17d923` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:47:21.200444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefdedf-9c37-4fa2-934f-6d9cf337977f admin admin] RBAC: Authorizing `identity:delete_user(user_id=588930f5618c4d7d92de82a89a17d923)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:47:21.202378 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefdedf-9c37-4fa2-934f-6d9cf337977f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:47:21.246501 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-6eefdedf-9c37-4fa2-934f-6d9cf337977f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '588930f5618c4d7d92de82a89a17d923'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:47:21.247206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-6eefdedf-9c37-4fa2-934f-6d9cf337977f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '588930f5618c4d7d92de82a89a17d923'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:47:21.249616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-6eefdedf-9c37-4fa2-934f-6d9cf337977f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '588930f5618c4d7d92de82a89a17d923'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:47:21.261950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-6eefdedf-9c37-4fa2-934f-6d9cf337977f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '588930f5618c4d7d92de82a89a17d923'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:47:21.269234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-6eefdedf-9c37-4fa2-934f-6d9cf337977f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '588930f5618c4d7d92de82a89a17d923'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:47:21.284373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1148/2306] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:47:21 2022] DELETE /identity/v3/users/588930f5618c4d7d92de82a89a17d923 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:47:21.451193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de515cf3-561e-422a-8908-d49f0f6e4616 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:47:21.461920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de515cf3-561e-422a-8908-d49f0f6e4616 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:47:21.518638 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:47:21.519525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:47:21.519811 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:47:21.520088 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] PATH_INFO: `/v3/projects/5efa2685b0ca4a4e86626fddbd68e4ed` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:47:21.521570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5efa2685b0ca4a4e86626fddbd68e4ed)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:47:21.523633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:47:21.568765 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5efa2685b0ca4a4e86626fddbd68e4ed', 'request_id': 'req-437a1777-7e8c-44d2-8eb9-9f9781d6155f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:47:21.575600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5efa2685b0ca4a4e86626fddbd68e4ed', 'request_id': 'req-437a1777-7e8c-44d2-8eb9-9f9781d6155f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:47:21.580835 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5efa2685b0ca4a4e86626fddbd68e4ed', 'request_id': 'req-437a1777-7e8c-44d2-8eb9-9f9781d6155f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:47:21.591644 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] The token cache is being invalidate because project 5efa2685b0ca4a4e86626fddbd68e4ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:47:21.591912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:47:21.592567 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:47:21.594820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1159/2307] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:47:21 2022] DELETE /identity/v3/projects/5efa2685b0ca4a4e86626fddbd68e4ed => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:47:40.153188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefdedf-9c37-4fa2-934f-6d9cf337977f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:47:40.154575 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-6eefdedf-9c37-4fa2-934f-6d9cf337977f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:47:40.233399 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefdedf-9c37-4fa2-934f-6d9cf337977f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:47:40.283322 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e8335-460c-4b1e-b36f-c1cb22cb9bc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:47:40.284495 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e8335-460c-4b1e-b36f-c1cb22cb9bc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:47:40.284778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e8335-460c-4b1e-b36f-c1cb22cb9bc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:47:40.285054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e8335-460c-4b1e-b36f-c1cb22cb9bc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:47:40.286911 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-090e8335-460c-4b1e-b36f-c1cb22cb9bc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:47:40.354246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e8335-460c-4b1e-b36f-c1cb22cb9bc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:47:40.356110 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e8335-460c-4b1e-b36f-c1cb22cb9bc5 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:47:40.367541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1149/2308] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:47:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:47:40.540006 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:47:40.541947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:47:40.600552 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a1777-7e8c-44d2-8eb9-9f9781d6155f admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:47:40.606360 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea8aee-85c7-41cb-af65-7fc870fc6cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:47:40.607486 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea8aee-85c7-41cb-af65-7fc870fc6cee service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:47:40.607959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea8aee-85c7-41cb-af65-7fc870fc6cee service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:47:40.608454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea8aee-85c7-41cb-af65-7fc870fc6cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:47:40.611523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-14ea8aee-85c7-41cb-af65-7fc870fc6cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:47:40.630405 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea8aee-85c7-41cb-af65-7fc870fc6cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:47:40.632961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea8aee-85c7-41cb-af65-7fc870fc6cee service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:47:40.645681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1160/2309] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:47:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:47:47.554615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54468b6-26cb-4629-9b0e-965451e211c0 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:47:47.555191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54468b6-26cb-4629-9b0e-965451e211c0 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:47:47.555298 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54468b6-26cb-4629-9b0e-965451e211c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:47:47.572310 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c54468b6-26cb-4629-9b0e-965451e211c0 None None] MFA Rules not processed for user `10626535b6874ef58b63d259f059cd15`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:47:47.573541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c54468b6-26cb-4629-9b0e-965451e211c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:47:47.626911 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1150/2310] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:47:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:47:47.925516 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea8aee-85c7-41cb-af65-7fc870fc6cee service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:47:47.933971 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea8aee-85c7-41cb-af65-7fc870fc6cee service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:47:47.937614 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137727b8-b7f0-4e89-9529-915678459565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:47:47.938305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137727b8-b7f0-4e89-9529-915678459565 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:47:47.939555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137727b8-b7f0-4e89-9529-915678459565 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:47:47.940239 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137727b8-b7f0-4e89-9529-915678459565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:47:47.942014 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-137727b8-b7f0-4e89-9529-915678459565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:47:47.951655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137727b8-b7f0-4e89-9529-915678459565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:47:47.953075 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137727b8-b7f0-4e89-9529-915678459565 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:47:47.962368 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1161/2311] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:47:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:47:48.268854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54468b6-26cb-4629-9b0e-965451e211c0 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:47:48.270268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c54468b6-26cb-4629-9b0e-965451e211c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:47:48.341371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54468b6-26cb-4629-9b0e-965451e211c0 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:47:48.346687 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d85e54-df9d-433d-ae3d-f5830616258b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01fa037b14c456eb533b5a86da0a370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:47:48.347330 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d85e54-df9d-433d-ae3d-f5830616258b service placement] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:47:48.347605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d85e54-df9d-433d-ae3d-f5830616258b service placement] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:47:48.347878 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d85e54-df9d-433d-ae3d-f5830616258b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:47:48.349596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-68d85e54-df9d-433d-ae3d-f5830616258b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:47:48.361091 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d85e54-df9d-433d-ae3d-f5830616258b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:47:48.362648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d85e54-df9d-433d-ae3d-f5830616258b service placement] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:47:48.372085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1151/2312] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:47:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:47:49.310122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137727b8-b7f0-4e89-9529-915678459565 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:47:49.311595 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-137727b8-b7f0-4e89-9529-915678459565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:47:49.322045 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137727b8-b7f0-4e89-9529-915678459565 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:47:49.327208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0bca6-a11d-4f62-95c4-5d5f92e15335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:47:49.327791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0bca6-a11d-4f62-95c4-5d5f92e15335 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:47:49.328076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0bca6-a11d-4f62-95c4-5d5f92e15335 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:47:49.328474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0bca6-a11d-4f62-95c4-5d5f92e15335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:47:49.330318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f5c0bca6-a11d-4f62-95c4-5d5f92e15335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:47:49.332666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d85e54-df9d-433d-ae3d-f5830616258b service placement] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:47:49.334921 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-68d85e54-df9d-433d-ae3d-f5830616258b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:47:49.341946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0bca6-a11d-4f62-95c4-5d5f92e15335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:47:49.343416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0bca6-a11d-4f62-95c4-5d5f92e15335 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:47:49.351391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d85e54-df9d-433d-ae3d-f5830616258b service placement] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:47:49.353633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1162/2313] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:47:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:47:49.357557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a21f0-7a01-4c59-b8c5-aa5a5d278407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:47:49.358215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a21f0-7a01-4c59-b8c5-aa5a5d278407 service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:47:49.358495 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a21f0-7a01-4c59-b8c5-aa5a5d278407 service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:47:49.358804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a21f0-7a01-4c59-b8c5-aa5a5d278407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:47:49.368584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a21f0-7a01-4c59-b8c5-aa5a5d278407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:47:49.370969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a21f0-7a01-4c59-b8c5-aa5a5d278407 service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:47:49.384115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1152/2314] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:47:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:47:51.249209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0bca6-a11d-4f62-95c4-5d5f92e15335 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:47:51.258608 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0bca6-a11d-4f62-95c4-5d5f92e15335 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:47:51.262574 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871a657-40a5-4391-8973-29e99d9fe47c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:47:51.263280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871a657-40a5-4391-8973-29e99d9fe47c service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:47:51.263565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871a657-40a5-4391-8973-29e99d9fe47c service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:47:51.263836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871a657-40a5-4391-8973-29e99d9fe47c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:47:51.265611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-0871a657-40a5-4391-8973-29e99d9fe47c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:47:51.278001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871a657-40a5-4391-8973-29e99d9fe47c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:47:51.291320 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871a657-40a5-4391-8973-29e99d9fe47c service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:47:51.301799 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1163/2315] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:47:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:48:00.423500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a21f0-7a01-4c59-b8c5-aa5a5d278407 service nova] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:48:00.435218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a21f0-7a01-4c59-b8c5-aa5a5d278407 service nova] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:48:00.440730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292973a-8f91-4f16-b3ad-73b9b03c8f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:48:00.441367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292973a-8f91-4f16-b3ad-73b9b03c8f56 service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:48:00.441675 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292973a-8f91-4f16-b3ad-73b9b03c8f56 service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:48:00.441950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292973a-8f91-4f16-b3ad-73b9b03c8f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:48:00.443771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a292973a-8f91-4f16-b3ad-73b9b03c8f56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:48:00.501543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292973a-8f91-4f16-b3ad-73b9b03c8f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:48:00.503410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292973a-8f91-4f16-b3ad-73b9b03c8f56 service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:48:00.512815 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1153/2316] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:48:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:48:03.537014 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57394f6-31b5-4385-8d0a-96dd3a380845 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:48:03.537529 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57394f6-31b5-4385-8d0a-96dd3a380845 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:48:03.537624 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57394f6-31b5-4385-8d0a-96dd3a380845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:48:03.556034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-f57394f6-31b5-4385-8d0a-96dd3a380845 None None] MFA Rules not processed for user `ee532b08897148dd9ff0482a00f537f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:48:03.557229 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f57394f6-31b5-4385-8d0a-96dd3a380845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:48:03.612717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1164/2317] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:48:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:48:09.469639 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292973a-8f91-4f16-b3ad-73b9b03c8f56 service nova] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:48:09.480953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292973a-8f91-4f16-b3ad-73b9b03c8f56 service nova] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:48:09.487825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40b37c-e3b4-4650-8d29-d23925c2cbdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:48:09.488808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40b37c-e3b4-4650-8d29-d23925c2cbdd service nova] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:48:09.489089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40b37c-e3b4-4650-8d29-d23925c2cbdd service nova] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:48:09.489367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40b37c-e3b4-4650-8d29-d23925c2cbdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:48:09.491478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3e40b37c-e3b4-4650-8d29-d23925c2cbdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:48:09.505150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40b37c-e3b4-4650-8d29-d23925c2cbdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:48:09.506784 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40b37c-e3b4-4650-8d29-d23925c2cbdd service nova] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:48:09.519292 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1154/2318] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:48:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:48:11.098953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfc35c-54ca-4a3c-807e-3cd992a05948 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:48:11.100030 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfc35c-54ca-4a3c-807e-3cd992a05948 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:48:11.100461 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfc35c-54ca-4a3c-807e-3cd992a05948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:48:11.119993 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-b1dfc35c-54ca-4a3c-807e-3cd992a05948 None None] MFA Rules not processed for user `7802c329d4ca4eccb28fdec9f8082cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:48:11.121208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b1dfc35c-54ca-4a3c-807e-3cd992a05948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:48:11.182002 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1165/2319] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:48:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:48:11.545714 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40b37c-e3b4-4650-8d29-d23925c2cbdd service nova] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:48:11.555254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40b37c-e3b4-4650-8d29-d23925c2cbdd service nova] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:48:11.558907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37055423-c158-4cc4-a051-b9084c50c2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:48:11.559535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055423-c158-4cc4-a051-b9084c50c2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:48:11.559813 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055423-c158-4cc4-a051-b9084c50c2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:48:11.560086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055423-c158-4cc4-a051-b9084c50c2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:48:11.561824 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-37055423-c158-4cc4-a051-b9084c50c2a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:48:11.572249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37055423-c158-4cc4-a051-b9084c50c2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:48:11.573669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37055423-c158-4cc4-a051-b9084c50c2a8 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:48:11.581536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1155/2320] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:48:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:48:16.093608 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfc35c-54ca-4a3c-807e-3cd992a05948 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:48:16.095199 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b1dfc35c-54ca-4a3c-807e-3cd992a05948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:48:16.136392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfc35c-54ca-4a3c-807e-3cd992a05948 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:48:16.145296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a00403-db31-4a4d-a835-cd1683f2b9f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:48:16.146261 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00403-db31-4a4d-a835-cd1683f2b9f6 service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:48:16.147010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00403-db31-4a4d-a835-cd1683f2b9f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:48:16.147442 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a00403-db31-4a4d-a835-cd1683f2b9f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:48:16.152069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-04a00403-db31-4a4d-a835-cd1683f2b9f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:48:16.168780 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a00403-db31-4a4d-a835-cd1683f2b9f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:48:16.177360 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a00403-db31-4a4d-a835-cd1683f2b9f6 service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:48:16.209782 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1166/2321] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:48:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:48:19.973606 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e890785-e7f6-4c68-922f-069ae48bd1f2 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:48:19.974171 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e890785-e7f6-4c68-922f-069ae48bd1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:48:19.974171 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e890785-e7f6-4c68-922f-069ae48bd1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:48:19.991355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-1e890785-e7f6-4c68-922f-069ae48bd1f2 None None] MFA Rules not processed for user `ac1708b4ee7e43afaac75452be3b195e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:48:19.993179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1e890785-e7f6-4c68-922f-069ae48bd1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:48:19.999968 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1156/2322] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:48:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:48:27.571545 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a00403-db31-4a4d-a835-cd1683f2b9f6 service nova] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:48:27.584701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a00403-db31-4a4d-a835-cd1683f2b9f6 service nova] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:48:27.591550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b01c9d-3d3a-4813-b0db-9d6a0f68c73f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:48:27.592191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b01c9d-3d3a-4813-b0db-9d6a0f68c73f service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:48:27.592467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b01c9d-3d3a-4813-b0db-9d6a0f68c73f service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:48:27.592738 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b01c9d-3d3a-4813-b0db-9d6a0f68c73f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:48:27.594638 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-16b01c9d-3d3a-4813-b0db-9d6a0f68c73f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:48:27.609277 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b01c9d-3d3a-4813-b0db-9d6a0f68c73f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:48:27.610947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b01c9d-3d3a-4813-b0db-9d6a0f68c73f service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:48:27.623572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1167/2323] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:48:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:48:30.555530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e890785-e7f6-4c68-922f-069ae48bd1f2 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:48:30.557039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1e890785-e7f6-4c68-922f-069ae48bd1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:48:30.568841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e890785-e7f6-4c68-922f-069ae48bd1f2 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:48:30.573123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0391028-f867-4810-ba0d-183407bdf844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:48:30.573755 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0391028-f867-4810-ba0d-183407bdf844 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:48:30.574036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0391028-f867-4810-ba0d-183407bdf844 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:48:30.574308 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0391028-f867-4810-ba0d-183407bdf844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:48:30.576110 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a0391028-f867-4810-ba0d-183407bdf844 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:48:30.634170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0391028-f867-4810-ba0d-183407bdf844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:48:30.635809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0391028-f867-4810-ba0d-183407bdf844 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:48:30.644822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1157/2324] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:48:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:48:38.117609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb2d37-45ef-4979-80a2-451048ec13b8 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:48:38.118178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb2d37-45ef-4979-80a2-451048ec13b8 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:48:38.118351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb2d37-45ef-4979-80a2-451048ec13b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:48:38.142355 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-26eb2d37-45ef-4979-80a2-451048ec13b8 None None] MFA Rules not processed for user `d8866c723166455a9711559eb7f125c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:48:38.143798 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-26eb2d37-45ef-4979-80a2-451048ec13b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:48:38.152334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1168/2325] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:48:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:48:47.872020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0391028-f867-4810-ba0d-183407bdf844 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:48:47.873444 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a0391028-f867-4810-ba0d-183407bdf844 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:48:47.884357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0391028-f867-4810-ba0d-183407bdf844 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:48:47.888752 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87edbd-d796-4fb9-8aec-831070c6d2d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:48:47.889390 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87edbd-d796-4fb9-8aec-831070c6d2d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:48:47.889667 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87edbd-d796-4fb9-8aec-831070c6d2d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:48:47.889940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87edbd-d796-4fb9-8aec-831070c6d2d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:48:47.892033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4e87edbd-d796-4fb9-8aec-831070c6d2d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:48:47.903516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87edbd-d796-4fb9-8aec-831070c6d2d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:48:47.904938 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87edbd-d796-4fb9-8aec-831070c6d2d7 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:48:47.913708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1158/2326] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:48:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:49:08.226365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb2d37-45ef-4979-80a2-451048ec13b8 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:08.236541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb2d37-45ef-4979-80a2-451048ec13b8 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:08.240139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f06c77-366d-4d87-ab83-18eec89c79ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:08.240779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f06c77-366d-4d87-ab83-18eec89c79ac service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:08.241061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f06c77-366d-4d87-ab83-18eec89c79ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:08.241340 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f06c77-366d-4d87-ab83-18eec89c79ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:08.243213 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e7f06c77-366d-4d87-ab83-18eec89c79ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:08.306043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f06c77-366d-4d87-ab83-18eec89c79ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:08.307611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f06c77-366d-4d87-ab83-18eec89c79ac service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:08.317174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1169/2327] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:49:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:49:11.589381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87edbd-d796-4fb9-8aec-831070c6d2d7 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:11.591415 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4e87edbd-d796-4fb9-8aec-831070c6d2d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:11.611995 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87edbd-d796-4fb9-8aec-831070c6d2d7 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:11.616820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6b5f6-c1f6-41d5-a253-dffdb625718d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:11.617981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6b5f6-c1f6-41d5-a253-dffdb625718d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:11.618332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6b5f6-c1f6-41d5-a253-dffdb625718d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:11.618694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6b5f6-c1f6-41d5-a253-dffdb625718d admin admin] PATH_INFO: `/v3/users/ee532b08897148dd9ff0482a00f537f7` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:11.619984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6b5f6-c1f6-41d5-a253-dffdb625718d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee532b08897148dd9ff0482a00f537f7)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:11.621978 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6b5f6-c1f6-41d5-a253-dffdb625718d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:11.679382 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-93c6b5f6-c1f6-41d5-a253-dffdb625718d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee532b08897148dd9ff0482a00f537f7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:11.680435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-93c6b5f6-c1f6-41d5-a253-dffdb625718d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee532b08897148dd9ff0482a00f537f7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:11.681114 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-93c6b5f6-c1f6-41d5-a253-dffdb625718d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee532b08897148dd9ff0482a00f537f7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:11.692750 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-93c6b5f6-c1f6-41d5-a253-dffdb625718d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee532b08897148dd9ff0482a00f537f7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:11.700421 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-93c6b5f6-c1f6-41d5-a253-dffdb625718d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee532b08897148dd9ff0482a00f537f7'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:11.715667 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1159/2328] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:49:11 2022] DELETE /identity/v3/users/ee532b08897148dd9ff0482a00f537f7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:49:11.895521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f06c77-366d-4d87-ab83-18eec89c79ac service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:11.912140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f06c77-366d-4d87-ab83-18eec89c79ac service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:11.968384 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459d729-37a3-4616-a356-53dc3ed7eb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:11.969430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459d729-37a3-4616-a356-53dc3ed7eb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:11.969717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459d729-37a3-4616-a356-53dc3ed7eb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:11.969988 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459d729-37a3-4616-a356-53dc3ed7eb2d admin admin] PATH_INFO: `/v3/projects/bcee5099fd2b4df2adaa069af3a45733` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:11.971201 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459d729-37a3-4616-a356-53dc3ed7eb2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcee5099fd2b4df2adaa069af3a45733)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:11.973140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459d729-37a3-4616-a356-53dc3ed7eb2d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:12.020158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8459d729-37a3-4616-a356-53dc3ed7eb2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcee5099fd2b4df2adaa069af3a45733', 'request_id': 'req-8459d729-37a3-4616-a356-53dc3ed7eb2d'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:12.027888 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8459d729-37a3-4616-a356-53dc3ed7eb2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcee5099fd2b4df2adaa069af3a45733', 'request_id': 'req-8459d729-37a3-4616-a356-53dc3ed7eb2d'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:12.033598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8459d729-37a3-4616-a356-53dc3ed7eb2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcee5099fd2b4df2adaa069af3a45733', 'request_id': 'req-8459d729-37a3-4616-a356-53dc3ed7eb2d'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:12.044495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8459d729-37a3-4616-a356-53dc3ed7eb2d admin admin] The token cache is being invalidate because project bcee5099fd2b4df2adaa069af3a45733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:49:12.044781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8459d729-37a3-4616-a356-53dc3ed7eb2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:12.045430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8459d729-37a3-4616-a356-53dc3ed7eb2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:12.047062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1170/2329] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:49:11 2022] DELETE /identity/v3/projects/bcee5099fd2b4df2adaa069af3a45733 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:49:12.052661 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08084798-ab99-4ef5-b226-0c9ed30dc4dd None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:12.053018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08084798-ab99-4ef5-b226-0c9ed30dc4dd None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:12.053299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08084798-ab99-4ef5-b226-0c9ed30dc4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:12.074402 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-08084798-ab99-4ef5-b226-0c9ed30dc4dd None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:49:12.075647 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-08084798-ab99-4ef5-b226-0c9ed30dc4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:12.137630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1160/2330] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:49:12.145186 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56989867-fe65-4151-8cc4-a66346f06f60 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:12.145504 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56989867-fe65-4151-8cc4-a66346f06f60 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:12.145781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56989867-fe65-4151-8cc4-a66346f06f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:12.165531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-56989867-fe65-4151-8cc4-a66346f06f60 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:49:12.166932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-56989867-fe65-4151-8cc4-a66346f06f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:12.175295 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1171/2331] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:49:12.179646 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08084798-ab99-4ef5-b226-0c9ed30dc4dd None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:12.190147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08084798-ab99-4ef5-b226-0c9ed30dc4dd None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:12.196218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadf0be-273b-42e8-ba80-9cccf47cba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:12.196416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadf0be-273b-42e8-ba80-9cccf47cba9d admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:12.196776 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadf0be-273b-42e8-ba80-9cccf47cba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:12.196987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadf0be-273b-42e8-ba80-9cccf47cba9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:12.197782 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadf0be-273b-42e8-ba80-9cccf47cba9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:49:12.198120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadf0be-273b-42e8-ba80-9cccf47cba9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:12.200094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadf0be-273b-42e8-ba80-9cccf47cba9d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:12.217673 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1161/2332] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:49:12.219194 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56989867-fe65-4151-8cc4-a66346f06f60 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:12.229443 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56989867-fe65-4151-8cc4-a66346f06f60 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:12.234392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9afa0-5085-462b-91f9-42c0e940ae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:12.235100 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9afa0-5085-462b-91f9-42c0e940ae39 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:12.235382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9afa0-5085-462b-91f9-42c0e940ae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:12.235663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9afa0-5085-462b-91f9-42c0e940ae39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:12.236752 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9afa0-5085-462b-91f9-42c0e940ae39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:12.238663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9afa0-5085-462b-91f9-42c0e940ae39 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:12.278910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1172/2333] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:49:12 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:49:12.282754 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadf0be-273b-42e8-ba80-9cccf47cba9d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:12.298445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadf0be-273b-42e8-ba80-9cccf47cba9d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:12.348488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf29eeb-4493-4447-9481-72e2e42577c7 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:12.348905 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf29eeb-4493-4447-9481-72e2e42577c7 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:12.349271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf29eeb-4493-4447-9481-72e2e42577c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:12.368962 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b188f3-a647-4c8e-a216-a71f7a2057c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:12.369637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b188f3-a647-4c8e-a216-a71f7a2057c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:12.369764 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-5bf29eeb-4493-4447-9481-72e2e42577c7 None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:49:12.370116 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b188f3-a647-4c8e-a216-a71f7a2057c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:12.370406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b188f3-a647-4c8e-a216-a71f7a2057c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:12.371108 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b188f3-a647-4c8e-a216-a71f7a2057c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:12.371221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5bf29eeb-4493-4447-9481-72e2e42577c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:12.373133 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b188f3-a647-4c8e-a216-a71f7a2057c5 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:12.393644 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1162/2334] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:49:12 2022] POST /identity/v3/users => generated 284 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:49:12.397429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b188f3-a647-4c8e-a216-a71f7a2057c5 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:12.407287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b188f3-a647-4c8e-a216-a71f7a2057c5 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:12.411972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568f8c7-b21b-4014-8a37-f0e0bd6e99a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:12.412631 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568f8c7-b21b-4014-8a37-f0e0bd6e99a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:12.412913 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568f8c7-b21b-4014-8a37-f0e0bd6e99a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:12.413190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568f8c7-b21b-4014-8a37-f0e0bd6e99a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:12.413915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568f8c7-b21b-4014-8a37-f0e0bd6e99a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:12.416198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568f8c7-b21b-4014-8a37-f0e0bd6e99a1 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:12.428974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1163/2335] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:49:12.429147 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1173/2336] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:49:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:49:12.431770 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568f8c7-b21b-4014-8a37-f0e0bd6e99a1 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:12.441938 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568f8c7-b21b-4014-8a37-f0e0bd6e99a1 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:12.447034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b571898-d1da-4901-b23c-f76329be0991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:12.447759 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b571898-d1da-4901-b23c-f76329be0991 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:12.448043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b571898-d1da-4901-b23c-f76329be0991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:12.448317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b571898-d1da-4901-b23c-f76329be0991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:12.449029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b571898-d1da-4901-b23c-f76329be0991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:12.450613 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b571898-d1da-4901-b23c-f76329be0991 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:12.462576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1164/2337] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:49:12.466934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf29eeb-4493-4447-9481-72e2e42577c7 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:12.475958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b571898-d1da-4901-b23c-f76329be0991 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:12.477682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2b571898-d1da-4901-b23c-f76329be0991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:12.478593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf29eeb-4493-4447-9481-72e2e42577c7 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:12.483314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e391f-0e17-4f1a-badb-5b19bbc99745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:12.484193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e391f-0e17-4f1a-badb-5b19bbc99745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:12.484470 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e391f-0e17-4f1a-badb-5b19bbc99745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:12.484740 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e391f-0e17-4f1a-badb-5b19bbc99745 admin admin] PATH_INFO: `/v3/projects/eb362bff822a4956b897fedbcefa8eb2/users/e11895b0fe254845a623e3ae61d458ed/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:12.500288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e391f-0e17-4f1a-badb-5b19bbc99745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb362bff822a4956b897fedbcefa8eb2, user_id=e11895b0fe254845a623e3ae61d458ed, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:12.503043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e391f-0e17-4f1a-badb-5b19bbc99745 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:12.517340 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1174/2338] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:49:12 2022] PUT /identity/v3/projects/eb362bff822a4956b897fedbcefa8eb2/users/e11895b0fe254845a623e3ae61d458ed/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:49:12.528540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e24b3-401b-41f8-ad9c-02a975fbf9c9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:12.528829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e24b3-401b-41f8-ad9c-02a975fbf9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:12.529106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e24b3-401b-41f8-ad9c-02a975fbf9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:12.546570 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b571898-d1da-4901-b23c-f76329be0991 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:12.556537 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-fe6e24b3-401b-41f8-ad9c-02a975fbf9c9 None None] MFA Rules not processed for user `e11895b0fe254845a623e3ae61d458ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:49:12.557761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-fe6e24b3-401b-41f8-ad9c-02a975fbf9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:12.605277 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b53cb2-587e-4f47-835e-98c29f3c86d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:12.606005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b53cb2-587e-4f47-835e-98c29f3c86d4 service swift] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:12.606240 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b53cb2-587e-4f47-835e-98c29f3c86d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:12.606516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b53cb2-587e-4f47-835e-98c29f3c86d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:12.621358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1175/2339] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:49:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:49:12.633223 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e24b3-401b-41f8-ad9c-02a975fbf9c9 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:12.634567 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-fe6e24b3-401b-41f8-ad9c-02a975fbf9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:12.663249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b53cb2-587e-4f47-835e-98c29f3c86d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:12.665519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b53cb2-587e-4f47-835e-98c29f3c86d4 service swift] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:12.674064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1165/2340] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:49:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 17:49:12.691038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e24b3-401b-41f8-ad9c-02a975fbf9c9 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:12.694618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4b21e-d2ab-4fae-9d79-9ffcae46a3f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:12.695427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4b21e-d2ab-4fae-9d79-9ffcae46a3f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:12.695713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4b21e-d2ab-4fae-9d79-9ffcae46a3f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:12.695985 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4b21e-d2ab-4fae-9d79-9ffcae46a3f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:12.705741 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4b21e-d2ab-4fae-9d79-9ffcae46a3f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:12.707229 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4b21e-d2ab-4fae-9d79-9ffcae46a3f1 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:12.717577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1176/2341] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:49:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:49:21.442924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b53cb2-587e-4f47-835e-98c29f3c86d4 service swift] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:21.517783 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b53cb2-587e-4f47-835e-98c29f3c86d4 service swift] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:21.522476 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5287-9741-4418-8753-ea4215cccca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:21.526029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5287-9741-4418-8753-ea4215cccca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:21.526029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5287-9741-4418-8753-ea4215cccca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:21.526764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5287-9741-4418-8753-ea4215cccca5 admin admin] PATH_INFO: `/v3/users/e11895b0fe254845a623e3ae61d458ed` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:21.530060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d5287-9741-4418-8753-ea4215cccca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e11895b0fe254845a623e3ae61d458ed)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:21.532154 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d5287-9741-4418-8753-ea4215cccca5 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:21.588371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a88d5287-9741-4418-8753-ea4215cccca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e11895b0fe254845a623e3ae61d458ed'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:21.589165 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a88d5287-9741-4418-8753-ea4215cccca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e11895b0fe254845a623e3ae61d458ed'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:21.589867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a88d5287-9741-4418-8753-ea4215cccca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e11895b0fe254845a623e3ae61d458ed'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:21.602862 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a88d5287-9741-4418-8753-ea4215cccca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e11895b0fe254845a623e3ae61d458ed'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:21.610308 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a88d5287-9741-4418-8753-ea4215cccca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e11895b0fe254845a623e3ae61d458ed'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:21.627129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1166/2342] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:49:21 2022] DELETE /identity/v3/users/e11895b0fe254845a623e3ae61d458ed => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:49:21.631648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89f739-1f86-4429-acc4-4665df0b046c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:21.632152 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89f739-1f86-4429-acc4-4665df0b046c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:21.632383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89f739-1f86-4429-acc4-4665df0b046c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:21.660356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-db89f739-1f86-4429-acc4-4665df0b046c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:49:21.661841 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-db89f739-1f86-4429-acc4-4665df0b046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:21.737497 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1177/2343] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:49:21.748002 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5287-9741-4418-8753-ea4215cccca5 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:21.749496 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a88d5287-9741-4418-8753-ea4215cccca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:21.811564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5287-9741-4418-8753-ea4215cccca5 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:21.815242 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603d7f9-efdb-48ec-ae2b-e5c7f5dc6131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:21.815886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603d7f9-efdb-48ec-ae2b-e5c7f5dc6131 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:21.816169 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603d7f9-efdb-48ec-ae2b-e5c7f5dc6131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:21.816460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603d7f9-efdb-48ec-ae2b-e5c7f5dc6131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:21.826895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603d7f9-efdb-48ec-ae2b-e5c7f5dc6131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:21.828482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603d7f9-efdb-48ec-ae2b-e5c7f5dc6131 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:21.839082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1167/2344] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:49:22.158877 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89f739-1f86-4429-acc4-4665df0b046c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:22.160331 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-db89f739-1f86-4429-acc4-4665df0b046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:22.174585 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89f739-1f86-4429-acc4-4665df0b046c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:22.179687 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fa40e-5280-4f05-828e-a46216e08b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:22.180665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fa40e-5280-4f05-828e-a46216e08b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:22.181034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fa40e-5280-4f05-828e-a46216e08b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:22.181376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fa40e-5280-4f05-828e-a46216e08b29 admin admin] PATH_INFO: `/v3/projects/eb362bff822a4956b897fedbcefa8eb2` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:22.182660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fa40e-5280-4f05-828e-a46216e08b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb362bff822a4956b897fedbcefa8eb2)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:22.184606 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fa40e-5280-4f05-828e-a46216e08b29 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:22.230920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e46fa40e-5280-4f05-828e-a46216e08b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb362bff822a4956b897fedbcefa8eb2', 'request_id': 'req-e46fa40e-5280-4f05-828e-a46216e08b29'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:22.238046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e46fa40e-5280-4f05-828e-a46216e08b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb362bff822a4956b897fedbcefa8eb2', 'request_id': 'req-e46fa40e-5280-4f05-828e-a46216e08b29'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:22.245385 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e46fa40e-5280-4f05-828e-a46216e08b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb362bff822a4956b897fedbcefa8eb2', 'request_id': 'req-e46fa40e-5280-4f05-828e-a46216e08b29'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:22.256272 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e46fa40e-5280-4f05-828e-a46216e08b29 admin admin] The token cache is being invalidate because project eb362bff822a4956b897fedbcefa8eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:49:22.256557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e46fa40e-5280-4f05-828e-a46216e08b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:22.257215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e46fa40e-5280-4f05-828e-a46216e08b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:49:22.259409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1178/2345] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:49:22 2022] DELETE /identity/v3/projects/eb362bff822a4956b897fedbcefa8eb2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:49:22.264899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fcfcf-3df1-42f3-bf93-e13350f1f3e1 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:22.265190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fcfcf-3df1-42f3-bf93-e13350f1f3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:22.265469 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fcfcf-3df1-42f3-bf93-e13350f1f3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:22.283834 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-1c5fcfcf-3df1-42f3-bf93-e13350f1f3e1 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:49:22.285026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1c5fcfcf-3df1-42f3-bf93-e13350f1f3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:22.352742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1168/2346] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:49:22.360221 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091a21e-8516-44e3-b68d-85bf7b40c53b None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:22.360507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091a21e-8516-44e3-b68d-85bf7b40c53b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:22.360779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091a21e-8516-44e3-b68d-85bf7b40c53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:22.379389 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-f091a21e-8516-44e3-b68d-85bf7b40c53b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:49:22.380583 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f091a21e-8516-44e3-b68d-85bf7b40c53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:22.389472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1179/2347] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:49:22.393668 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fcfcf-3df1-42f3-bf93-e13350f1f3e1 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:22.404952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fcfcf-3df1-42f3-bf93-e13350f1f3e1 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:22.410197 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65f1bf-dafa-4b5f-a533-3f99d5053a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:22.410883 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65f1bf-dafa-4b5f-a533-3f99d5053a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:22.411216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65f1bf-dafa-4b5f-a533-3f99d5053a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:22.411639 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65f1bf-dafa-4b5f-a533-3f99d5053a7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:22.412369 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65f1bf-dafa-4b5f-a533-3f99d5053a7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:49:22.412676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65f1bf-dafa-4b5f-a533-3f99d5053a7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:22.415046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65f1bf-dafa-4b5f-a533-3f99d5053a7e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:22.427745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1169/2348] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:49:22.432873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091a21e-8516-44e3-b68d-85bf7b40c53b None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:22.442994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091a21e-8516-44e3-b68d-85bf7b40c53b None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:22.448092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c49cee-540f-417c-bd6b-501ee339b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:22.448784 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c49cee-540f-417c-bd6b-501ee339b10e admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:22.449057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c49cee-540f-417c-bd6b-501ee339b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:22.449324 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c49cee-540f-417c-bd6b-501ee339b10e admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:22.450041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c49cee-540f-417c-bd6b-501ee339b10e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:22.451994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c49cee-540f-417c-bd6b-501ee339b10e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:22.482108 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1180/2349] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:49:22 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:49:22.486369 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65f1bf-dafa-4b5f-a533-3f99d5053a7e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:22.498369 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65f1bf-dafa-4b5f-a533-3f99d5053a7e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:22.564972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9df9b-dac6-49aa-b971-48e7c45be13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:22.565620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9df9b-dac6-49aa-b971-48e7c45be13e admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:22.565876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9df9b-dac6-49aa-b971-48e7c45be13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:22.566172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9df9b-dac6-49aa-b971-48e7c45be13e admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:22.567063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9df9b-dac6-49aa-b971-48e7c45be13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:22.569780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9df9b-dac6-49aa-b971-48e7c45be13e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:22.592917 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1170/2350] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:49:22 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:49:22.597200 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c49cee-540f-417c-bd6b-501ee339b10e admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:22.609164 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c49cee-540f-417c-bd6b-501ee339b10e admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:22.630050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55bf70-6813-413d-8d05-2ea66ba0f250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:22.631284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55bf70-6813-413d-8d05-2ea66ba0f250 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:22.631284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55bf70-6813-413d-8d05-2ea66ba0f250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:22.631680 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55bf70-6813-413d-8d05-2ea66ba0f250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:22.633841 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55bf70-6813-413d-8d05-2ea66ba0f250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:22.635595 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55bf70-6813-413d-8d05-2ea66ba0f250 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:22.650859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1181/2351] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:49:22.655388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9df9b-dac6-49aa-b971-48e7c45be13e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:22.668146 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9df9b-dac6-49aa-b971-48e7c45be13e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:22.673395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fabee5-71fc-4d7a-92a4-9c8b5d4f2b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:22.673928 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fabee5-71fc-4d7a-92a4-9c8b5d4f2b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:22.674397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fabee5-71fc-4d7a-92a4-9c8b5d4f2b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:22.674863 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fabee5-71fc-4d7a-92a4-9c8b5d4f2b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:22.676119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fabee5-71fc-4d7a-92a4-9c8b5d4f2b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:22.678205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fabee5-71fc-4d7a-92a4-9c8b5d4f2b60 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:22.696107 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1171/2352] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:49:22.700924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55bf70-6813-413d-8d05-2ea66ba0f250 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:22.713083 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55bf70-6813-413d-8d05-2ea66ba0f250 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:22.717859 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1817443-be1d-42cb-8364-60eff67b031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:22.718865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1817443-be1d-42cb-8364-60eff67b031c admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:22.719210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1817443-be1d-42cb-8364-60eff67b031c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:22.719568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1817443-be1d-42cb-8364-60eff67b031c admin admin] PATH_INFO: `/v3/projects/555b0f259ce14e1aacfd2744d823308e/users/75ddc9269b414b338e90c2aeac43113a/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:22.735262 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1817443-be1d-42cb-8364-60eff67b031c admin admin] RBAC: Authorizing `identity:create_grant(project_id=555b0f259ce14e1aacfd2744d823308e, user_id=75ddc9269b414b338e90c2aeac43113a, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:22.738305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1817443-be1d-42cb-8364-60eff67b031c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:22.753040 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1182/2353] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:49:22 2022] PUT /identity/v3/projects/555b0f259ce14e1aacfd2744d823308e/users/75ddc9269b414b338e90c2aeac43113a/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:49:22.763440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63ea91-2fbc-44f4-83cd-801a8e3c741f None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:22.763727 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63ea91-2fbc-44f4-83cd-801a8e3c741f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:22.764001 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63ea91-2fbc-44f4-83cd-801a8e3c741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:22.793048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-7e63ea91-2fbc-44f4-83cd-801a8e3c741f None None] MFA Rules not processed for user `75ddc9269b414b338e90c2aeac43113a`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:49:22.794442 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-7e63ea91-2fbc-44f4-83cd-801a8e3c741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:22.861592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1172/2354] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:49:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:49:22.866015 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1817443-be1d-42cb-8364-60eff67b031c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:22.928113 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1817443-be1d-42cb-8364-60eff67b031c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:22.933500 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcc2d4-5245-4e1f-8d1c-b6eb008b3af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:22.934158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcc2d4-5245-4e1f-8d1c-b6eb008b3af8 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:22.934441 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcc2d4-5245-4e1f-8d1c-b6eb008b3af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:22.934842 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcc2d4-5245-4e1f-8d1c-b6eb008b3af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:22.935558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dcc2d4-5245-4e1f-8d1c-b6eb008b3af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:22.937791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dcc2d4-5245-4e1f-8d1c-b6eb008b3af8 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:22.966620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1183/2355] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:49:22 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:49:22.967982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63ea91-2fbc-44f4-83cd-801a8e3c741f None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:22.979330 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63ea91-2fbc-44f4-83cd-801a8e3c741f None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:23.037332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db1e29-4cfe-46ee-b3c4-75d15d37523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:23.038004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1e29-4cfe-46ee-b3c4-75d15d37523d admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:23.038262 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1e29-4cfe-46ee-b3c4-75d15d37523d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:23.038535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1e29-4cfe-46ee-b3c4-75d15d37523d admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:23.039953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db1e29-4cfe-46ee-b3c4-75d15d37523d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:23.042190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db1e29-4cfe-46ee-b3c4-75d15d37523d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:23.062317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1173/2356] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:49:22 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:49:23.067193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcc2d4-5245-4e1f-8d1c-b6eb008b3af8 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:23.077532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcc2d4-5245-4e1f-8d1c-b6eb008b3af8 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:23.082140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1e578-c4c1-485f-8a37-89c2f9b9fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:23.082813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1e578-c4c1-485f-8a37-89c2f9b9fdea admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:23.083097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1e578-c4c1-485f-8a37-89c2f9b9fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:23.083365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1e578-c4c1-485f-8a37-89c2f9b9fdea admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:23.084076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1e578-c4c1-485f-8a37-89c2f9b9fdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:23.085668 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1e578-c4c1-485f-8a37-89c2f9b9fdea admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:23.096564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1184/2357] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:49:23.100718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db1e29-4cfe-46ee-b3c4-75d15d37523d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:23.111309 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db1e29-4cfe-46ee-b3c4-75d15d37523d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:23.118831 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeca73d-7bb6-409c-a7ef-fd80aa614982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:23.119681 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca73d-7bb6-409c-a7ef-fd80aa614982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:23.119960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca73d-7bb6-409c-a7ef-fd80aa614982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:23.120228 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca73d-7bb6-409c-a7ef-fd80aa614982 admin admin] PATH_INFO: `/v3/projects/61e1850c5a094ecf80b729291a70b058/users/b1620ad1b2404b9c9c538381f2c01d98/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:23.138941 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeca73d-7bb6-409c-a7ef-fd80aa614982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e1850c5a094ecf80b729291a70b058, user_id=b1620ad1b2404b9c9c538381f2c01d98, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:23.141572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeca73d-7bb6-409c-a7ef-fd80aa614982 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:23.156149 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1174/2358] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:49:23 2022] PUT /identity/v3/projects/61e1850c5a094ecf80b729291a70b058/users/b1620ad1b2404b9c9c538381f2c01d98/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:49:23.160161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1e578-c4c1-485f-8a37-89c2f9b9fdea admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:23.170080 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1e578-c4c1-485f-8a37-89c2f9b9fdea admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:23.225816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450115f-8c71-4ad1-b001-19763f25dcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:23.226504 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450115f-8c71-4ad1-b001-19763f25dcfe admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:23.226865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450115f-8c71-4ad1-b001-19763f25dcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:23.227145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450115f-8c71-4ad1-b001-19763f25dcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:23.227901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450115f-8c71-4ad1-b001-19763f25dcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:23.229498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450115f-8c71-4ad1-b001-19763f25dcfe admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:23.239844 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1185/2359] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:49:23.244503 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeca73d-7bb6-409c-a7ef-fd80aa614982 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:23.254878 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeca73d-7bb6-409c-a7ef-fd80aa614982 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:23.260420 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f12dd-b228-4d11-8223-fffccbe6f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:23.261294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f12dd-b228-4d11-8223-fffccbe6f22a admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:23.261573 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f12dd-b228-4d11-8223-fffccbe6f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:23.261845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f12dd-b228-4d11-8223-fffccbe6f22a admin admin] PATH_INFO: `/v3/projects/61e1850c5a094ecf80b729291a70b058/users/b1620ad1b2404b9c9c538381f2c01d98/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:23.263820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f12dd-b228-4d11-8223-fffccbe6f22a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e1850c5a094ecf80b729291a70b058, user_id=b1620ad1b2404b9c9c538381f2c01d98, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:23.266443 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f12dd-b228-4d11-8223-fffccbe6f22a admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:23.279373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1175/2360] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:49:23 2022] PUT /identity/v3/projects/61e1850c5a094ecf80b729291a70b058/users/b1620ad1b2404b9c9c538381f2c01d98/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:49:23.291671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d772d-14cd-4ef6-85d6-90ea15f7cb8a None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:23.291958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d772d-14cd-4ef6-85d6-90ea15f7cb8a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:23.292232 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d772d-14cd-4ef6-85d6-90ea15f7cb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:23.317695 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-943d772d-14cd-4ef6-85d6-90ea15f7cb8a None None] MFA Rules not processed for user `b1620ad1b2404b9c9c538381f2c01d98`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:49:23.318851 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-943d772d-14cd-4ef6-85d6-90ea15f7cb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:23.384196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1186/2361] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:49:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:49:23.395528 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f12dd-b228-4d11-8223-fffccbe6f22a admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:23.397242 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c24f12dd-b228-4d11-8223-fffccbe6f22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:23.454001 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f12dd-b228-4d11-8223-fffccbe6f22a admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:23.457744 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df28d98-a4d4-468d-93e2-0b5b3f70bb94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:23.458389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df28d98-a4d4-468d-93e2-0b5b3f70bb94 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:23.458664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df28d98-a4d4-468d-93e2-0b5b3f70bb94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:23.458966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df28d98-a4d4-468d-93e2-0b5b3f70bb94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:23.468546 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df28d98-a4d4-468d-93e2-0b5b3f70bb94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:23.469967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df28d98-a4d4-468d-93e2-0b5b3f70bb94 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:23.480017 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1176/2362] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:49:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:49:23.550608 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d772d-14cd-4ef6-85d6-90ea15f7cb8a None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:23.560279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d772d-14cd-4ef6-85d6-90ea15f7cb8a None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:23.564255 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1f8b3-73d9-4055-ad24-a2b9049870ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:23.564890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1f8b3-73d9-4055-ad24-a2b9049870ae service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:23.565166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1f8b3-73d9-4055-ad24-a2b9049870ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:23.565437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1f8b3-73d9-4055-ad24-a2b9049870ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:23.621111 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1f8b3-73d9-4055-ad24-a2b9049870ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:23.622653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1f8b3-73d9-4055-ad24-a2b9049870ae service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:23.631593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1187/2363] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:49:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:49:26.480317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa3808-aeed-4f34-b516-502ca58eb471 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:26.480810 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa3808-aeed-4f34-b516-502ca58eb471 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:26.480920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa3808-aeed-4f34-b516-502ca58eb471 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:26.482236 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1177/2364] 10.222.0.76 () {54 vars in 921 bytes} [Thu May 12 17:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:49:26.488819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25f30f-73ac-4eaf-a02b-71fc17cde95a None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:26.489287 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25f30f-73ac-4eaf-a02b-71fc17cde95a None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:26.489402 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25f30f-73ac-4eaf-a02b-71fc17cde95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:26.517557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-7f25f30f-73ac-4eaf-a02b-71fc17cde95a None None] MFA Rules not processed for user `04ad234318ad47589b844351cd3bb3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:49:26.518815 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-7f25f30f-73ac-4eaf-a02b-71fc17cde95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:26.586569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1188/2365] 10.222.0.76 () {58 vars in 1018 bytes} [Thu May 12 17:49:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:49:26.599045 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa3808-aeed-4f34-b516-502ca58eb471 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:26.600804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-36fa3808-aeed-4f34-b516-502ca58eb471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:26.667607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa3808-aeed-4f34-b516-502ca58eb471 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:26.671253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71b182-a835-40ff-afb0-8d27fd5cd77d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a003b6145fb4c5c8919020d9208afa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:26.671891 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71b182-a835-40ff-afb0-8d27fd5cd77d service glance] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:26.672186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71b182-a835-40ff-afb0-8d27fd5cd77d service glance] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:26.672449 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71b182-a835-40ff-afb0-8d27fd5cd77d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:26.682533 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71b182-a835-40ff-afb0-8d27fd5cd77d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:26.683990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71b182-a835-40ff-afb0-8d27fd5cd77d service glance] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:26.694599 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1178/2366] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:49:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:49:26.761854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a8c05-cc68-4dc0-8216-49bec320d321 None None] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:26.762138 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a8c05-cc68-4dc0-8216-49bec320d321 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:26.762410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a8c05-cc68-4dc0-8216-49bec320d321 None None] PATH_INFO: `/` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:26.763813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1189/2367] 10.222.0.76 () {54 vars in 921 bytes} [Thu May 12 17:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:49:26.768671 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e3d07-202a-42a7-a0eb-9064bf0cd284 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:26.768989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e3d07-202a-42a7-a0eb-9064bf0cd284 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:26.769290 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e3d07-202a-42a7-a0eb-9064bf0cd284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:26.787493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-9a9e3d07-202a-42a7-a0eb-9064bf0cd284 None None] MFA Rules not processed for user `731d9124a2294b95a7cf1127e5362b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:49:26.788701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9a9e3d07-202a-42a7-a0eb-9064bf0cd284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:26.839250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1179/2368] 10.222.0.76 () {58 vars in 1018 bytes} [Thu May 12 17:49:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:49:26.851000 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a8c05-cc68-4dc0-8216-49bec320d321 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:26.853279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6c7a8c05-cc68-4dc0-8216-49bec320d321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:26.865965 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a8c05-cc68-4dc0-8216-49bec320d321 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:26.870343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c214e7-cc5b-4696-9a45-47f44fffdc70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:26.871097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c214e7-cc5b-4696-9a45-47f44fffdc70 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:26.871377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c214e7-cc5b-4696-9a45-47f44fffdc70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:26.871649 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c214e7-cc5b-4696-9a45-47f44fffdc70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:26.878906 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c214e7-cc5b-4696-9a45-47f44fffdc70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:26.880326 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c214e7-cc5b-4696-9a45-47f44fffdc70 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:26.888089 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1190/2369] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:49:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:49:26.969427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0a927-3d66-4560-b4e7-9690dc47e642 None None] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:26.969648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0a927-3d66-4560-b4e7-9690dc47e642 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:26.969922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0a927-3d66-4560-b4e7-9690dc47e642 None None] PATH_INFO: `/` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:26.971344 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1180/2370] 10.222.0.76 () {54 vars in 921 bytes} [Thu May 12 17:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:49:26.977583 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbde26-56be-4f21-b2a6-3848f2b5f42e None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:26.977775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbde26-56be-4f21-b2a6-3848f2b5f42e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:26.978005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbde26-56be-4f21-b2a6-3848f2b5f42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:26.996176 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-20bbde26-56be-4f21-b2a6-3848f2b5f42e None None] MFA Rules not processed for user `04ad234318ad47589b844351cd3bb3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:49:26.997373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-20bbde26-56be-4f21-b2a6-3848f2b5f42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:27.006739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1191/2371] 10.222.0.76 () {58 vars in 1018 bytes} [Thu May 12 17:49:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:49:27.017322 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0a927-3d66-4560-b4e7-9690dc47e642 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:27.019045 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0ab0a927-3d66-4560-b4e7-9690dc47e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:27.032830 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0a927-3d66-4560-b4e7-9690dc47e642 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:27.036385 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06b065-5c56-4682-bb70-1dfb1f19b9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:27.037013 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06b065-5c56-4682-bb70-1dfb1f19b9ad service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:27.037302 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06b065-5c56-4682-bb70-1dfb1f19b9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:27.037575 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06b065-5c56-4682-bb70-1dfb1f19b9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:27.048375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06b065-5c56-4682-bb70-1dfb1f19b9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:27.049808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06b065-5c56-4682-bb70-1dfb1f19b9ad service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:27.060516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1181/2372] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:49:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:49:31.433814 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534a375-ec90-49a4-95c7-ce392deda0ad None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:31.434320 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534a375-ec90-49a4-95c7-ce392deda0ad None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:31.434511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534a375-ec90-49a4-95c7-ce392deda0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:31.456008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-5534a375-ec90-49a4-95c7-ce392deda0ad None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:49:31.457303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5534a375-ec90-49a4-95c7-ce392deda0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:31.534929 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1192/2373] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:49:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:49:31.547583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06b065-5c56-4682-bb70-1dfb1f19b9ad service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:31.548984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1a06b065-5c56-4682-bb70-1dfb1f19b9ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:31.631712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06b065-5c56-4682-bb70-1dfb1f19b9ad service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:31.638842 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131be49-f5b7-4d54-88d4-1df36d7fdd3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:31.639494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131be49-f5b7-4d54-88d4-1df36d7fdd3f service swift] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:31.639777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131be49-f5b7-4d54-88d4-1df36d7fdd3f service swift] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:31.640052 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131be49-f5b7-4d54-88d4-1df36d7fdd3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:31.651735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131be49-f5b7-4d54-88d4-1df36d7fdd3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:31.654875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131be49-f5b7-4d54-88d4-1df36d7fdd3f service swift] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:31.663638 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1182/2374] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:49:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:49:52.879298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b231d1-2a28-48fb-aeeb-e4305803dadd None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:52.879846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b231d1-2a28-48fb-aeeb-e4305803dadd None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:52.879846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b231d1-2a28-48fb-aeeb-e4305803dadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:52.899855 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-b3b231d1-2a28-48fb-aeeb-e4305803dadd None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:49:52.901469 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b3b231d1-2a28-48fb-aeeb-e4305803dadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:52.913041 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1193/2375] 10.222.0.76 () {58 vars in 967 bytes} [Thu May 12 17:49:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:49:52.931771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131be49-f5b7-4d54-88d4-1df36d7fdd3f service swift] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:52.960095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131be49-f5b7-4d54-88d4-1df36d7fdd3f service swift] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:52.967643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358da5-b370-44cd-a0ec-c5fc0fddc3e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:52.968304 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358da5-b370-44cd-a0ec-c5fc0fddc3e1 service swift] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:52.968588 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358da5-b370-44cd-a0ec-c5fc0fddc3e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:52.969003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79358da5-b370-44cd-a0ec-c5fc0fddc3e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:52.977922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79358da5-b370-44cd-a0ec-c5fc0fddc3e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:52.979653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79358da5-b370-44cd-a0ec-c5fc0fddc3e1 service swift] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:53.001429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1183/2376] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:49:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:49:58.136351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b231d1-2a28-48fb-aeeb-e4305803dadd None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:49:58.145450 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b231d1-2a28-48fb-aeeb-e4305803dadd None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:49:58.149281 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5d68c-e20c-4518-94f6-cad52bef607c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:49:58.150531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5d68c-e20c-4518-94f6-cad52bef607c service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:49:58.150849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5d68c-e20c-4518-94f6-cad52bef607c service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:49:58.151127 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5d68c-e20c-4518-94f6-cad52bef607c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:49:58.152894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8ce5d68c-e20c-4518-94f6-cad52bef607c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:49:58.212954 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5d68c-e20c-4518-94f6-cad52bef607c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:49:58.214450 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5d68c-e20c-4518-94f6-cad52bef607c service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:49:58.223870 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1194/2377] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:02.239788 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358da5-b370-44cd-a0ec-c5fc0fddc3e1 service swift] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:02.244569 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-79358da5-b370-44cd-a0ec-c5fc0fddc3e1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:02.261389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79358da5-b370-44cd-a0ec-c5fc0fddc3e1 service swift] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:02.266764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d3032-3a3e-4576-8094-8eeee5a75833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:02.267974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3032-3a3e-4576-8094-8eeee5a75833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:02.268360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3032-3a3e-4576-8094-8eeee5a75833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:02.268733 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3032-3a3e-4576-8094-8eeee5a75833 admin admin] PATH_INFO: `/v3/users/ac1708b4ee7e43afaac75452be3b195e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:02.270229 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d3032-3a3e-4576-8094-8eeee5a75833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1708b4ee7e43afaac75452be3b195e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:02.272549 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d3032-3a3e-4576-8094-8eeee5a75833 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:02.323416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a58d3032-3a3e-4576-8094-8eeee5a75833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1708b4ee7e43afaac75452be3b195e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:02.324067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a58d3032-3a3e-4576-8094-8eeee5a75833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1708b4ee7e43afaac75452be3b195e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:02.324666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a58d3032-3a3e-4576-8094-8eeee5a75833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1708b4ee7e43afaac75452be3b195e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:02.335930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a58d3032-3a3e-4576-8094-8eeee5a75833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1708b4ee7e43afaac75452be3b195e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:02.343395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-a58d3032-3a3e-4576-8094-8eeee5a75833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1708b4ee7e43afaac75452be3b195e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:02.356675 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1184/2378] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:02 2022] DELETE /identity/v3/users/ac1708b4ee7e43afaac75452be3b195e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:02.539664 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5d68c-e20c-4518-94f6-cad52bef607c service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:02.558217 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5d68c-e20c-4518-94f6-cad52bef607c service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:02.622538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:02.623453 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:02.623726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:02.624005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84 admin admin] PATH_INFO: `/v3/projects/38aae8b9be064fabb6e07ea34a5dcdb9` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:02.625393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38aae8b9be064fabb6e07ea34a5dcdb9)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:02.627373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:02.674424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38aae8b9be064fabb6e07ea34a5dcdb9', 'request_id': 'req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:02.681955 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38aae8b9be064fabb6e07ea34a5dcdb9', 'request_id': 'req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:02.687596 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38aae8b9be064fabb6e07ea34a5dcdb9', 'request_id': 'req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:02.698556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84 admin admin] The token cache is being invalidate because project 38aae8b9be064fabb6e07ea34a5dcdb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:02.698874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:02.699523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e8f7b2f8-96aa-4f98-8cfa-2e58c649ce84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:02.701085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1195/2379] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:02 2022] DELETE /identity/v3/projects/38aae8b9be064fabb6e07ea34a5dcdb9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:02.706206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35497dee-c829-4b8f-a073-06055a03ba91 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:02.706706 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35497dee-c829-4b8f-a073-06055a03ba91 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:02.707022 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35497dee-c829-4b8f-a073-06055a03ba91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:02.724653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-35497dee-c829-4b8f-a073-06055a03ba91 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:02.725853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-35497dee-c829-4b8f-a073-06055a03ba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:02.784065 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1185/2380] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:02.792683 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c4e9e-0fba-46a3-9a28-f04ae6245da5 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:02.792999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c4e9e-0fba-46a3-9a28-f04ae6245da5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:02.793276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c4e9e-0fba-46a3-9a28-f04ae6245da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:02.811438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-6f1c4e9e-0fba-46a3-9a28-f04ae6245da5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:02.812626 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6f1c4e9e-0fba-46a3-9a28-f04ae6245da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:02.820412 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1196/2381] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:02.824709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35497dee-c829-4b8f-a073-06055a03ba91 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:02.834263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35497dee-c829-4b8f-a073-06055a03ba91 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:02.839487 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903237e-8c38-467e-a99c-c700a1f0b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:02.840136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903237e-8c38-467e-a99c-c700a1f0b70f admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:02.840419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903237e-8c38-467e-a99c-c700a1f0b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:02.840697 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903237e-8c38-467e-a99c-c700a1f0b70f admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:02.841426 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903237e-8c38-467e-a99c-c700a1f0b70f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:02.841737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903237e-8c38-467e-a99c-c700a1f0b70f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:02.843383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903237e-8c38-467e-a99c-c700a1f0b70f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:02.855212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1186/2382] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:50:02.859348 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c4e9e-0fba-46a3-9a28-f04ae6245da5 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:02.868667 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c4e9e-0fba-46a3-9a28-f04ae6245da5 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:02.873571 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f4963-57f4-4c58-b312-df933b974f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:02.874302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f4963-57f4-4c58-b312-df933b974f4f admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:02.874586 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f4963-57f4-4c58-b312-df933b974f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:02.874896 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f4963-57f4-4c58-b312-df933b974f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:02.875603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f4963-57f4-4c58-b312-df933b974f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:02.877557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f4963-57f4-4c58-b312-df933b974f4f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:02.905455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1197/2383] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:02 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:02.909311 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903237e-8c38-467e-a99c-c700a1f0b70f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:02.919909 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903237e-8c38-467e-a99c-c700a1f0b70f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:02.975739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8cb6c-284d-431b-9682-930cf5f546b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:02.976398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8cb6c-284d-431b-9682-930cf5f546b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:02.976679 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8cb6c-284d-431b-9682-930cf5f546b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:02.976953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8cb6c-284d-431b-9682-930cf5f546b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:02.978202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8cb6c-284d-431b-9682-930cf5f546b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:02.980208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8cb6c-284d-431b-9682-930cf5f546b4 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:02.999967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1187/2384] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:02 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:03.003946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f4963-57f4-4c58-b312-df933b974f4f admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:03.014079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f4963-57f4-4c58-b312-df933b974f4f admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:03.018586 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a3a38-4319-474d-b935-c2811d9f4eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:03.019263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a3a38-4319-474d-b935-c2811d9f4eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:03.019546 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a3a38-4319-474d-b935-c2811d9f4eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:03.019827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a3a38-4319-474d-b935-c2811d9f4eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:03.020547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a3a38-4319-474d-b935-c2811d9f4eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:03.022141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a3a38-4319-474d-b935-c2811d9f4eaf admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:03.032468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1198/2385] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:03.036334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8cb6c-284d-431b-9682-930cf5f546b4 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:03.046906 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8cb6c-284d-431b-9682-930cf5f546b4 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:03.051440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bd892-677d-4eb3-acb5-23b74662cd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:03.052081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bd892-677d-4eb3-acb5-23b74662cd6c admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:03.052360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bd892-677d-4eb3-acb5-23b74662cd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:03.052633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bd892-677d-4eb3-acb5-23b74662cd6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:03.053347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bd892-677d-4eb3-acb5-23b74662cd6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:03.054975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bd892-677d-4eb3-acb5-23b74662cd6c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:03.065514 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1188/2386] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:03.069640 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a3a38-4319-474d-b935-c2811d9f4eaf admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:03.079650 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a3a38-4319-474d-b935-c2811d9f4eaf admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:03.084230 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968b337-182e-4d9c-b1cc-a4c3f4601444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:03.085101 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968b337-182e-4d9c-b1cc-a4c3f4601444 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:03.085382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968b337-182e-4d9c-b1cc-a4c3f4601444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:03.085661 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968b337-182e-4d9c-b1cc-a4c3f4601444 admin admin] PATH_INFO: `/v3/projects/a3abc0370bfc48f888453b4c56ee15e5/users/0300aa7787b6433b9003e46ff0853758/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:03.099795 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968b337-182e-4d9c-b1cc-a4c3f4601444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3abc0370bfc48f888453b4c56ee15e5, user_id=0300aa7787b6433b9003e46ff0853758, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:03.103121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968b337-182e-4d9c-b1cc-a4c3f4601444 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:03.115778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1199/2387] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:03 2022] PUT /identity/v3/projects/a3abc0370bfc48f888453b4c56ee15e5/users/0300aa7787b6433b9003e46ff0853758/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:03.126689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6b63-fd12-4b9b-8f15-d78a98341be2 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:03.127084 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6b63-fd12-4b9b-8f15-d78a98341be2 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:03.127379 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6b63-fd12-4b9b-8f15-d78a98341be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:03.153067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-7c2d6b63-fd12-4b9b-8f15-d78a98341be2 None None] MFA Rules not processed for user `0300aa7787b6433b9003e46ff0853758`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:03.154296 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-7c2d6b63-fd12-4b9b-8f15-d78a98341be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:03.215348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1189/2388] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:03.226219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968b337-182e-4d9c-b1cc-a4c3f4601444 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:03.228933 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c968b337-182e-4d9c-b1cc-a4c3f4601444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:03.299704 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968b337-182e-4d9c-b1cc-a4c3f4601444 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:03.305027 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ea6cf-76d9-41ac-877c-176f5af01dc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:03.306236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ea6cf-76d9-41ac-877c-176f5af01dc5 service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:03.306656 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ea6cf-76d9-41ac-877c-176f5af01dc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:03.306965 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ea6cf-76d9-41ac-877c-176f5af01dc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:03.314421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ea6cf-76d9-41ac-877c-176f5af01dc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:03.316020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ea6cf-76d9-41ac-877c-176f5af01dc5 service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:03.325421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1200/2389] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:03.732575 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d6b63-fd12-4b9b-8f15-d78a98341be2 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:03.734144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-7c2d6b63-fd12-4b9b-8f15-d78a98341be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:03.801587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d6b63-fd12-4b9b-8f15-d78a98341be2 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:03.806345 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade0f6b-a761-4ef9-94b3-b15af0c8ce0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:03.807429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade0f6b-a761-4ef9-94b3-b15af0c8ce0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:03.807707 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade0f6b-a761-4ef9-94b3-b15af0c8ce0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:03.807977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade0f6b-a761-4ef9-94b3-b15af0c8ce0f admin admin] PATH_INFO: `/v3/users/75ddc9269b414b338e90c2aeac43113a` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:03.809213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade0f6b-a761-4ef9-94b3-b15af0c8ce0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ddc9269b414b338e90c2aeac43113a)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:03.811190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade0f6b-a761-4ef9-94b3-b15af0c8ce0f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:03.859472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1ade0f6b-a761-4ef9-94b3-b15af0c8ce0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ddc9269b414b338e90c2aeac43113a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:03.860244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1ade0f6b-a761-4ef9-94b3-b15af0c8ce0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ddc9269b414b338e90c2aeac43113a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:03.860914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1ade0f6b-a761-4ef9-94b3-b15af0c8ce0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ddc9269b414b338e90c2aeac43113a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:03.873365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1ade0f6b-a761-4ef9-94b3-b15af0c8ce0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ddc9269b414b338e90c2aeac43113a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:03.879916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1ade0f6b-a761-4ef9-94b3-b15af0c8ce0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ddc9269b414b338e90c2aeac43113a'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:03.893400 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1190/2390] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:03 2022] DELETE /identity/v3/users/75ddc9269b414b338e90c2aeac43113a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:03.898121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527caaeb-8111-4737-bc89-035f64035103 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:03.898934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527caaeb-8111-4737-bc89-035f64035103 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:03.899043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527caaeb-8111-4737-bc89-035f64035103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:03.916384 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-527caaeb-8111-4737-bc89-035f64035103 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:03.917604 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-527caaeb-8111-4737-bc89-035f64035103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:03.974894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1201/2391] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:03.984726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade0f6b-a761-4ef9-94b3-b15af0c8ce0f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:03.986123 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1ade0f6b-a761-4ef9-94b3-b15af0c8ce0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:04.043031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade0f6b-a761-4ef9-94b3-b15af0c8ce0f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:04.046688 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d337a86-03ea-4aff-a67f-c6a529a1bb01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:04.047339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d337a86-03ea-4aff-a67f-c6a529a1bb01 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:04.047618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d337a86-03ea-4aff-a67f-c6a529a1bb01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:04.047890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d337a86-03ea-4aff-a67f-c6a529a1bb01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:04.057442 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d337a86-03ea-4aff-a67f-c6a529a1bb01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:04.058910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d337a86-03ea-4aff-a67f-c6a529a1bb01 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:04.068330 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1191/2392] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:04.337603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527caaeb-8111-4737-bc89-035f64035103 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:04.339084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-527caaeb-8111-4737-bc89-035f64035103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:04.351211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527caaeb-8111-4737-bc89-035f64035103 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:04.356087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:04.356950 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:04.357236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:04.358147 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] PATH_INFO: `/v3/projects/555b0f259ce14e1aacfd2744d823308e` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:04.359033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=555b0f259ce14e1aacfd2744d823308e)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:04.360968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:04.408054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555b0f259ce14e1aacfd2744d823308e', 'request_id': 'req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:04.415219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555b0f259ce14e1aacfd2744d823308e', 'request_id': 'req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:04.420526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555b0f259ce14e1aacfd2744d823308e', 'request_id': 'req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:04.431755 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] The token cache is being invalidate because project 555b0f259ce14e1aacfd2744d823308e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:04.432042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:04.432677 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:04.434218 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1202/2393] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:04 2022] DELETE /identity/v3/projects/555b0f259ce14e1aacfd2744d823308e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:04.438321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d337a86-03ea-4aff-a67f-c6a529a1bb01 service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:04.448686 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d337a86-03ea-4aff-a67f-c6a529a1bb01 service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:04.503827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5e87d-1c03-4f95-ab11-ec021b4c3aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:04.504688 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5e87d-1c03-4f95-ab11-ec021b4c3aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:04.504970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5e87d-1c03-4f95-ab11-ec021b4c3aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:04.505246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5e87d-1c03-4f95-ab11-ec021b4c3aa1 admin admin] PATH_INFO: `/v3/users/b1620ad1b2404b9c9c538381f2c01d98` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:04.506455 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5e87d-1c03-4f95-ab11-ec021b4c3aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1620ad1b2404b9c9c538381f2c01d98)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:04.508466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5e87d-1c03-4f95-ab11-ec021b4c3aa1 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:04.553622 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-b8b5e87d-1c03-4f95-ab11-ec021b4c3aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1620ad1b2404b9c9c538381f2c01d98'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:04.554294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-b8b5e87d-1c03-4f95-ab11-ec021b4c3aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1620ad1b2404b9c9c538381f2c01d98'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:04.554932 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-b8b5e87d-1c03-4f95-ab11-ec021b4c3aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1620ad1b2404b9c9c538381f2c01d98'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:04.567414 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-b8b5e87d-1c03-4f95-ab11-ec021b4c3aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1620ad1b2404b9c9c538381f2c01d98'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:04.574370 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-b8b5e87d-1c03-4f95-ab11-ec021b4c3aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1620ad1b2404b9c9c538381f2c01d98'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:04.588130 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1192/2394] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:04 2022] DELETE /identity/v3/users/b1620ad1b2404b9c9c538381f2c01d98 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:04.873974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:04.875437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:04.890524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffb1fe-8a1d-43a8-87d9-d8e558a9b26c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:04.965239 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d514bc-3e04-44db-b927-81f1c468cd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:04.966118 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d514bc-3e04-44db-b927-81f1c468cd66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:04.966452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d514bc-3e04-44db-b927-81f1c468cd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:04.966696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d514bc-3e04-44db-b927-81f1c468cd66 admin admin] PATH_INFO: `/v3/projects/61e1850c5a094ecf80b729291a70b058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:04.968182 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d514bc-3e04-44db-b927-81f1c468cd66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e1850c5a094ecf80b729291a70b058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:04.970199 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d514bc-3e04-44db-b927-81f1c468cd66 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:05.042387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-c6d514bc-3e04-44db-b927-81f1c468cd66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e1850c5a094ecf80b729291a70b058', 'request_id': 'req-c6d514bc-3e04-44db-b927-81f1c468cd66'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:05.054487 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-c6d514bc-3e04-44db-b927-81f1c468cd66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e1850c5a094ecf80b729291a70b058', 'request_id': 'req-c6d514bc-3e04-44db-b927-81f1c468cd66'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:05.061278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-c6d514bc-3e04-44db-b927-81f1c468cd66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e1850c5a094ecf80b729291a70b058', 'request_id': 'req-c6d514bc-3e04-44db-b927-81f1c468cd66'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:05.073026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-c6d514bc-3e04-44db-b927-81f1c468cd66 admin admin] The token cache is being invalidate because project 61e1850c5a094ecf80b729291a70b058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:05.073436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-c6d514bc-3e04-44db-b927-81f1c468cd66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:05.074415 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-c6d514bc-3e04-44db-b927-81f1c468cd66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:05.079246 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1203/2395] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:04 2022] DELETE /identity/v3/projects/61e1850c5a094ecf80b729291a70b058 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:05.080876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d575c-3592-4bc4-a3b1-e648edb21209 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.081342 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d575c-3592-4bc4-a3b1-e648edb21209 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.081442 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d575c-3592-4bc4-a3b1-e648edb21209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.101765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ba6d575c-3592-4bc4-a3b1-e648edb21209 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:05.103008 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ba6d575c-3592-4bc4-a3b1-e648edb21209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:05.159955 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1193/2396] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:05.168039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813994e0-26af-4a3e-9cf3-35688d9addbe None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.168345 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813994e0-26af-4a3e-9cf3-35688d9addbe None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.168620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813994e0-26af-4a3e-9cf3-35688d9addbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.187378 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-813994e0-26af-4a3e-9cf3-35688d9addbe None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:05.188500 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-813994e0-26af-4a3e-9cf3-35688d9addbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:05.197008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1204/2397] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:05.201230 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d575c-3592-4bc4-a3b1-e648edb21209 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:05.210817 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d575c-3592-4bc4-a3b1-e648edb21209 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:05.215426 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123d54c-d569-4771-8d7e-d20af370237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:05.216094 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123d54c-d569-4771-8d7e-d20af370237c admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.216375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123d54c-d569-4771-8d7e-d20af370237c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.216647 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123d54c-d569-4771-8d7e-d20af370237c admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.217393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123d54c-d569-4771-8d7e-d20af370237c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:05.217694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123d54c-d569-4771-8d7e-d20af370237c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:05.219352 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123d54c-d569-4771-8d7e-d20af370237c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:05.231124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1194/2398] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:50:05.235308 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813994e0-26af-4a3e-9cf3-35688d9addbe None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:05.245109 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813994e0-26af-4a3e-9cf3-35688d9addbe None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:05.249777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70d64b-ad71-4d52-82d7-e77055b57097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:05.250421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70d64b-ad71-4d52-82d7-e77055b57097 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.250729 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70d64b-ad71-4d52-82d7-e77055b57097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.251012 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70d64b-ad71-4d52-82d7-e77055b57097 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.251708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70d64b-ad71-4d52-82d7-e77055b57097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:05.253602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70d64b-ad71-4d52-82d7-e77055b57097 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:05.278489 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1205/2399] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:05 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:05.282629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123d54c-d569-4771-8d7e-d20af370237c admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:05.292979 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123d54c-d569-4771-8d7e-d20af370237c admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:05.348295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebc165-4295-4320-a45e-4441e1d06a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:05.349256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebc165-4295-4320-a45e-4441e1d06a01 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.349541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebc165-4295-4320-a45e-4441e1d06a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.349819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebc165-4295-4320-a45e-4441e1d06a01 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.350518 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebc165-4295-4320-a45e-4441e1d06a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:05.353098 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebc165-4295-4320-a45e-4441e1d06a01 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:05.373430 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1195/2400] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:05 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:05.377589 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70d64b-ad71-4d52-82d7-e77055b57097 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:05.387947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70d64b-ad71-4d52-82d7-e77055b57097 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:05.392536 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974b93a-d520-4577-b507-1dd160076e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:05.393189 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974b93a-d520-4577-b507-1dd160076e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.393477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974b93a-d520-4577-b507-1dd160076e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.393753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974b93a-d520-4577-b507-1dd160076e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.394480 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974b93a-d520-4577-b507-1dd160076e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:05.396105 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974b93a-d520-4577-b507-1dd160076e26 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:05.406750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1206/2401] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:05.410627 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebc165-4295-4320-a45e-4441e1d06a01 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:05.421083 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebc165-4295-4320-a45e-4441e1d06a01 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:05.425615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acc3cf-0caf-4935-b3b4-fb854f152205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:05.426258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acc3cf-0caf-4935-b3b4-fb854f152205 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.426534 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acc3cf-0caf-4935-b3b4-fb854f152205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.426833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acc3cf-0caf-4935-b3b4-fb854f152205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.427545 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acc3cf-0caf-4935-b3b4-fb854f152205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:05.429110 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acc3cf-0caf-4935-b3b4-fb854f152205 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:05.440056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1196/2402] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:05.444310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974b93a-d520-4577-b507-1dd160076e26 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:05.454129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974b93a-d520-4577-b507-1dd160076e26 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:05.458721 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf215b7f-e06b-4989-a48d-eaffe7d81fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:05.459598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf215b7f-e06b-4989-a48d-eaffe7d81fac admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.459899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf215b7f-e06b-4989-a48d-eaffe7d81fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.460170 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf215b7f-e06b-4989-a48d-eaffe7d81fac admin admin] PATH_INFO: `/v3/projects/0a0ee34f3097428c8ea9de5a8af3e52d/users/fa056dba417c4975b58c2685bac08017/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.474282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf215b7f-e06b-4989-a48d-eaffe7d81fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0ee34f3097428c8ea9de5a8af3e52d, user_id=fa056dba417c4975b58c2685bac08017, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:05.476982 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf215b7f-e06b-4989-a48d-eaffe7d81fac admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:05.489372 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1207/2403] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:05 2022] PUT /identity/v3/projects/0a0ee34f3097428c8ea9de5a8af3e52d/users/fa056dba417c4975b58c2685bac08017/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:05.501287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a27e0d-6a60-4256-8910-1b73bfcf03d5 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.501574 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a27e0d-6a60-4256-8910-1b73bfcf03d5 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.501850 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a27e0d-6a60-4256-8910-1b73bfcf03d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.529334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-34a27e0d-6a60-4256-8910-1b73bfcf03d5 None None] MFA Rules not processed for user `fa056dba417c4975b58c2685bac08017`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:05.530521 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-34a27e0d-6a60-4256-8910-1b73bfcf03d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:05.592066 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1197/2404] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:05.596501 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf215b7f-e06b-4989-a48d-eaffe7d81fac admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:05.656604 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf215b7f-e06b-4989-a48d-eaffe7d81fac admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:05.661173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28179015-21a8-4114-967d-2446ed2f23a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:05.661819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28179015-21a8-4114-967d-2446ed2f23a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.662094 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28179015-21a8-4114-967d-2446ed2f23a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.662364 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28179015-21a8-4114-967d-2446ed2f23a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.663280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28179015-21a8-4114-967d-2446ed2f23a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:05.665379 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28179015-21a8-4114-967d-2446ed2f23a3 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:05.691480 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1208/2405] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:05 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:05.695447 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a27e0d-6a60-4256-8910-1b73bfcf03d5 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:05.706853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a27e0d-6a60-4256-8910-1b73bfcf03d5 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:05.762845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51104094-f051-4b2e-9c3b-ce07af66ae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:05.763514 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51104094-f051-4b2e-9c3b-ce07af66ae43 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.763805 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51104094-f051-4b2e-9c3b-ce07af66ae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.764079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51104094-f051-4b2e-9c3b-ce07af66ae43 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.764762 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51104094-f051-4b2e-9c3b-ce07af66ae43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:05.766710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51104094-f051-4b2e-9c3b-ce07af66ae43 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:05.785474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1198/2406] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:05 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:05.789444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28179015-21a8-4114-967d-2446ed2f23a3 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:05.801171 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28179015-21a8-4114-967d-2446ed2f23a3 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:05.806491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf66400-f967-4e5c-a2a0-bee0360d67d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:05.807175 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf66400-f967-4e5c-a2a0-bee0360d67d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.807454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf66400-f967-4e5c-a2a0-bee0360d67d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.807728 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf66400-f967-4e5c-a2a0-bee0360d67d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.808446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf66400-f967-4e5c-a2a0-bee0360d67d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:05.810031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf66400-f967-4e5c-a2a0-bee0360d67d4 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:05.821025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1209/2407] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:05.825751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51104094-f051-4b2e-9c3b-ce07af66ae43 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:05.835776 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51104094-f051-4b2e-9c3b-ce07af66ae43 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:05.840517 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe063f50-6ccc-4b5f-a637-714160b0d332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:05.841389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe063f50-6ccc-4b5f-a637-714160b0d332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.841671 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe063f50-6ccc-4b5f-a637-714160b0d332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.841948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe063f50-6ccc-4b5f-a637-714160b0d332 admin admin] PATH_INFO: `/v3/projects/a0f0e9a3119940aab1ee3c12becedb5b/users/3080549c660c4ae5aa54f5994b9859fc/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.856315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe063f50-6ccc-4b5f-a637-714160b0d332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f0e9a3119940aab1ee3c12becedb5b, user_id=3080549c660c4ae5aa54f5994b9859fc, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:05.859010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe063f50-6ccc-4b5f-a637-714160b0d332 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:05.872695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1199/2408] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:05 2022] PUT /identity/v3/projects/a0f0e9a3119940aab1ee3c12becedb5b/users/3080549c660c4ae5aa54f5994b9859fc/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:05.876686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf66400-f967-4e5c-a2a0-bee0360d67d4 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:05.887427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf66400-f967-4e5c-a2a0-bee0360d67d4 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:05.942069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2875-e1a1-4ee5-ad3e-5d7bc00abeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:05.942687 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2875-e1a1-4ee5-ad3e-5d7bc00abeec admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.942978 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2875-e1a1-4ee5-ad3e-5d7bc00abeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.943251 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2875-e1a1-4ee5-ad3e-5d7bc00abeec admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.943961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb2875-e1a1-4ee5-ad3e-5d7bc00abeec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:05.945690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb2875-e1a1-4ee5-ad3e-5d7bc00abeec admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:05.955699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1210/2409] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:05.960211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe063f50-6ccc-4b5f-a637-714160b0d332 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:05.970383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe063f50-6ccc-4b5f-a637-714160b0d332 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:05.974958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93892905-bfdd-419a-8a58-3bdf8f7d9fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:05.975840 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93892905-bfdd-419a-8a58-3bdf8f7d9fed admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:05.976110 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93892905-bfdd-419a-8a58-3bdf8f7d9fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:05.976384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93892905-bfdd-419a-8a58-3bdf8f7d9fed admin admin] PATH_INFO: `/v3/projects/a0f0e9a3119940aab1ee3c12becedb5b/users/3080549c660c4ae5aa54f5994b9859fc/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:05.979039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93892905-bfdd-419a-8a58-3bdf8f7d9fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f0e9a3119940aab1ee3c12becedb5b, user_id=3080549c660c4ae5aa54f5994b9859fc, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:05.981858 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93892905-bfdd-419a-8a58-3bdf8f7d9fed admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:05.991793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1200/2410] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:05 2022] PUT /identity/v3/projects/a0f0e9a3119940aab1ee3c12becedb5b/users/3080549c660c4ae5aa54f5994b9859fc/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:06.002912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed803ce-6b47-4fbd-b95b-cea602571d3e None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:06.003403 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed803ce-6b47-4fbd-b95b-cea602571d3e None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:06.003502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed803ce-6b47-4fbd-b95b-cea602571d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:06.028924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-5ed803ce-6b47-4fbd-b95b-cea602571d3e None None] MFA Rules not processed for user `3080549c660c4ae5aa54f5994b9859fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:06.030128 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-5ed803ce-6b47-4fbd-b95b-cea602571d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:06.097980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1211/2411] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:06.110630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93892905-bfdd-419a-8a58-3bdf8f7d9fed admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:06.112667 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-93892905-bfdd-419a-8a58-3bdf8f7d9fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:06.173244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93892905-bfdd-419a-8a58-3bdf8f7d9fed admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:06.177346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348aa9b-d1ea-4886-b5d1-a570638513b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:06.178009 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348aa9b-d1ea-4886-b5d1-a570638513b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:06.178306 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348aa9b-d1ea-4886-b5d1-a570638513b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:06.178637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348aa9b-d1ea-4886-b5d1-a570638513b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:06.190324 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348aa9b-d1ea-4886-b5d1-a570638513b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:06.191881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348aa9b-d1ea-4886-b5d1-a570638513b5 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:06.202241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1201/2412] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:06.230918 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed803ce-6b47-4fbd-b95b-cea602571d3e None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:06.294242 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed803ce-6b47-4fbd-b95b-cea602571d3e None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:06.298852 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24140eb0-dd87-4450-87ce-9cf5b89a5058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:06.299712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24140eb0-dd87-4450-87ce-9cf5b89a5058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:06.299990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24140eb0-dd87-4450-87ce-9cf5b89a5058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:06.300261 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24140eb0-dd87-4450-87ce-9cf5b89a5058 admin admin] PATH_INFO: `/v3/users/fa056dba417c4975b58c2685bac08017` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:06.301449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24140eb0-dd87-4450-87ce-9cf5b89a5058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa056dba417c4975b58c2685bac08017)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:06.303440 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24140eb0-dd87-4450-87ce-9cf5b89a5058 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:06.348069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-24140eb0-dd87-4450-87ce-9cf5b89a5058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa056dba417c4975b58c2685bac08017'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:06.348747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-24140eb0-dd87-4450-87ce-9cf5b89a5058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa056dba417c4975b58c2685bac08017'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:06.360738 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-24140eb0-dd87-4450-87ce-9cf5b89a5058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa056dba417c4975b58c2685bac08017'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:06.361404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-24140eb0-dd87-4450-87ce-9cf5b89a5058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa056dba417c4975b58c2685bac08017'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:06.368693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-24140eb0-dd87-4450-87ce-9cf5b89a5058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa056dba417c4975b58c2685bac08017'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:06.381259 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1212/2413] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:06 2022] DELETE /identity/v3/users/fa056dba417c4975b58c2685bac08017 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:06.386566 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c173d-7b8f-45c4-9aa8-8bf821e1f7d5 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:06.386894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c173d-7b8f-45c4-9aa8-8bf821e1f7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:06.387191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c173d-7b8f-45c4-9aa8-8bf821e1f7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:06.405103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c13c173d-7b8f-45c4-9aa8-8bf821e1f7d5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:06.406292 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c13c173d-7b8f-45c4-9aa8-8bf821e1f7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:06.463650 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1202/2414] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:06.473408 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24140eb0-dd87-4450-87ce-9cf5b89a5058 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:06.474819 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-24140eb0-dd87-4450-87ce-9cf5b89a5058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:06.532323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24140eb0-dd87-4450-87ce-9cf5b89a5058 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:06.535907 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7ebc6-81ec-4c7a-a418-f569e5249cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:06.536534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7ebc6-81ec-4c7a-a418-f569e5249cbd service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:06.536809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7ebc6-81ec-4c7a-a418-f569e5249cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:06.537079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7ebc6-81ec-4c7a-a418-f569e5249cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:06.546366 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7ebc6-81ec-4c7a-a418-f569e5249cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:06.547804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7ebc6-81ec-4c7a-a418-f569e5249cbd service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:06.557913 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1213/2415] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:06.831359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c173d-7b8f-45c4-9aa8-8bf821e1f7d5 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:06.832802 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c13c173d-7b8f-45c4-9aa8-8bf821e1f7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:06.846776 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c173d-7b8f-45c4-9aa8-8bf821e1f7d5 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:06.852157 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:06.853491 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:06.853828 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:06.854229 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] PATH_INFO: `/v3/projects/0a0ee34f3097428c8ea9de5a8af3e52d` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:06.855543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0ee34f3097428c8ea9de5a8af3e52d)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:06.857401 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:06.902930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0ee34f3097428c8ea9de5a8af3e52d', 'request_id': 'req-52edea9b-285f-4768-bd4d-a56b636168b1'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:06.909956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0ee34f3097428c8ea9de5a8af3e52d', 'request_id': 'req-52edea9b-285f-4768-bd4d-a56b636168b1'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:06.915758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0ee34f3097428c8ea9de5a8af3e52d', 'request_id': 'req-52edea9b-285f-4768-bd4d-a56b636168b1'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:06.926434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] The token cache is being invalidate because project 0a0ee34f3097428c8ea9de5a8af3e52d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:06.926750 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:06.927387 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:06.928933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1203/2416] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:06 2022] DELETE /identity/v3/projects/0a0ee34f3097428c8ea9de5a8af3e52d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:06.933438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7ebc6-81ec-4c7a-a418-f569e5249cbd service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:06.942734 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7ebc6-81ec-4c7a-a418-f569e5249cbd service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:06.998047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62aa36-4cd7-4828-9967-251de287390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:06.998863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62aa36-4cd7-4828-9967-251de287390d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:06.999140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62aa36-4cd7-4828-9967-251de287390d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:06.999410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62aa36-4cd7-4828-9967-251de287390d admin admin] PATH_INFO: `/v3/users/3080549c660c4ae5aa54f5994b9859fc` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:07.000586 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62aa36-4cd7-4828-9967-251de287390d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3080549c660c4ae5aa54f5994b9859fc)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:07.002492 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62aa36-4cd7-4828-9967-251de287390d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:07.047200 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3c62aa36-4cd7-4828-9967-251de287390d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3080549c660c4ae5aa54f5994b9859fc'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:07.047847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3c62aa36-4cd7-4828-9967-251de287390d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3080549c660c4ae5aa54f5994b9859fc'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:07.060340 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3c62aa36-4cd7-4828-9967-251de287390d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3080549c660c4ae5aa54f5994b9859fc'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:07.060974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3c62aa36-4cd7-4828-9967-251de287390d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3080549c660c4ae5aa54f5994b9859fc'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:07.067625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-3c62aa36-4cd7-4828-9967-251de287390d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3080549c660c4ae5aa54f5994b9859fc'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:07.079685 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1214/2417] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:06 2022] DELETE /identity/v3/users/3080549c660c4ae5aa54f5994b9859fc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:07.347461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:07.349542 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:07.366175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edea9b-285f-4768-bd4d-a56b636168b1 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:07.428640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:07.429533 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:07.429811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:07.430082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1 admin admin] PATH_INFO: `/v3/projects/a0f0e9a3119940aab1ee3c12becedb5b` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:07.431563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f0e9a3119940aab1ee3c12becedb5b)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:07.433491 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:07.480144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f0e9a3119940aab1ee3c12becedb5b', 'request_id': 'req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:07.486982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f0e9a3119940aab1ee3c12becedb5b', 'request_id': 'req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:07.492410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f0e9a3119940aab1ee3c12becedb5b', 'request_id': 'req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:07.503514 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1 admin admin] The token cache is being invalidate because project a0f0e9a3119940aab1ee3c12becedb5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:07.503795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:07.504416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fe616bfe-f578-4d7f-84b1-b8e1a63a10b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:07.505936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1204/2418] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:07 2022] DELETE /identity/v3/projects/a0f0e9a3119940aab1ee3c12becedb5b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:07.514079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435978c6-ab35-41a8-aab1-6dd262567b92 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:07.514421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435978c6-ab35-41a8-aab1-6dd262567b92 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:07.514775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435978c6-ab35-41a8-aab1-6dd262567b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:07.532857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-435978c6-ab35-41a8-aab1-6dd262567b92 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:07.534001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-435978c6-ab35-41a8-aab1-6dd262567b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:07.593111 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1215/2419] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:07.600768 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3921-1d81-45e3-a26e-24f52a3c960f None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:07.601051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3921-1d81-45e3-a26e-24f52a3c960f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:07.601487 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3921-1d81-45e3-a26e-24f52a3c960f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:07.620453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c5dc3921-1d81-45e3-a26e-24f52a3c960f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:07.621637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c5dc3921-1d81-45e3-a26e-24f52a3c960f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:07.629326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1205/2420] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:07.633485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435978c6-ab35-41a8-aab1-6dd262567b92 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:07.643166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435978c6-ab35-41a8-aab1-6dd262567b92 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:07.647619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce243a28-c6e8-4bda-bad3-95558f11aca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:07.648263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243a28-c6e8-4bda-bad3-95558f11aca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:07.648544 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243a28-c6e8-4bda-bad3-95558f11aca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:07.649082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243a28-c6e8-4bda-bad3-95558f11aca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:07.649947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce243a28-c6e8-4bda-bad3-95558f11aca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:07.650252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce243a28-c6e8-4bda-bad3-95558f11aca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:07.651866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce243a28-c6e8-4bda-bad3-95558f11aca2 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:07.663022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1216/2421] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:50:07.668203 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc3921-1d81-45e3-a26e-24f52a3c960f None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:07.677846 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc3921-1d81-45e3-a26e-24f52a3c960f None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:07.683262 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b392d7d-b1d6-4ba9-beba-9bfcf11c19b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:07.683904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b392d7d-b1d6-4ba9-beba-9bfcf11c19b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:07.684184 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b392d7d-b1d6-4ba9-beba-9bfcf11c19b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:07.684459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b392d7d-b1d6-4ba9-beba-9bfcf11c19b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:07.685152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b392d7d-b1d6-4ba9-beba-9bfcf11c19b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:07.687090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b392d7d-b1d6-4ba9-beba-9bfcf11c19b6 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:07.711850 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1206/2422] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:07 2022] POST /identity/v3/projects => generated 397 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:07.715705 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce243a28-c6e8-4bda-bad3-95558f11aca2 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:07.725438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce243a28-c6e8-4bda-bad3-95558f11aca2 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:07.780125 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c19c3-851a-450e-9829-f5c447effc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:07.780786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c19c3-851a-450e-9829-f5c447effc91 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:07.781072 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c19c3-851a-450e-9829-f5c447effc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:07.781350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c19c3-851a-450e-9829-f5c447effc91 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:07.782044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c19c3-851a-450e-9829-f5c447effc91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:07.784195 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c19c3-851a-450e-9829-f5c447effc91 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:07.807130 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1217/2423] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:07 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:07.811339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b392d7d-b1d6-4ba9-beba-9bfcf11c19b6 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:07.821789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b392d7d-b1d6-4ba9-beba-9bfcf11c19b6 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:07.826523 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb077f90-3686-4c49-af20-b59b04f3b006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:07.827274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb077f90-3686-4c49-af20-b59b04f3b006 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:07.827623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb077f90-3686-4c49-af20-b59b04f3b006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:07.827939 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb077f90-3686-4c49-af20-b59b04f3b006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:07.828662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb077f90-3686-4c49-af20-b59b04f3b006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:07.830249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb077f90-3686-4c49-af20-b59b04f3b006 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:07.843898 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1207/2424] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:07.845078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c19c3-851a-450e-9829-f5c447effc91 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:07.855943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c19c3-851a-450e-9829-f5c447effc91 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:07.860582 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9dc5c-0150-46bc-8418-830f3f6eb778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:07.861231 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9dc5c-0150-46bc-8418-830f3f6eb778 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:07.861520 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9dc5c-0150-46bc-8418-830f3f6eb778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:07.861795 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9dc5c-0150-46bc-8418-830f3f6eb778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:07.862521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9dc5c-0150-46bc-8418-830f3f6eb778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:07.864136 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9dc5c-0150-46bc-8418-830f3f6eb778 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:07.874077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1218/2425] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:07.878147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb077f90-3686-4c49-af20-b59b04f3b006 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:07.888619 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb077f90-3686-4c49-af20-b59b04f3b006 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:07.893267 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a697a-76b6-4742-a251-9e8dbdad1974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:07.894147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a697a-76b6-4742-a251-9e8dbdad1974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:07.894426 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a697a-76b6-4742-a251-9e8dbdad1974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:07.894734 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a697a-76b6-4742-a251-9e8dbdad1974 admin admin] PATH_INFO: `/v3/projects/4b0ff1880b7544abb7718cfd4bec2d94/users/6d9206ff92fb4ebf9a203965678d5bc0/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:07.909600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a697a-76b6-4742-a251-9e8dbdad1974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0ff1880b7544abb7718cfd4bec2d94, user_id=6d9206ff92fb4ebf9a203965678d5bc0, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:07.912272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a697a-76b6-4742-a251-9e8dbdad1974 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:07.925519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1208/2426] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:07 2022] PUT /identity/v3/projects/4b0ff1880b7544abb7718cfd4bec2d94/users/6d9206ff92fb4ebf9a203965678d5bc0/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:07.936613 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b2f08-653e-43e5-8ca2-e22ae67bcc4b None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:07.936905 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b2f08-653e-43e5-8ca2-e22ae67bcc4b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:07.937188 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b2f08-653e-43e5-8ca2-e22ae67bcc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:07.963973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-8a8b2f08-653e-43e5-8ca2-e22ae67bcc4b None None] MFA Rules not processed for user `6d9206ff92fb4ebf9a203965678d5bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:07.965178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8a8b2f08-653e-43e5-8ca2-e22ae67bcc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:08.027768 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1219/2427] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:08.039079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a697a-76b6-4742-a251-9e8dbdad1974 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:08.041340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-722a697a-76b6-4742-a251-9e8dbdad1974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:08.096551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a697a-76b6-4742-a251-9e8dbdad1974 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:08.100127 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c79ba-0d3c-426d-bbd9-d31dd811a3ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:08.100764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c79ba-0d3c-426d-bbd9-d31dd811a3ea service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:08.101040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c79ba-0d3c-426d-bbd9-d31dd811a3ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:08.101311 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c79ba-0d3c-426d-bbd9-d31dd811a3ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:08.109988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c79ba-0d3c-426d-bbd9-d31dd811a3ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:08.111433 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c79ba-0d3c-426d-bbd9-d31dd811a3ea service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:08.120191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1209/2428] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:10.629860 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b2f08-653e-43e5-8ca2-e22ae67bcc4b None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:10.629860 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8a8b2f08-653e-43e5-8ca2-e22ae67bcc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:10.695601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b2f08-653e-43e5-8ca2-e22ae67bcc4b None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:10.701293 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b474792-5128-4ccc-9d34-d6322990abe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:10.702151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b474792-5128-4ccc-9d34-d6322990abe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:10.702430 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b474792-5128-4ccc-9d34-d6322990abe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:10.702727 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b474792-5128-4ccc-9d34-d6322990abe4 admin admin] PATH_INFO: `/v3/users/0300aa7787b6433b9003e46ff0853758` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:10.703897 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b474792-5128-4ccc-9d34-d6322990abe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0300aa7787b6433b9003e46ff0853758)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:10.705803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b474792-5128-4ccc-9d34-d6322990abe4 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:10.749689 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9b474792-5128-4ccc-9d34-d6322990abe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0300aa7787b6433b9003e46ff0853758'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:10.750499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9b474792-5128-4ccc-9d34-d6322990abe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0300aa7787b6433b9003e46ff0853758'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:10.762652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9b474792-5128-4ccc-9d34-d6322990abe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0300aa7787b6433b9003e46ff0853758'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:10.763274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9b474792-5128-4ccc-9d34-d6322990abe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0300aa7787b6433b9003e46ff0853758'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:10.769941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9b474792-5128-4ccc-9d34-d6322990abe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0300aa7787b6433b9003e46ff0853758'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:10.783368 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1220/2429] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:10 2022] DELETE /identity/v3/users/0300aa7787b6433b9003e46ff0853758 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:10.788005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94106096-ce51-4151-9144-563bc0c1bdb8 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:10.788483 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94106096-ce51-4151-9144-563bc0c1bdb8 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:10.788602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94106096-ce51-4151-9144-563bc0c1bdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:10.807056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-94106096-ce51-4151-9144-563bc0c1bdb8 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:10.808268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-94106096-ce51-4151-9144-563bc0c1bdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:10.872958 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1210/2430] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:10.884278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b474792-5128-4ccc-9d34-d6322990abe4 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:10.885771 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9b474792-5128-4ccc-9d34-d6322990abe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:10.943005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b474792-5128-4ccc-9d34-d6322990abe4 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:10.948014 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478fc3e-03b1-4b89-b811-fc0c65906d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:10.948662 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478fc3e-03b1-4b89-b811-fc0c65906d47 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:10.948951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478fc3e-03b1-4b89-b811-fc0c65906d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:10.949227 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478fc3e-03b1-4b89-b811-fc0c65906d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:10.958491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478fc3e-03b1-4b89-b811-fc0c65906d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:10.959981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478fc3e-03b1-4b89-b811-fc0c65906d47 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:10.970298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1221/2431] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:11.239241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94106096-ce51-4151-9144-563bc0c1bdb8 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:11.240743 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-94106096-ce51-4151-9144-563bc0c1bdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:11.252729 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94106096-ce51-4151-9144-563bc0c1bdb8 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:11.257329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031df22-0705-4369-8c9d-6fdcf939f1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:11.258183 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031df22-0705-4369-8c9d-6fdcf939f1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:11.258464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031df22-0705-4369-8c9d-6fdcf939f1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:11.260453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031df22-0705-4369-8c9d-6fdcf939f1de admin admin] PATH_INFO: `/v3/projects/a3abc0370bfc48f888453b4c56ee15e5` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:11.262023 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031df22-0705-4369-8c9d-6fdcf939f1de admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3abc0370bfc48f888453b4c56ee15e5)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:11.264068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031df22-0705-4369-8c9d-6fdcf939f1de admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:11.312103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2031df22-0705-4369-8c9d-6fdcf939f1de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3abc0370bfc48f888453b4c56ee15e5', 'request_id': 'req-2031df22-0705-4369-8c9d-6fdcf939f1de'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:11.318265 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2031df22-0705-4369-8c9d-6fdcf939f1de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3abc0370bfc48f888453b4c56ee15e5', 'request_id': 'req-2031df22-0705-4369-8c9d-6fdcf939f1de'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:11.324097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2031df22-0705-4369-8c9d-6fdcf939f1de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3abc0370bfc48f888453b4c56ee15e5', 'request_id': 'req-2031df22-0705-4369-8c9d-6fdcf939f1de'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:11.334532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2031df22-0705-4369-8c9d-6fdcf939f1de admin admin] The token cache is being invalidate because project a3abc0370bfc48f888453b4c56ee15e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:11.334852 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2031df22-0705-4369-8c9d-6fdcf939f1de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:11.335482 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2031df22-0705-4369-8c9d-6fdcf939f1de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:11.337974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1211/2432] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:11 2022] DELETE /identity/v3/projects/a3abc0370bfc48f888453b4c56ee15e5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:11.342735 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0e313-b9b1-4ade-a708-ce1c18f2b014 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:11.343027 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0e313-b9b1-4ade-a708-ce1c18f2b014 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:11.343304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0e313-b9b1-4ade-a708-ce1c18f2b014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:11.360456 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ada0e313-b9b1-4ade-a708-ce1c18f2b014 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:11.361658 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ada0e313-b9b1-4ade-a708-ce1c18f2b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:11.419970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1222/2433] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:11.428737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf42c86-5c99-4e1d-8735-20173b8dd7f5 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:11.429026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf42c86-5c99-4e1d-8735-20173b8dd7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:11.429307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf42c86-5c99-4e1d-8735-20173b8dd7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:11.448682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-dbf42c86-5c99-4e1d-8735-20173b8dd7f5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:11.449883 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-dbf42c86-5c99-4e1d-8735-20173b8dd7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:11.457679 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1212/2434] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:11.462554 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0e313-b9b1-4ade-a708-ce1c18f2b014 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:11.472117 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0e313-b9b1-4ade-a708-ce1c18f2b014 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:11.476719 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b94e6-b5e9-41b2-a614-01f4baf95cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:11.477367 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b94e6-b5e9-41b2-a614-01f4baf95cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:11.477652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b94e6-b5e9-41b2-a614-01f4baf95cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:11.477928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b94e6-b5e9-41b2-a614-01f4baf95cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:11.478656 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b94e6-b5e9-41b2-a614-01f4baf95cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:11.478987 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b94e6-b5e9-41b2-a614-01f4baf95cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:11.480577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b94e6-b5e9-41b2-a614-01f4baf95cd8 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:11.493787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1223/2435] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:50:11.496466 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf42c86-5c99-4e1d-8735-20173b8dd7f5 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:11.505660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf42c86-5c99-4e1d-8735-20173b8dd7f5 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:11.511552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de9f57-3a34-400b-b1d6-07b452cec132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:11.512210 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9f57-3a34-400b-b1d6-07b452cec132 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:11.512487 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9f57-3a34-400b-b1d6-07b452cec132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:11.512811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9f57-3a34-400b-b1d6-07b452cec132 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:11.513580 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de9f57-3a34-400b-b1d6-07b452cec132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:11.515633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de9f57-3a34-400b-b1d6-07b452cec132 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:11.541458 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1213/2436] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:11 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:11.546953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b94e6-b5e9-41b2-a614-01f4baf95cd8 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:11.562237 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b94e6-b5e9-41b2-a614-01f4baf95cd8 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:11.618824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d579cc3-f238-4104-803d-d10fff5f0f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:11.619503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d579cc3-f238-4104-803d-d10fff5f0f66 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:11.619791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d579cc3-f238-4104-803d-d10fff5f0f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:11.620074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d579cc3-f238-4104-803d-d10fff5f0f66 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:11.620763 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d579cc3-f238-4104-803d-d10fff5f0f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:11.622718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d579cc3-f238-4104-803d-d10fff5f0f66 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:11.644282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1224/2437] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:11 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:11.648397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de9f57-3a34-400b-b1d6-07b452cec132 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:11.658817 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de9f57-3a34-400b-b1d6-07b452cec132 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:11.663663 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1a68b-3606-4e3c-a9a4-afa9cb7445c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:11.664318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1a68b-3606-4e3c-a9a4-afa9cb7445c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:11.664610 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1a68b-3606-4e3c-a9a4-afa9cb7445c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:11.664890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1a68b-3606-4e3c-a9a4-afa9cb7445c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:11.666003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1a68b-3606-4e3c-a9a4-afa9cb7445c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:11.669055 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1a68b-3606-4e3c-a9a4-afa9cb7445c6 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:11.683224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1214/2438] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:11.686962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d579cc3-f238-4104-803d-d10fff5f0f66 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:11.697854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d579cc3-f238-4104-803d-d10fff5f0f66 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:11.702642 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad84e6-4fd6-45dc-b980-71334fc369a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:11.703335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad84e6-4fd6-45dc-b980-71334fc369a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:11.703615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad84e6-4fd6-45dc-b980-71334fc369a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:11.703885 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad84e6-4fd6-45dc-b980-71334fc369a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:11.704616 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad84e6-4fd6-45dc-b980-71334fc369a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:11.706238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad84e6-4fd6-45dc-b980-71334fc369a6 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:11.718530 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1225/2439] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:11.722773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1a68b-3606-4e3c-a9a4-afa9cb7445c6 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:11.733018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1a68b-3606-4e3c-a9a4-afa9cb7445c6 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:11.737691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976d34f-ade7-49fe-b49f-3abf8c2c9178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:11.738577 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976d34f-ade7-49fe-b49f-3abf8c2c9178 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:11.738888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976d34f-ade7-49fe-b49f-3abf8c2c9178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:11.739158 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976d34f-ade7-49fe-b49f-3abf8c2c9178 admin admin] PATH_INFO: `/v3/projects/7cfa88ee0f8b4e1d9508d85506bc9a1b/users/b29e55c67bc44040a304df71e5610d9c/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:11.754200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976d34f-ade7-49fe-b49f-3abf8c2c9178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfa88ee0f8b4e1d9508d85506bc9a1b, user_id=b29e55c67bc44040a304df71e5610d9c, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:11.756960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976d34f-ade7-49fe-b49f-3abf8c2c9178 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:11.772565 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1215/2440] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:11 2022] PUT /identity/v3/projects/7cfa88ee0f8b4e1d9508d85506bc9a1b/users/b29e55c67bc44040a304df71e5610d9c/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:11.783524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53db857-a876-4eb5-9a59-37b35d8244e5 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:11.783882 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53db857-a876-4eb5-9a59-37b35d8244e5 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:11.784265 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53db857-a876-4eb5-9a59-37b35d8244e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:11.814665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-c53db857-a876-4eb5-9a59-37b35d8244e5 None None] MFA Rules not processed for user `b29e55c67bc44040a304df71e5610d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:11.815899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c53db857-a876-4eb5-9a59-37b35d8244e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:11.885680 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1226/2441] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:11.890459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976d34f-ade7-49fe-b49f-3abf8c2c9178 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:11.951474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976d34f-ade7-49fe-b49f-3abf8c2c9178 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:11.956087 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3774e8c-a667-4b6a-8baf-21eb899af9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:11.956732 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3774e8c-a667-4b6a-8baf-21eb899af9ff admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:11.957015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3774e8c-a667-4b6a-8baf-21eb899af9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:11.957289 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3774e8c-a667-4b6a-8baf-21eb899af9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:11.957966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3774e8c-a667-4b6a-8baf-21eb899af9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:11.959897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3774e8c-a667-4b6a-8baf-21eb899af9ff admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:11.984667 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1216/2442] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:11 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:11.988625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53db857-a876-4eb5-9a59-37b35d8244e5 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:12.000002 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53db857-a876-4eb5-9a59-37b35d8244e5 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:12.054972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4fe2a-59c8-4848-b1d4-f0fd032efba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:12.056424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4fe2a-59c8-4848-b1d4-f0fd032efba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:12.056713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4fe2a-59c8-4848-b1d4-f0fd032efba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:12.057009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4fe2a-59c8-4848-b1d4-f0fd032efba4 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:12.057701 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4fe2a-59c8-4848-b1d4-f0fd032efba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:12.059647 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4fe2a-59c8-4848-b1d4-f0fd032efba4 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:12.079237 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1227/2443] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:11 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:12.083120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3774e8c-a667-4b6a-8baf-21eb899af9ff admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:12.093328 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3774e8c-a667-4b6a-8baf-21eb899af9ff admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:12.097994 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a685939-af60-43d7-ac85-0355ac6150c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:12.098588 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a685939-af60-43d7-ac85-0355ac6150c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:12.098894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a685939-af60-43d7-ac85-0355ac6150c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:12.099166 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a685939-af60-43d7-ac85-0355ac6150c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:12.099880 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a685939-af60-43d7-ac85-0355ac6150c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:12.101460 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a685939-af60-43d7-ac85-0355ac6150c1 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:12.122281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1217/2444] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:12.126188 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4fe2a-59c8-4848-b1d4-f0fd032efba4 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:12.136608 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4fe2a-59c8-4848-b1d4-f0fd032efba4 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:12.141270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe259d-32ff-467c-b49b-3fa174d22d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:12.142144 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe259d-32ff-467c-b49b-3fa174d22d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:12.142425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe259d-32ff-467c-b49b-3fa174d22d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:12.142724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe259d-32ff-467c-b49b-3fa174d22d22 admin admin] PATH_INFO: `/v3/projects/5080eb9d60ab4479984a2d8d6a5d5bfb/users/957b8e7950f84fa4ad6a9493771960d7/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:12.158601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe259d-32ff-467c-b49b-3fa174d22d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5080eb9d60ab4479984a2d8d6a5d5bfb, user_id=957b8e7950f84fa4ad6a9493771960d7, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:12.161300 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe259d-32ff-467c-b49b-3fa174d22d22 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:12.175736 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1228/2445] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:12 2022] PUT /identity/v3/projects/5080eb9d60ab4479984a2d8d6a5d5bfb/users/957b8e7950f84fa4ad6a9493771960d7/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:12.179839 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a685939-af60-43d7-ac85-0355ac6150c1 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:12.190714 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a685939-af60-43d7-ac85-0355ac6150c1 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:12.246510 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f357286-56e1-4433-a7a8-8986c0719933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:12.247275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f357286-56e1-4433-a7a8-8986c0719933 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:12.247583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f357286-56e1-4433-a7a8-8986c0719933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:12.247856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f357286-56e1-4433-a7a8-8986c0719933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:12.248614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f357286-56e1-4433-a7a8-8986c0719933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:12.250193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f357286-56e1-4433-a7a8-8986c0719933 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:12.259970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1218/2446] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:12.264262 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe259d-32ff-467c-b49b-3fa174d22d22 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:12.274910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe259d-32ff-467c-b49b-3fa174d22d22 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:12.279611 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844054c8-55e1-4543-888e-827327a439ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:12.280490 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844054c8-55e1-4543-888e-827327a439ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:12.280773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844054c8-55e1-4543-888e-827327a439ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:12.281049 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844054c8-55e1-4543-888e-827327a439ad admin admin] PATH_INFO: `/v3/projects/5080eb9d60ab4479984a2d8d6a5d5bfb/users/957b8e7950f84fa4ad6a9493771960d7/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:12.283068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844054c8-55e1-4543-888e-827327a439ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5080eb9d60ab4479984a2d8d6a5d5bfb, user_id=957b8e7950f84fa4ad6a9493771960d7, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:12.285708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844054c8-55e1-4543-888e-827327a439ad admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:12.296833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1229/2447] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:12 2022] PUT /identity/v3/projects/5080eb9d60ab4479984a2d8d6a5d5bfb/users/957b8e7950f84fa4ad6a9493771960d7/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:12.307825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bb749-83cf-40ef-84d4-92ac71242b5c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:12.308140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bb749-83cf-40ef-84d4-92ac71242b5c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:12.308417 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bb749-83cf-40ef-84d4-92ac71242b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:12.334299 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-9d4bb749-83cf-40ef-84d4-92ac71242b5c None None] MFA Rules not processed for user `957b8e7950f84fa4ad6a9493771960d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:12.335531 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9d4bb749-83cf-40ef-84d4-92ac71242b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:12.402742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1219/2448] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:12.413687 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844054c8-55e1-4543-888e-827327a439ad admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:12.415831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-844054c8-55e1-4543-888e-827327a439ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:12.470982 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844054c8-55e1-4543-888e-827327a439ad admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:12.474545 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94dc8a-9406-46c4-a972-4bc6bb4f24a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:12.475201 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94dc8a-9406-46c4-a972-4bc6bb4f24a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:12.475481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94dc8a-9406-46c4-a972-4bc6bb4f24a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:12.475760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94dc8a-9406-46c4-a972-4bc6bb4f24a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:12.484393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94dc8a-9406-46c4-a972-4bc6bb4f24a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:12.485817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94dc8a-9406-46c4-a972-4bc6bb4f24a4 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:12.497817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1230/2449] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:12.598036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bb749-83cf-40ef-84d4-92ac71242b5c None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:12.608661 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bb749-83cf-40ef-84d4-92ac71242b5c None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:12.612360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fabcf-2a9e-4d7e-8c30-b1e4d05486f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:12.612994 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fabcf-2a9e-4d7e-8c30-b1e4d05486f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:12.613296 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fabcf-2a9e-4d7e-8c30-b1e4d05486f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:12.613566 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fabcf-2a9e-4d7e-8c30-b1e4d05486f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:12.669238 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fabcf-2a9e-4d7e-8c30-b1e4d05486f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:12.670638 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fabcf-2a9e-4d7e-8c30-b1e4d05486f6 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:12.679695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1220/2450] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:15.087064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94dc8a-9406-46c4-a972-4bc6bb4f24a4 service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:15.088807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3f94dc8a-9406-46c4-a972-4bc6bb4f24a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:15.100104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94dc8a-9406-46c4-a972-4bc6bb4f24a4 service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:15.105541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3e111-4938-453f-8cf6-279a2edc4711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:15.106351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3e111-4938-453f-8cf6-279a2edc4711 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:15.106638 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3e111-4938-453f-8cf6-279a2edc4711 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:15.106949 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3e111-4938-453f-8cf6-279a2edc4711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:15.108855 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-67d3e111-4938-453f-8cf6-279a2edc4711 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:15.166110 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3e111-4938-453f-8cf6-279a2edc4711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:15.168343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3e111-4938-453f-8cf6-279a2edc4711 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:15.177696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1231/2451] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:15.192910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fabcf-2a9e-4d7e-8c30-b1e4d05486f6 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:15.194320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ba5fabcf-2a9e-4d7e-8c30-b1e4d05486f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:15.278226 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fabcf-2a9e-4d7e-8c30-b1e4d05486f6 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:15.292739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9037b-e394-409a-95b5-daf945ce8de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:15.292739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9037b-e394-409a-95b5-daf945ce8de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:15.292739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9037b-e394-409a-95b5-daf945ce8de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:15.292739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9037b-e394-409a-95b5-daf945ce8de5 admin admin] PATH_INFO: `/v3/users/6d9206ff92fb4ebf9a203965678d5bc0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:15.293207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9037b-e394-409a-95b5-daf945ce8de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d9206ff92fb4ebf9a203965678d5bc0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:15.293207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9037b-e394-409a-95b5-daf945ce8de5 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:15.344694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d0c9037b-e394-409a-95b5-daf945ce8de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d9206ff92fb4ebf9a203965678d5bc0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:15.345552 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d0c9037b-e394-409a-95b5-daf945ce8de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d9206ff92fb4ebf9a203965678d5bc0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:15.346395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d0c9037b-e394-409a-95b5-daf945ce8de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d9206ff92fb4ebf9a203965678d5bc0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:15.360480 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d0c9037b-e394-409a-95b5-daf945ce8de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d9206ff92fb4ebf9a203965678d5bc0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:15.368470 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d0c9037b-e394-409a-95b5-daf945ce8de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d9206ff92fb4ebf9a203965678d5bc0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:15.388357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1221/2452] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:15 2022] DELETE /identity/v3/users/6d9206ff92fb4ebf9a203965678d5bc0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:15.393376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc14e7-4209-4fa5-9db4-f6d1344a470b None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:15.393631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc14e7-4209-4fa5-9db4-f6d1344a470b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:15.393886 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc14e7-4209-4fa5-9db4-f6d1344a470b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:15.412753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-52fc14e7-4209-4fa5-9db4-f6d1344a470b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:15.413973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-52fc14e7-4209-4fa5-9db4-f6d1344a470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:15.479144 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1232/2453] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:15.488917 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9037b-e394-409a-95b5-daf945ce8de5 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:15.490388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d0c9037b-e394-409a-95b5-daf945ce8de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:15.547624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9037b-e394-409a-95b5-daf945ce8de5 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:15.551214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dbcf3-0f4b-4f8a-9eb1-3448419c5b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:15.551859 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dbcf3-0f4b-4f8a-9eb1-3448419c5b74 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:15.552137 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dbcf3-0f4b-4f8a-9eb1-3448419c5b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:15.552406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dbcf3-0f4b-4f8a-9eb1-3448419c5b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:15.562234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dbcf3-0f4b-4f8a-9eb1-3448419c5b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:15.563701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dbcf3-0f4b-4f8a-9eb1-3448419c5b74 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:15.574513 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1222/2454] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:50:15.919171 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc14e7-4209-4fa5-9db4-f6d1344a470b None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:15.920610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-52fc14e7-4209-4fa5-9db4-f6d1344a470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:15.933330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc14e7-4209-4fa5-9db4-f6d1344a470b None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:15.939266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:15.940138 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:15.940422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:15.940696 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] PATH_INFO: `/v3/projects/4b0ff1880b7544abb7718cfd4bec2d94` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:15.941889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0ff1880b7544abb7718cfd4bec2d94)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:15.943830 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:15.989690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0ff1880b7544abb7718cfd4bec2d94', 'request_id': 'req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:15.998341 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0ff1880b7544abb7718cfd4bec2d94', 'request_id': 'req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:16.004003 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0ff1880b7544abb7718cfd4bec2d94', 'request_id': 'req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:16.014809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] The token cache is being invalidate because project 4b0ff1880b7544abb7718cfd4bec2d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:16.015092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:16.015715 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:16.017258 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1233/2455] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:15 2022] DELETE /identity/v3/projects/4b0ff1880b7544abb7718cfd4bec2d94 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:24.118253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2fcd-35b3-4ad6-b046-e7bc74ba296b None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:24.118847 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2fcd-35b3-4ad6-b046-e7bc74ba296b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:24.118973 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2fcd-35b3-4ad6-b046-e7bc74ba296b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:24.136312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-f5cb2fcd-35b3-4ad6-b046-e7bc74ba296b None None] MFA Rules not processed for user `7802c329d4ca4eccb28fdec9f8082cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:24.138298 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f5cb2fcd-35b3-4ad6-b046-e7bc74ba296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:24.195541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1223/2456] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:25.664396 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:25.665804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:25.735099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa43b9-86a4-4774-b7f0-f6340c0fad9f admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:25.740299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d1ddb-5d56-4b68-90fe-a2a473aa3d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:25.741205 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1ddb-5d56-4b68-90fe-a2a473aa3d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:25.741488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1ddb-5d56-4b68-90fe-a2a473aa3d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:25.741764 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d1ddb-5d56-4b68-90fe-a2a473aa3d26 admin admin] PATH_INFO: `/v3/users/b29e55c67bc44040a304df71e5610d9c` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:25.742996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d1ddb-5d56-4b68-90fe-a2a473aa3d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b29e55c67bc44040a304df71e5610d9c)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:25.744914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d1ddb-5d56-4b68-90fe-a2a473aa3d26 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:25.794821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f49d1ddb-5d56-4b68-90fe-a2a473aa3d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b29e55c67bc44040a304df71e5610d9c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:25.795451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f49d1ddb-5d56-4b68-90fe-a2a473aa3d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b29e55c67bc44040a304df71e5610d9c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:25.811046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f49d1ddb-5d56-4b68-90fe-a2a473aa3d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b29e55c67bc44040a304df71e5610d9c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:25.812258 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f49d1ddb-5d56-4b68-90fe-a2a473aa3d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b29e55c67bc44040a304df71e5610d9c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:25.819155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f49d1ddb-5d56-4b68-90fe-a2a473aa3d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b29e55c67bc44040a304df71e5610d9c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:25.833304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1234/2457] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:25 2022] DELETE /identity/v3/users/b29e55c67bc44040a304df71e5610d9c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:25.837831 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e9522-b11c-4902-852a-a90404c19e3a None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:25.838328 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e9522-b11c-4902-852a-a90404c19e3a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:25.838423 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e9522-b11c-4902-852a-a90404c19e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:25.857709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-3a0e9522-b11c-4902-852a-a90404c19e3a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:25.858974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3a0e9522-b11c-4902-852a-a90404c19e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:25.923977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1224/2458] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:25.933765 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d1ddb-5d56-4b68-90fe-a2a473aa3d26 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:25.935373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f49d1ddb-5d56-4b68-90fe-a2a473aa3d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:25.998390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d1ddb-5d56-4b68-90fe-a2a473aa3d26 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:26.002230 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123abd34-64ec-4481-b7e7-735e338158c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:26.002899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123abd34-64ec-4481-b7e7-735e338158c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:26.003177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123abd34-64ec-4481-b7e7-735e338158c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:26.003447 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123abd34-64ec-4481-b7e7-735e338158c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:26.013651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123abd34-64ec-4481-b7e7-735e338158c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:26.015122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123abd34-64ec-4481-b7e7-735e338158c3 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:26.025967 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1235/2459] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:26.442909 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e9522-b11c-4902-852a-a90404c19e3a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:26.445206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3a0e9522-b11c-4902-852a-a90404c19e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:26.459947 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e9522-b11c-4902-852a-a90404c19e3a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:26.466303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:26.467677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:26.467964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:26.468244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] PATH_INFO: `/v3/projects/7cfa88ee0f8b4e1d9508d85506bc9a1b` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:26.469624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cfa88ee0f8b4e1d9508d85506bc9a1b)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:26.471580 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:26.534846 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cfa88ee0f8b4e1d9508d85506bc9a1b', 'request_id': 'req-31d75481-3971-4204-9471-90aabee56aec'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:26.543137 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cfa88ee0f8b4e1d9508d85506bc9a1b', 'request_id': 'req-31d75481-3971-4204-9471-90aabee56aec'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:26.549886 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cfa88ee0f8b4e1d9508d85506bc9a1b', 'request_id': 'req-31d75481-3971-4204-9471-90aabee56aec'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:26.562209 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] The token cache is being invalidate because project 7cfa88ee0f8b4e1d9508d85506bc9a1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:26.562625 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:26.563624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:26.566092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1225/2460] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:26 2022] DELETE /identity/v3/projects/7cfa88ee0f8b4e1d9508d85506bc9a1b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:26.569201 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123abd34-64ec-4481-b7e7-735e338158c3 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:26.580369 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123abd34-64ec-4481-b7e7-735e338158c3 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:26.665552 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcc5be-4a86-4d99-97cc-e6852cf0501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:26.667143 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcc5be-4a86-4d99-97cc-e6852cf0501c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:26.667427 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcc5be-4a86-4d99-97cc-e6852cf0501c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:26.667703 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcc5be-4a86-4d99-97cc-e6852cf0501c admin admin] PATH_INFO: `/v3/users/957b8e7950f84fa4ad6a9493771960d7` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:26.669129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcc5be-4a86-4d99-97cc-e6852cf0501c admin admin] RBAC: Authorizing `identity:delete_user(user_id=957b8e7950f84fa4ad6a9493771960d7)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:26.671185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcc5be-4a86-4d99-97cc-e6852cf0501c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:26.743526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-57fcc5be-4a86-4d99-97cc-e6852cf0501c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957b8e7950f84fa4ad6a9493771960d7'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:26.744201 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-57fcc5be-4a86-4d99-97cc-e6852cf0501c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957b8e7950f84fa4ad6a9493771960d7'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:26.761957 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-57fcc5be-4a86-4d99-97cc-e6852cf0501c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957b8e7950f84fa4ad6a9493771960d7'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:26.763779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-57fcc5be-4a86-4d99-97cc-e6852cf0501c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957b8e7950f84fa4ad6a9493771960d7'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:26.780926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-57fcc5be-4a86-4d99-97cc-e6852cf0501c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957b8e7950f84fa4ad6a9493771960d7'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:26.801855 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1236/2461] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:26 2022] DELETE /identity/v3/users/957b8e7950f84fa4ad6a9493771960d7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:27.106283 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:27.107860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:27.126020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d75481-3971-4204-9471-90aabee56aec admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:27.187057 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:27.187926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:27.188206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:27.188479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482 admin admin] PATH_INFO: `/v3/projects/5080eb9d60ab4479984a2d8d6a5d5bfb` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:27.189705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5080eb9d60ab4479984a2d8d6a5d5bfb)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:27.191937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:27.252283 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5080eb9d60ab4479984a2d8d6a5d5bfb', 'request_id': 'req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:27.263701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5080eb9d60ab4479984a2d8d6a5d5bfb', 'request_id': 'req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:27.270434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5080eb9d60ab4479984a2d8d6a5d5bfb', 'request_id': 'req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:27.283747 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482 admin admin] The token cache is being invalidate because project 5080eb9d60ab4479984a2d8d6a5d5bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:27.284121 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:27.284692 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-8e47af0d-4e5f-40e2-ad02-a27aa9d16482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:27.286272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1226/2462] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:27 2022] DELETE /identity/v3/projects/5080eb9d60ab4479984a2d8d6a5d5bfb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:27.294556 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ef24-beaa-4ec2-9a3f-ff1b70027bf4 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:27.294823 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ef24-beaa-4ec2-9a3f-ff1b70027bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:27.295104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ef24-beaa-4ec2-9a3f-ff1b70027bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:27.313373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-cc99ef24-beaa-4ec2-9a3f-ff1b70027bf4 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:27.314589 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-cc99ef24-beaa-4ec2-9a3f-ff1b70027bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:27.396256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1237/2463] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:27.408369 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da61ea-125b-49b0-8757-37a03983205d None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:27.408369 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da61ea-125b-49b0-8757-37a03983205d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:27.408369 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da61ea-125b-49b0-8757-37a03983205d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:27.429890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c1da61ea-125b-49b0-8757-37a03983205d None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:27.431161 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c1da61ea-125b-49b0-8757-37a03983205d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:27.443614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1227/2464] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:27.444791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99ef24-beaa-4ec2-9a3f-ff1b70027bf4 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:27.456794 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99ef24-beaa-4ec2-9a3f-ff1b70027bf4 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:27.460559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168797c-9030-4cf3-ab70-b4b5b1283e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:27.461341 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168797c-9030-4cf3-ab70-b4b5b1283e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:27.461633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168797c-9030-4cf3-ab70-b4b5b1283e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:27.461908 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168797c-9030-4cf3-ab70-b4b5b1283e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:27.462647 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168797c-9030-4cf3-ab70-b4b5b1283e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:27.462986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168797c-9030-4cf3-ab70-b4b5b1283e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:27.464594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168797c-9030-4cf3-ab70-b4b5b1283e4f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:27.477513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1238/2465] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:50:27.482785 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da61ea-125b-49b0-8757-37a03983205d None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:27.492560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da61ea-125b-49b0-8757-37a03983205d None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:27.498125 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ed20-01e7-48f1-bf82-688542b06d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:27.498840 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ed20-01e7-48f1-bf82-688542b06d68 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:27.499124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ed20-01e7-48f1-bf82-688542b06d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:27.499401 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ed20-01e7-48f1-bf82-688542b06d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:27.500316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69ed20-01e7-48f1-bf82-688542b06d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:27.502059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69ed20-01e7-48f1-bf82-688542b06d68 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:27.539497 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1228/2466] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:27 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:27.540766 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168797c-9030-4cf3-ab70-b4b5b1283e4f admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:27.551789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168797c-9030-4cf3-ab70-b4b5b1283e4f admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:27.636729 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849566bf-e51f-4ebd-8eab-6def9291e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:27.639095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849566bf-e51f-4ebd-8eab-6def9291e183 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:27.639583 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849566bf-e51f-4ebd-8eab-6def9291e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:27.640076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849566bf-e51f-4ebd-8eab-6def9291e183 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:27.640891 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849566bf-e51f-4ebd-8eab-6def9291e183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:27.643185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849566bf-e51f-4ebd-8eab-6def9291e183 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:27.666620 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1239/2467] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:27 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:27.671113 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ed20-01e7-48f1-bf82-688542b06d68 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:27.681896 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ed20-01e7-48f1-bf82-688542b06d68 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:27.687221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e915c6-3d2e-48e3-9d6e-73f4b833fa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:27.688187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e915c6-3d2e-48e3-9d6e-73f4b833fa66 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:27.688500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e915c6-3d2e-48e3-9d6e-73f4b833fa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:27.688774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e915c6-3d2e-48e3-9d6e-73f4b833fa66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:27.689509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e915c6-3d2e-48e3-9d6e-73f4b833fa66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:27.691358 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e915c6-3d2e-48e3-9d6e-73f4b833fa66 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:27.703621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1229/2468] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:27.709203 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849566bf-e51f-4ebd-8eab-6def9291e183 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:27.720713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849566bf-e51f-4ebd-8eab-6def9291e183 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:27.725593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce6672-a40d-4208-a96e-200aef01c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:27.726271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce6672-a40d-4208-a96e-200aef01c4aa admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:27.726757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce6672-a40d-4208-a96e-200aef01c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:27.727222 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce6672-a40d-4208-a96e-200aef01c4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:27.728114 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce6672-a40d-4208-a96e-200aef01c4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:27.729896 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce6672-a40d-4208-a96e-200aef01c4aa admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:27.741414 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1240/2469] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:27.745697 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e915c6-3d2e-48e3-9d6e-73f4b833fa66 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:27.757066 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e915c6-3d2e-48e3-9d6e-73f4b833fa66 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:27.762627 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56042b96-7df4-4d8d-9d65-2be693366106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:27.763568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56042b96-7df4-4d8d-9d65-2be693366106 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:27.763846 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56042b96-7df4-4d8d-9d65-2be693366106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:27.764114 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56042b96-7df4-4d8d-9d65-2be693366106 admin admin] PATH_INFO: `/v3/projects/f2347f6d3de842beb5d04088d21d6b95/users/41b41bdbe26e4689bfe05e12a0d368e8/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:27.781214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56042b96-7df4-4d8d-9d65-2be693366106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2347f6d3de842beb5d04088d21d6b95, user_id=41b41bdbe26e4689bfe05e12a0d368e8, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:27.784122 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56042b96-7df4-4d8d-9d65-2be693366106 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:27.797674 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1230/2470] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:27 2022] PUT /identity/v3/projects/f2347f6d3de842beb5d04088d21d6b95/users/41b41bdbe26e4689bfe05e12a0d368e8/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:27.810208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef40dee-c6d7-42cd-8912-1d0687381180 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:27.810409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef40dee-c6d7-42cd-8912-1d0687381180 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:27.810711 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef40dee-c6d7-42cd-8912-1d0687381180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:27.842066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-4ef40dee-c6d7-42cd-8912-1d0687381180 None None] MFA Rules not processed for user `41b41bdbe26e4689bfe05e12a0d368e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:27.843396 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4ef40dee-c6d7-42cd-8912-1d0687381180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:27.937512 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1241/2471] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:27.941946 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56042b96-7df4-4d8d-9d65-2be693366106 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:27.969595 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef40dee-c6d7-42cd-8912-1d0687381180 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:27.971429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4ef40dee-c6d7-42cd-8912-1d0687381180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:28.018632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56042b96-7df4-4d8d-9d65-2be693366106 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:28.023907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91a92-6700-4551-a4ed-656a848eb1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:28.024908 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91a92-6700-4551-a4ed-656a848eb1bb admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:28.025257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91a92-6700-4551-a4ed-656a848eb1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:28.025600 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91a92-6700-4551-a4ed-656a848eb1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:28.026461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a91a92-6700-4551-a4ed-656a848eb1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:28.029030 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a91a92-6700-4551-a4ed-656a848eb1bb admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:28.032384 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef40dee-c6d7-42cd-8912-1d0687381180 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:28.037410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad3c53-9250-4a05-a776-b8c76cb920de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:28.038287 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad3c53-9250-4a05-a776-b8c76cb920de service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:28.038757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad3c53-9250-4a05-a776-b8c76cb920de service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:28.039192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad3c53-9250-4a05-a776-b8c76cb920de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:28.041190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b8ad3c53-9250-4a05-a776-b8c76cb920de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:28.056471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1231/2472] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:27 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:28.061140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91a92-6700-4551-a4ed-656a848eb1bb admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:28.064599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad3c53-9250-4a05-a776-b8c76cb920de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:28.066056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad3c53-9250-4a05-a776-b8c76cb920de service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:28.076621 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1242/2473] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:50:28.124478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91a92-6700-4551-a4ed-656a848eb1bb admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:28.129911 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d59f1b-782f-44d1-a6c8-f53312d44d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:28.130586 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d59f1b-782f-44d1-a6c8-f53312d44d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:28.130910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d59f1b-782f-44d1-a6c8-f53312d44d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:28.131191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d59f1b-782f-44d1-a6c8-f53312d44d17 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:28.131908 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d59f1b-782f-44d1-a6c8-f53312d44d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:28.133990 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d59f1b-782f-44d1-a6c8-f53312d44d17 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:28.155905 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1232/2474] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:28 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:28.159804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad3c53-9250-4a05-a776-b8c76cb920de service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:28.170574 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad3c53-9250-4a05-a776-b8c76cb920de service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:28.175222 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4983fb-2f7c-407d-8eba-9e2a9cc9682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:28.175907 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4983fb-2f7c-407d-8eba-9e2a9cc9682e admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:28.176184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4983fb-2f7c-407d-8eba-9e2a9cc9682e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:28.176454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4983fb-2f7c-407d-8eba-9e2a9cc9682e admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:28.177163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4983fb-2f7c-407d-8eba-9e2a9cc9682e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:28.178785 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4983fb-2f7c-407d-8eba-9e2a9cc9682e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:28.193495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1243/2475] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:28.194804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d59f1b-782f-44d1-a6c8-f53312d44d17 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:28.205017 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d59f1b-782f-44d1-a6c8-f53312d44d17 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:28.209522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa75ee6-38cf-40ec-a6ce-5c37f2976a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:28.210393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa75ee6-38cf-40ec-a6ce-5c37f2976a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:28.210697 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa75ee6-38cf-40ec-a6ce-5c37f2976a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:28.210967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa75ee6-38cf-40ec-a6ce-5c37f2976a6a admin admin] PATH_INFO: `/v3/projects/a9547d0f61b44c718183455a30dfaa92/users/e3ae1a65b3d34e6fa428fe19cc9f968c/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:28.226932 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa75ee6-38cf-40ec-a6ce-5c37f2976a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9547d0f61b44c718183455a30dfaa92, user_id=e3ae1a65b3d34e6fa428fe19cc9f968c, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:28.229609 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa75ee6-38cf-40ec-a6ce-5c37f2976a6a admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:28.244831 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1233/2476] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:28 2022] PUT /identity/v3/projects/a9547d0f61b44c718183455a30dfaa92/users/e3ae1a65b3d34e6fa428fe19cc9f968c/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:28.249394 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4983fb-2f7c-407d-8eba-9e2a9cc9682e admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:28.260058 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4983fb-2f7c-407d-8eba-9e2a9cc9682e admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:28.332993 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb2d8b-7847-407f-8179-61e6b9855b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:28.333887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb2d8b-7847-407f-8179-61e6b9855b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:28.334267 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb2d8b-7847-407f-8179-61e6b9855b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:28.334551 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb2d8b-7847-407f-8179-61e6b9855b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:28.335309 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb2d8b-7847-407f-8179-61e6b9855b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:28.336912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb2d8b-7847-407f-8179-61e6b9855b69 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:28.347025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1244/2477] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:28.351301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa75ee6-38cf-40ec-a6ce-5c37f2976a6a admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:28.362816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa75ee6-38cf-40ec-a6ce-5c37f2976a6a admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:28.367515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e902c-478a-40d3-b917-e7cc76ebbc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:28.368775 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e902c-478a-40d3-b917-e7cc76ebbc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:28.368775 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e902c-478a-40d3-b917-e7cc76ebbc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:28.368956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e902c-478a-40d3-b917-e7cc76ebbc1e admin admin] PATH_INFO: `/v3/projects/a9547d0f61b44c718183455a30dfaa92/users/e3ae1a65b3d34e6fa428fe19cc9f968c/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:28.371181 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e902c-478a-40d3-b917-e7cc76ebbc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9547d0f61b44c718183455a30dfaa92, user_id=e3ae1a65b3d34e6fa428fe19cc9f968c, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:28.374943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e902c-478a-40d3-b917-e7cc76ebbc1e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:28.385540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1234/2478] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:28 2022] PUT /identity/v3/projects/a9547d0f61b44c718183455a30dfaa92/users/e3ae1a65b3d34e6fa428fe19cc9f968c/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:28.396773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d89cd2-4366-470b-bbdf-c000a6d31144 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:28.397070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d89cd2-4366-470b-bbdf-c000a6d31144 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:28.397351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d89cd2-4366-470b-bbdf-c000a6d31144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:28.426586 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-66d89cd2-4366-470b-bbdf-c000a6d31144 None None] MFA Rules not processed for user `e3ae1a65b3d34e6fa428fe19cc9f968c`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:28.427968 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-66d89cd2-4366-470b-bbdf-c000a6d31144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:28.513568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1245/2479] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:28 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:28.524828 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e902c-478a-40d3-b917-e7cc76ebbc1e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:28.526836 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9f7e902c-478a-40d3-b917-e7cc76ebbc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:28.589303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e902c-478a-40d3-b917-e7cc76ebbc1e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:28.593029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd710be-84c3-405f-8cd5-9a7e86595dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:28.593674 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd710be-84c3-405f-8cd5-9a7e86595dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:28.593971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd710be-84c3-405f-8cd5-9a7e86595dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:28.594229 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd710be-84c3-405f-8cd5-9a7e86595dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:28.603336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd710be-84c3-405f-8cd5-9a7e86595dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:28.604762 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd710be-84c3-405f-8cd5-9a7e86595dc0 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:28.615041 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1235/2480] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:28 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:28.660932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d89cd2-4366-470b-bbdf-c000a6d31144 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:28.663709 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-66d89cd2-4366-470b-bbdf-c000a6d31144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:28.677298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d89cd2-4366-470b-bbdf-c000a6d31144 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:28.681249 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a653d-2757-4832-b42d-8975f7e64641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:28.681981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a653d-2757-4832-b42d-8975f7e64641 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:28.682356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a653d-2757-4832-b42d-8975f7e64641 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:28.682702 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a653d-2757-4832-b42d-8975f7e64641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:28.741492 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a653d-2757-4832-b42d-8975f7e64641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:28.742961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a653d-2757-4832-b42d-8975f7e64641 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:28.754212 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1246/2481] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:31.925795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd710be-84c3-405f-8cd5-9a7e86595dc0 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:31.927511 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3fd710be-84c3-405f-8cd5-9a7e86595dc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:31.997373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd710be-84c3-405f-8cd5-9a7e86595dc0 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:32.001809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728072-4cab-49d0-bae2-c04597019ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:32.002703 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728072-4cab-49d0-bae2-c04597019ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.002982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728072-4cab-49d0-bae2-c04597019ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.003253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728072-4cab-49d0-bae2-c04597019ad0 admin admin] PATH_INFO: `/v3/users/d8866c723166455a9711559eb7f125c4` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.004433 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728072-4cab-49d0-bae2-c04597019ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8866c723166455a9711559eb7f125c4)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:32.006340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728072-4cab-49d0-bae2-c04597019ad0 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:32.059619 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1d728072-4cab-49d0-bae2-c04597019ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8866c723166455a9711559eb7f125c4'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.060275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1d728072-4cab-49d0-bae2-c04597019ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8866c723166455a9711559eb7f125c4'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.060720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1d728072-4cab-49d0-bae2-c04597019ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8866c723166455a9711559eb7f125c4'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.076638 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1d728072-4cab-49d0-bae2-c04597019ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8866c723166455a9711559eb7f125c4'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.084311 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1d728072-4cab-49d0-bae2-c04597019ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8866c723166455a9711559eb7f125c4'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.099970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1236/2482] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:31 2022] DELETE /identity/v3/users/d8866c723166455a9711559eb7f125c4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:32.213803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a653d-2757-4832-b42d-8975f7e64641 service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:32.225510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a653d-2757-4832-b42d-8975f7e64641 service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:32.289256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7917f-7e5b-42af-a869-88cd14c928ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:32.289434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728072-4cab-49d0-bae2-c04597019ad0 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:32.289555 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7917f-7e5b-42af-a869-88cd14c928ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.289831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7917f-7e5b-42af-a869-88cd14c928ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.290140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7917f-7e5b-42af-a869-88cd14c928ef admin admin] PATH_INFO: `/v3/users/41b41bdbe26e4689bfe05e12a0d368e8` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.291453 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7917f-7e5b-42af-a869-88cd14c928ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b41bdbe26e4689bfe05e12a0d368e8)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:32.293937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1d728072-4cab-49d0-bae2-c04597019ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:32.294133 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7917f-7e5b-42af-a869-88cd14c928ef admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:32.323762 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728072-4cab-49d0-bae2-c04597019ad0 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:32.329765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacbb18-39da-4e60-8f03-02db9eb36c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:32.330691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacbb18-39da-4e60-8f03-02db9eb36c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.330996 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacbb18-39da-4e60-8f03-02db9eb36c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.331271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacbb18-39da-4e60-8f03-02db9eb36c26 admin admin] PATH_INFO: `/v3/projects/bf607837a27e47bf99a32b3b095df070` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.332653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacbb18-39da-4e60-8f03-02db9eb36c26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf607837a27e47bf99a32b3b095df070)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:32.334574 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacbb18-39da-4e60-8f03-02db9eb36c26 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:32.350282 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fbd7917f-7e5b-42af-a869-88cd14c928ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b41bdbe26e4689bfe05e12a0d368e8'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.351039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fbd7917f-7e5b-42af-a869-88cd14c928ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b41bdbe26e4689bfe05e12a0d368e8'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.362927 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fbd7917f-7e5b-42af-a869-88cd14c928ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b41bdbe26e4689bfe05e12a0d368e8'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.363739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fbd7917f-7e5b-42af-a869-88cd14c928ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b41bdbe26e4689bfe05e12a0d368e8'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.370659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fbd7917f-7e5b-42af-a869-88cd14c928ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b41bdbe26e4689bfe05e12a0d368e8'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.381737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cfacbb18-39da-4e60-8f03-02db9eb36c26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf607837a27e47bf99a32b3b095df070', 'request_id': 'req-cfacbb18-39da-4e60-8f03-02db9eb36c26'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.384683 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1247/2483] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:32 2022] DELETE /identity/v3/users/41b41bdbe26e4689bfe05e12a0d368e8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:32.389951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef7554-22d2-4f90-8fec-2e2db4dd7bab None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.390242 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef7554-22d2-4f90-8fec-2e2db4dd7bab None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.390543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef7554-22d2-4f90-8fec-2e2db4dd7bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.392928 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cfacbb18-39da-4e60-8f03-02db9eb36c26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf607837a27e47bf99a32b3b095df070', 'request_id': 'req-cfacbb18-39da-4e60-8f03-02db9eb36c26'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.398562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cfacbb18-39da-4e60-8f03-02db9eb36c26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf607837a27e47bf99a32b3b095df070', 'request_id': 'req-cfacbb18-39da-4e60-8f03-02db9eb36c26'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.408955 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-c0ef7554-22d2-4f90-8fec-2e2db4dd7bab None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:32.410176 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c0ef7554-22d2-4f90-8fec-2e2db4dd7bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:32.410402 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cfacbb18-39da-4e60-8f03-02db9eb36c26 admin admin] The token cache is being invalidate because project bf607837a27e47bf99a32b3b095df070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:32.410712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cfacbb18-39da-4e60-8f03-02db9eb36c26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.411352 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cfacbb18-39da-4e60-8f03-02db9eb36c26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:32.412903 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1237/2484] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:32 2022] DELETE /identity/v3/projects/bf607837a27e47bf99a32b3b095df070 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:32.417508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf3a31-1496-49c2-8bf0-645dc41aa437 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.417841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf3a31-1496-49c2-8bf0-645dc41aa437 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.418841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf3a31-1496-49c2-8bf0-645dc41aa437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.437418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-0eaf3a31-1496-49c2-8bf0-645dc41aa437 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:32.438812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0eaf3a31-1496-49c2-8bf0-645dc41aa437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:32.468948 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1248/2485] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:32.478541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef7554-22d2-4f90-8fec-2e2db4dd7bab None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:32.479964 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c0ef7554-22d2-4f90-8fec-2e2db4dd7bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:32.499185 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1238/2486] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:32.506925 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833bacf-fdda-4d99-91df-a193582ce1c7 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.507216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833bacf-fdda-4d99-91df-a193582ce1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.507494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833bacf-fdda-4d99-91df-a193582ce1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.525632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-9833bacf-fdda-4d99-91df-a193582ce1c7 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:32.527075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9833bacf-fdda-4d99-91df-a193582ce1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:32.535825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1239/2487] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:32.539987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833bacf-fdda-4d99-91df-a193582ce1c7 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:32.540376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef7554-22d2-4f90-8fec-2e2db4dd7bab None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:32.544849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b70b-3325-46e1-947f-768b699982de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:32.545489 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b70b-3325-46e1-947f-768b699982de service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.545767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b70b-3325-46e1-947f-768b699982de service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.546160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b70b-3325-46e1-947f-768b699982de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.549746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833bacf-fdda-4d99-91df-a193582ce1c7 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:32.554207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa42122-3948-4540-ad7e-0c6ba2ce5a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:32.554872 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa42122-3948-4540-ad7e-0c6ba2ce5a0d admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.555151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa42122-3948-4540-ad7e-0c6ba2ce5a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.555268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1b70b-3325-46e1-947f-768b699982de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:32.555425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa42122-3948-4540-ad7e-0c6ba2ce5a0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.556147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa42122-3948-4540-ad7e-0c6ba2ce5a0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:32.556576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa42122-3948-4540-ad7e-0c6ba2ce5a0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:32.556690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1b70b-3325-46e1-947f-768b699982de service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:32.558146 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa42122-3948-4540-ad7e-0c6ba2ce5a0d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:32.566101 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1249/2488] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:50:32.570349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1240/2489] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:50:32.575242 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b70b-3325-46e1-947f-768b699982de service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:32.584510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b70b-3325-46e1-947f-768b699982de service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:32.589042 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d81b08-2507-4053-98d6-0548fead2255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:32.589693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81b08-2507-4053-98d6-0548fead2255 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.590600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81b08-2507-4053-98d6-0548fead2255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.591107 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81b08-2507-4053-98d6-0548fead2255 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.591938 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d81b08-2507-4053-98d6-0548fead2255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:32.593825 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d81b08-2507-4053-98d6-0548fead2255 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:32.621280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1250/2490] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:32 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:32.625517 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa42122-3948-4540-ad7e-0c6ba2ce5a0d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:32.636224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa42122-3948-4540-ad7e-0c6ba2ce5a0d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:32.695078 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2531c-5628-43cf-a391-5d22142acf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:32.695750 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2531c-5628-43cf-a391-5d22142acf8b admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.696027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2531c-5628-43cf-a391-5d22142acf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.696327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2531c-5628-43cf-a391-5d22142acf8b admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.697271 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2531c-5628-43cf-a391-5d22142acf8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:32.699052 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2531c-5628-43cf-a391-5d22142acf8b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:32.723529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1241/2491] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:32 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:32.727316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d81b08-2507-4053-98d6-0548fead2255 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:32.738558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d81b08-2507-4053-98d6-0548fead2255 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:32.743316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c3e2c-9801-4a36-8e7b-19ea8864067b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:32.743966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c3e2c-9801-4a36-8e7b-19ea8864067b admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.744244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c3e2c-9801-4a36-8e7b-19ea8864067b admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.744514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c3e2c-9801-4a36-8e7b-19ea8864067b admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.745268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c3e2c-9801-4a36-8e7b-19ea8864067b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:32.746952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c3e2c-9801-4a36-8e7b-19ea8864067b admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:32.757828 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1251/2492] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:32.761822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2531c-5628-43cf-a391-5d22142acf8b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:32.771766 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2531c-5628-43cf-a391-5d22142acf8b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:32.776604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3be2f0-9c78-4836-9d71-548aba908fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:32.777257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3be2f0-9c78-4836-9d71-548aba908fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.778305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3be2f0-9c78-4836-9d71-548aba908fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.778649 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3be2f0-9c78-4836-9d71-548aba908fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.779424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3be2f0-9c78-4836-9d71-548aba908fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:32.781032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3be2f0-9c78-4836-9d71-548aba908fa3 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:32.794842 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1242/2493] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:32.796304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c3e2c-9801-4a36-8e7b-19ea8864067b admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:32.806974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c3e2c-9801-4a36-8e7b-19ea8864067b admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:32.811983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a2233-83c9-4092-a433-aa99aa946390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:32.812865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a2233-83c9-4092-a433-aa99aa946390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.813138 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a2233-83c9-4092-a433-aa99aa946390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.813404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a2233-83c9-4092-a433-aa99aa946390 admin admin] PATH_INFO: `/v3/projects/1d252f717d76405c9892f4255d48d2e9/users/b66fcc0d3af44ad6a9e7e1d47be3848c/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.829310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a2233-83c9-4092-a433-aa99aa946390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d252f717d76405c9892f4255d48d2e9, user_id=b66fcc0d3af44ad6a9e7e1d47be3848c, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:32.832192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a2233-83c9-4092-a433-aa99aa946390 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:32.846004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3be2f0-9c78-4836-9d71-548aba908fa3 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:32.848469 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-5e3be2f0-9c78-4836-9d71-548aba908fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:32.854059 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1252/2494] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:32 2022] PUT /identity/v3/projects/1d252f717d76405c9892f4255d48d2e9/users/b66fcc0d3af44ad6a9e7e1d47be3848c/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:32.870854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8f48f-2beb-45e2-891c-9f2593777228 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.871818 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8f48f-2beb-45e2-891c-9f2593777228 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.872317 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8f48f-2beb-45e2-891c-9f2593777228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.877669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3be2f0-9c78-4836-9d71-548aba908fa3 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:32.911104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-8be8f48f-2beb-45e2-891c-9f2593777228 None None] MFA Rules not processed for user `b66fcc0d3af44ad6a9e7e1d47be3848c`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:32.912410 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8be8f48f-2beb-45e2-891c-9f2593777228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:32.942389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:32.943871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:32.944152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:32.944427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] PATH_INFO: `/v3/projects/f2347f6d3de842beb5d04088d21d6b95` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:32.945618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2347f6d3de842beb5d04088d21d6b95)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:32.947563 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:32.976190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1253/2495] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:32.980842 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8f48f-2beb-45e2-891c-9f2593777228 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:32.991408 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8f48f-2beb-45e2-891c-9f2593777228 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:32.994920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2347f6d3de842beb5d04088d21d6b95', 'request_id': 'req-19484b69-c802-4400-b3d2-bac2c92f2d4f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.002840 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2347f6d3de842beb5d04088d21d6b95', 'request_id': 'req-19484b69-c802-4400-b3d2-bac2c92f2d4f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.008873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2347f6d3de842beb5d04088d21d6b95', 'request_id': 'req-19484b69-c802-4400-b3d2-bac2c92f2d4f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.020746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] The token cache is being invalidate because project f2347f6d3de842beb5d04088d21d6b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:33.021029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.021768 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.023267 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1243/2496] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:32 2022] DELETE /identity/v3/projects/f2347f6d3de842beb5d04088d21d6b95 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:33.027436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:33.029578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:33.052247 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb6a70-b343-447d-b83d-faaef72048cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:33.053072 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb6a70-b343-447d-b83d-faaef72048cb admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.053358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb6a70-b343-447d-b83d-faaef72048cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.053624 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb6a70-b343-447d-b83d-faaef72048cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.054350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb6a70-b343-447d-b83d-faaef72048cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:33.056303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb6a70-b343-447d-b83d-faaef72048cb admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:33.085390 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1254/2497] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:32 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:33.087214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb6a70-b343-447d-b83d-faaef72048cb admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:33.088835 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-accb6a70-b343-447d-b83d-faaef72048cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:33.091844 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19484b69-c802-4400-b3d2-bac2c92f2d4f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:33.145384 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5cd26-c9ef-4078-bd8d-ac31346ab13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:33.146510 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5cd26-c9ef-4078-bd8d-ac31346ab13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.147218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5cd26-c9ef-4078-bd8d-ac31346ab13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.147688 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5cd26-c9ef-4078-bd8d-ac31346ab13d admin admin] PATH_INFO: `/v3/users/e3ae1a65b3d34e6fa428fe19cc9f968c` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.148893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5cd26-c9ef-4078-bd8d-ac31346ab13d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ae1a65b3d34e6fa428fe19cc9f968c)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:33.151103 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5cd26-c9ef-4078-bd8d-ac31346ab13d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:33.153024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb6a70-b343-447d-b83d-faaef72048cb admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:33.158050 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920fe39-bbae-44b6-b352-62a5f54a20b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:33.158735 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920fe39-bbae-44b6-b352-62a5f54a20b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.159020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920fe39-bbae-44b6-b352-62a5f54a20b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.159296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920fe39-bbae-44b6-b352-62a5f54a20b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.159997 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920fe39-bbae-44b6-b352-62a5f54a20b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:33.161912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920fe39-bbae-44b6-b352-62a5f54a20b9 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:33.186278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1255/2498] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:33 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:33.187452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920fe39-bbae-44b6-b352-62a5f54a20b9 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:33.196849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920fe39-bbae-44b6-b352-62a5f54a20b9 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:33.198324 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-abb5cd26-c9ef-4078-bd8d-ac31346ab13d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ae1a65b3d34e6fa428fe19cc9f968c'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.199048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-abb5cd26-c9ef-4078-bd8d-ac31346ab13d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ae1a65b3d34e6fa428fe19cc9f968c'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.200698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-abb5cd26-c9ef-4078-bd8d-ac31346ab13d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ae1a65b3d34e6fa428fe19cc9f968c'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.202065 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d6d3c-f153-4d6b-be64-6f052dffb33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:33.202743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d6d3c-f153-4d6b-be64-6f052dffb33d admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.203030 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d6d3c-f153-4d6b-be64-6f052dffb33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.203308 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d6d3c-f153-4d6b-be64-6f052dffb33d admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.204027 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d6d3c-f153-4d6b-be64-6f052dffb33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:33.205612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d6d3c-f153-4d6b-be64-6f052dffb33d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:33.212799 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-abb5cd26-c9ef-4078-bd8d-ac31346ab13d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ae1a65b3d34e6fa428fe19cc9f968c'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.216820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1256/2499] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:33.220804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d6d3c-f153-4d6b-be64-6f052dffb33d admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:33.220940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-abb5cd26-c9ef-4078-bd8d-ac31346ab13d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ae1a65b3d34e6fa428fe19cc9f968c'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.222570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9b6d6d3c-f153-4d6b-be64-6f052dffb33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:33.237015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1244/2500] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:33 2022] DELETE /identity/v3/users/e3ae1a65b3d34e6fa428fe19cc9f968c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:33.237350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d6d3c-f153-4d6b-be64-6f052dffb33d admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:33.300708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80a1c0-6cfc-442a-bf5d-7c7c6c9b61e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:33.301550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a1c0-6cfc-442a-bf5d-7c7c6c9b61e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.301978 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a1c0-6cfc-442a-bf5d-7c7c6c9b61e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.302254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a1c0-6cfc-442a-bf5d-7c7c6c9b61e6 admin admin] PATH_INFO: `/v3/projects/255cc12ee5104adf9a8aef83603ec500/users/51cae3dd394d4c8b8d1274e065e0fb02/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.319454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80a1c0-6cfc-442a-bf5d-7c7c6c9b61e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=255cc12ee5104adf9a8aef83603ec500, user_id=51cae3dd394d4c8b8d1274e065e0fb02, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:33.322204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80a1c0-6cfc-442a-bf5d-7c7c6c9b61e6 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:33.339074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1257/2501] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:33 2022] PUT /identity/v3/projects/255cc12ee5104adf9a8aef83603ec500/users/51cae3dd394d4c8b8d1274e065e0fb02/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:33.343782 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5cd26-c9ef-4078-bd8d-ac31346ab13d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:33.354607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5cd26-c9ef-4078-bd8d-ac31346ab13d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:33.427777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b721794-ae2d-46fe-bcb2-2cb3f7f0aa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:33.428672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b721794-ae2d-46fe-bcb2-2cb3f7f0aa1b admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.429026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b721794-ae2d-46fe-bcb2-2cb3f7f0aa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.429372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b721794-ae2d-46fe-bcb2-2cb3f7f0aa1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.430173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b721794-ae2d-46fe-bcb2-2cb3f7f0aa1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:33.431896 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b721794-ae2d-46fe-bcb2-2cb3f7f0aa1b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:33.442490 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1245/2502] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:33.446769 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80a1c0-6cfc-442a-bf5d-7c7c6c9b61e6 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:33.457889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80a1c0-6cfc-442a-bf5d-7c7c6c9b61e6 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:33.462458 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce7d8f-46ce-421f-a4a3-92443706c5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:33.463362 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce7d8f-46ce-421f-a4a3-92443706c5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.463633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce7d8f-46ce-421f-a4a3-92443706c5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.463900 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce7d8f-46ce-421f-a4a3-92443706c5d8 admin admin] PATH_INFO: `/v3/projects/255cc12ee5104adf9a8aef83603ec500/users/51cae3dd394d4c8b8d1274e065e0fb02/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.466074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce7d8f-46ce-421f-a4a3-92443706c5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=255cc12ee5104adf9a8aef83603ec500, user_id=51cae3dd394d4c8b8d1274e065e0fb02, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:33.468866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce7d8f-46ce-421f-a4a3-92443706c5d8 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:33.479827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1258/2503] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:33 2022] PUT /identity/v3/projects/255cc12ee5104adf9a8aef83603ec500/users/51cae3dd394d4c8b8d1274e065e0fb02/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:33.490027 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecc255-07ec-4847-af7e-e9c30330ccb8 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.490318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecc255-07ec-4847-af7e-e9c30330ccb8 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.490596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecc255-07ec-4847-af7e-e9c30330ccb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.518695 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-7aecc255-07ec-4847-af7e-e9c30330ccb8 None None] MFA Rules not processed for user `51cae3dd394d4c8b8d1274e065e0fb02`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:33.519953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-7aecc255-07ec-4847-af7e-e9c30330ccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:33.543102 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce7d8f-46ce-421f-a4a3-92443706c5d8 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:33.545672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-52ce7d8f-46ce-421f-a4a3-92443706c5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:33.600077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1246/2504] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:33.611619 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecc255-07ec-4847-af7e-e9c30330ccb8 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:33.613090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-7aecc255-07ec-4847-af7e-e9c30330ccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:33.618867 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce7d8f-46ce-421f-a4a3-92443706c5d8 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:33.624163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:33.625039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.625319 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.625594 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41 admin admin] PATH_INFO: `/v3/projects/a9547d0f61b44c718183455a30dfaa92` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.626824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9547d0f61b44c718183455a30dfaa92)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:33.629027 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:33.676884 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9547d0f61b44c718183455a30dfaa92', 'request_id': 'req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.677640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecc255-07ec-4847-af7e-e9c30330ccb8 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:33.684862 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9547d0f61b44c718183455a30dfaa92', 'request_id': 'req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.690874 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9547d0f61b44c718183455a30dfaa92', 'request_id': 'req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.702652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41 admin admin] The token cache is being invalidate because project a9547d0f61b44c718183455a30dfaa92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:33.702966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.703630 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7c2df63a-84fb-4b10-bb6b-da31bcfc5f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:33.705229 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1259/2505] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:33 2022] DELETE /identity/v3/projects/a9547d0f61b44c718183455a30dfaa92 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:33.709800 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5c9c4-1ceb-457e-aaa8-4b698deb18b0 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.710141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5c9c4-1ceb-457e-aaa8-4b698deb18b0 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.710423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5c9c4-1ceb-457e-aaa8-4b698deb18b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.726612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bc42e-132f-4747-b411-1dd8abd857b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:33.727288 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bc42e-132f-4747-b411-1dd8abd857b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.727569 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bc42e-132f-4747-b411-1dd8abd857b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.727845 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bc42e-132f-4747-b411-1dd8abd857b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.728583 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-81c5c9c4-1ceb-457e-aaa8-4b698deb18b0 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:33.729624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c12bc42e-132f-4747-b411-1dd8abd857b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:33.729771 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-81c5c9c4-1ceb-457e-aaa8-4b698deb18b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:33.789118 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1260/2506] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:33.790464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bc42e-132f-4747-b411-1dd8abd857b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:33.791983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bc42e-132f-4747-b411-1dd8abd857b3 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:33.797270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9746c0-858d-4703-8f75-0198e87c0675 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.797574 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9746c0-858d-4703-8f75-0198e87c0675 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.798144 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9746c0-858d-4703-8f75-0198e87c0675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.803607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1247/2507] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:50:33.817435 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ff9746c0-858d-4703-8f75-0198e87c0675 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:33.818634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ff9746c0-858d-4703-8f75-0198e87c0675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:33.827646 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1261/2508] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:33.832333 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bc42e-132f-4747-b411-1dd8abd857b3 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:33.844741 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bc42e-132f-4747-b411-1dd8abd857b3 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:33.849656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8eb23-b9a8-4f5d-8531-33bc158f39fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:33.850391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8eb23-b9a8-4f5d-8531-33bc158f39fc admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.850778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8eb23-b9a8-4f5d-8531-33bc158f39fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.851124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8eb23-b9a8-4f5d-8531-33bc158f39fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.851924 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8eb23-b9a8-4f5d-8531-33bc158f39fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:33.852237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8eb23-b9a8-4f5d-8531-33bc158f39fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:33.853844 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8eb23-b9a8-4f5d-8531-33bc158f39fc admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:33.870151 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1248/2509] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:50:33.871927 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9746c0-858d-4703-8f75-0198e87c0675 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:33.881086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9746c0-858d-4703-8f75-0198e87c0675 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:33.885995 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b321e4b-5824-4993-8b7e-ba74a6c9b28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:33.887387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b321e4b-5824-4993-8b7e-ba74a6c9b28c admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.887558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b321e4b-5824-4993-8b7e-ba74a6c9b28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.887996 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b321e4b-5824-4993-8b7e-ba74a6c9b28c admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.888805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b321e4b-5824-4993-8b7e-ba74a6c9b28c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:33.890779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b321e4b-5824-4993-8b7e-ba74a6c9b28c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:33.917733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1262/2510] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:33 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:33.922424 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8eb23-b9a8-4f5d-8531-33bc158f39fc admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:33.932255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8eb23-b9a8-4f5d-8531-33bc158f39fc admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:33.991279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04f08e-87b8-4c8f-ad2a-de07418af531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:33.992064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04f08e-87b8-4c8f-ad2a-de07418af531 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:33.992418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04f08e-87b8-4c8f-ad2a-de07418af531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:33.992719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04f08e-87b8-4c8f-ad2a-de07418af531 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:33.993623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04f08e-87b8-4c8f-ad2a-de07418af531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:33.995604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04f08e-87b8-4c8f-ad2a-de07418af531 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:34.019693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1249/2511] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:33 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:34.023814 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b321e4b-5824-4993-8b7e-ba74a6c9b28c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:34.034810 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b321e4b-5824-4993-8b7e-ba74a6c9b28c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:34.041424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768154b-65bb-4daf-b61c-60912a5081d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:34.042412 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768154b-65bb-4daf-b61c-60912a5081d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:34.042862 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768154b-65bb-4daf-b61c-60912a5081d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:34.043950 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768154b-65bb-4daf-b61c-60912a5081d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:34.044758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768154b-65bb-4daf-b61c-60912a5081d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:34.046404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768154b-65bb-4daf-b61c-60912a5081d9 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:34.057643 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1263/2512] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:34.062171 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04f08e-87b8-4c8f-ad2a-de07418af531 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:34.072188 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04f08e-87b8-4c8f-ad2a-de07418af531 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:34.077499 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ce966-0e6b-4497-9275-2d9adc5eb92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:34.078233 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce966-0e6b-4497-9275-2d9adc5eb92b admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:34.078576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce966-0e6b-4497-9275-2d9adc5eb92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:34.078945 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce966-0e6b-4497-9275-2d9adc5eb92b admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:34.079792 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ce966-0e6b-4497-9275-2d9adc5eb92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:34.083169 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ce966-0e6b-4497-9275-2d9adc5eb92b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:34.093178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1250/2513] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:34.097303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768154b-65bb-4daf-b61c-60912a5081d9 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:34.107917 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768154b-65bb-4daf-b61c-60912a5081d9 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:34.112514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f17f1-c9f8-479c-8542-ecad6970d624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:34.113432 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f17f1-c9f8-479c-8542-ecad6970d624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:34.113710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f17f1-c9f8-479c-8542-ecad6970d624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:34.113979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f17f1-c9f8-479c-8542-ecad6970d624 admin admin] PATH_INFO: `/v3/projects/11afdea7f8b94d6b98111fe2969177ba/users/0dd793bb29c2461eb3a7da1a166c13f5/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:34.132014 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f17f1-c9f8-479c-8542-ecad6970d624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11afdea7f8b94d6b98111fe2969177ba, user_id=0dd793bb29c2461eb3a7da1a166c13f5, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:34.134664 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f17f1-c9f8-479c-8542-ecad6970d624 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:34.148671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1264/2514] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:34 2022] PUT /identity/v3/projects/11afdea7f8b94d6b98111fe2969177ba/users/0dd793bb29c2461eb3a7da1a166c13f5/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:34.160610 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e670c-d645-4efb-94a4-9ebc7942ba81 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:34.160902 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e670c-d645-4efb-94a4-9ebc7942ba81 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:34.161225 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e670c-d645-4efb-94a4-9ebc7942ba81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:34.190294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c84e670c-d645-4efb-94a4-9ebc7942ba81 None None] MFA Rules not processed for user `0dd793bb29c2461eb3a7da1a166c13f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:34.191704 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c84e670c-d645-4efb-94a4-9ebc7942ba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:34.260851 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1251/2515] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:34.265087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f17f1-c9f8-479c-8542-ecad6970d624 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:34.341244 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f17f1-c9f8-479c-8542-ecad6970d624 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:34.349600 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e610ac0-6c89-430c-8143-fd9937565f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:34.350269 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e610ac0-6c89-430c-8143-fd9937565f23 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:34.350549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e610ac0-6c89-430c-8143-fd9937565f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:34.350882 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e610ac0-6c89-430c-8143-fd9937565f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:34.351577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e610ac0-6c89-430c-8143-fd9937565f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:34.354352 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e610ac0-6c89-430c-8143-fd9937565f23 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:34.384205 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1265/2516] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:34 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:34.389088 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e670c-d645-4efb-94a4-9ebc7942ba81 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:34.402344 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e670c-d645-4efb-94a4-9ebc7942ba81 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:34.472293 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79839f-8191-4e80-a3d3-06edd71cf89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:34.473906 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79839f-8191-4e80-a3d3-06edd71cf89d admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:34.474596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79839f-8191-4e80-a3d3-06edd71cf89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:34.475050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79839f-8191-4e80-a3d3-06edd71cf89d admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:34.475676 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79839f-8191-4e80-a3d3-06edd71cf89d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:34.477804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79839f-8191-4e80-a3d3-06edd71cf89d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:34.504417 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1252/2517] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:34 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:34.507946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e610ac0-6c89-430c-8143-fd9937565f23 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:34.520673 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e610ac0-6c89-430c-8143-fd9937565f23 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:34.529494 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200f5db-13dd-4f99-a3c2-1b6bf050d9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:34.530305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f5db-13dd-4f99-a3c2-1b6bf050d9cb admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:34.531204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f5db-13dd-4f99-a3c2-1b6bf050d9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:34.532373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f5db-13dd-4f99-a3c2-1b6bf050d9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:34.533349 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200f5db-13dd-4f99-a3c2-1b6bf050d9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:34.535395 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200f5db-13dd-4f99-a3c2-1b6bf050d9cb admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:34.548020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1266/2518] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:34.552175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79839f-8191-4e80-a3d3-06edd71cf89d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:34.565393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79839f-8191-4e80-a3d3-06edd71cf89d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:34.576036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d329d08-0ffc-4a86-8b35-1ed18114de5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:34.577052 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d329d08-0ffc-4a86-8b35-1ed18114de5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:34.577193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d329d08-0ffc-4a86-8b35-1ed18114de5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:34.577464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d329d08-0ffc-4a86-8b35-1ed18114de5e admin admin] PATH_INFO: `/v3/projects/f79c894f0f5041a694b4318767ebd510/users/92b0522169594f6fa4169ee1bf911850/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:34.596419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d329d08-0ffc-4a86-8b35-1ed18114de5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79c894f0f5041a694b4318767ebd510, user_id=92b0522169594f6fa4169ee1bf911850, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:34.599249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d329d08-0ffc-4a86-8b35-1ed18114de5e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:34.623293 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1253/2519] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:34 2022] PUT /identity/v3/projects/f79c894f0f5041a694b4318767ebd510/users/92b0522169594f6fa4169ee1bf911850/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:34.627432 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200f5db-13dd-4f99-a3c2-1b6bf050d9cb admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:34.653928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200f5db-13dd-4f99-a3c2-1b6bf050d9cb admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:34.722079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1d442-3e01-4ede-a0e7-727e583bfcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:34.722965 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1d442-3e01-4ede-a0e7-727e583bfcfa admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:34.723413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1d442-3e01-4ede-a0e7-727e583bfcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:34.723849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1d442-3e01-4ede-a0e7-727e583bfcfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:34.724574 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1d442-3e01-4ede-a0e7-727e583bfcfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:34.728226 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1d442-3e01-4ede-a0e7-727e583bfcfa admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:34.742547 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1267/2520] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:34.743755 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d329d08-0ffc-4a86-8b35-1ed18114de5e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:34.755931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d329d08-0ffc-4a86-8b35-1ed18114de5e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:34.761526 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc20b08-b61a-40e9-bb1f-ee17edc94f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:34.763643 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc20b08-b61a-40e9-bb1f-ee17edc94f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:34.763936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc20b08-b61a-40e9-bb1f-ee17edc94f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:34.768400 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc20b08-b61a-40e9-bb1f-ee17edc94f0f admin admin] PATH_INFO: `/v3/projects/f79c894f0f5041a694b4318767ebd510/users/92b0522169594f6fa4169ee1bf911850/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:34.770966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc20b08-b61a-40e9-bb1f-ee17edc94f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79c894f0f5041a694b4318767ebd510, user_id=92b0522169594f6fa4169ee1bf911850, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:34.775264 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc20b08-b61a-40e9-bb1f-ee17edc94f0f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:34.788340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1254/2521] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:34 2022] PUT /identity/v3/projects/f79c894f0f5041a694b4318767ebd510/users/92b0522169594f6fa4169ee1bf911850/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:34.799709 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae1a48-b651-4d69-9ee5-839048f5edb2 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:34.800005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae1a48-b651-4d69-9ee5-839048f5edb2 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:34.800436 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae1a48-b651-4d69-9ee5-839048f5edb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:34.829751 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-08ae1a48-b651-4d69-9ee5-839048f5edb2 None None] MFA Rules not processed for user `92b0522169594f6fa4169ee1bf911850`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:34.831017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-08ae1a48-b651-4d69-9ee5-839048f5edb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:34.904949 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1268/2522] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:34.918175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc20b08-b61a-40e9-bb1f-ee17edc94f0f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:34.918175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3bc20b08-b61a-40e9-bb1f-ee17edc94f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:34.976371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc20b08-b61a-40e9-bb1f-ee17edc94f0f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:34.980018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472da34-bb12-4c61-b284-36b9f90a520f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:34.980698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472da34-bb12-4c61-b284-36b9f90a520f service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:34.980977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472da34-bb12-4c61-b284-36b9f90a520f service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:34.981255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472da34-bb12-4c61-b284-36b9f90a520f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:34.990776 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472da34-bb12-4c61-b284-36b9f90a520f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:34.992225 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472da34-bb12-4c61-b284-36b9f90a520f service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:35.002206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1255/2523] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:35.072666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae1a48-b651-4d69-9ee5-839048f5edb2 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:35.138508 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae1a48-b651-4d69-9ee5-839048f5edb2 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:35.143176 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220c083-ce7e-4379-aa5c-5649c4a94da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:35.144043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220c083-ce7e-4379-aa5c-5649c4a94da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:35.144329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220c083-ce7e-4379-aa5c-5649c4a94da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:35.144603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220c083-ce7e-4379-aa5c-5649c4a94da8 admin admin] PATH_INFO: `/v3/users/0dd793bb29c2461eb3a7da1a166c13f5` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:35.145837 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220c083-ce7e-4379-aa5c-5649c4a94da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd793bb29c2461eb3a7da1a166c13f5)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:35.147821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220c083-ce7e-4379-aa5c-5649c4a94da8 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:35.195715 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1220c083-ce7e-4379-aa5c-5649c4a94da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd793bb29c2461eb3a7da1a166c13f5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.196374 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1220c083-ce7e-4379-aa5c-5649c4a94da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd793bb29c2461eb3a7da1a166c13f5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.208140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1220c083-ce7e-4379-aa5c-5649c4a94da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd793bb29c2461eb3a7da1a166c13f5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.208843 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1220c083-ce7e-4379-aa5c-5649c4a94da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd793bb29c2461eb3a7da1a166c13f5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.215791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1220c083-ce7e-4379-aa5c-5649c4a94da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd793bb29c2461eb3a7da1a166c13f5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.228580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1269/2524] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:35 2022] DELETE /identity/v3/users/0dd793bb29c2461eb3a7da1a166c13f5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:35.233750 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a5a18-d1db-4882-b216-7be0e180e213 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:35.234039 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a5a18-d1db-4882-b216-7be0e180e213 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:35.234317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a5a18-d1db-4882-b216-7be0e180e213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:35.254408 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-841a5a18-d1db-4882-b216-7be0e180e213 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:35.255654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-841a5a18-d1db-4882-b216-7be0e180e213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:35.263777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220c083-ce7e-4379-aa5c-5649c4a94da8 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:35.265148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-1220c083-ce7e-4379-aa5c-5649c4a94da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:35.316150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1256/2525] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:35.326877 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a5a18-d1db-4882-b216-7be0e180e213 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:35.328219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-841a5a18-d1db-4882-b216-7be0e180e213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:35.333087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220c083-ce7e-4379-aa5c-5649c4a94da8 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:35.337981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fd2d8-2043-417f-abe1-b9e4debec18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:35.338941 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fd2d8-2043-417f-abe1-b9e4debec18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:35.339219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fd2d8-2043-417f-abe1-b9e4debec18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:35.339494 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fd2d8-2043-417f-abe1-b9e4debec18a admin admin] PATH_INFO: `/v3/users/b66fcc0d3af44ad6a9e7e1d47be3848c` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:35.341385 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fd2d8-2043-417f-abe1-b9e4debec18a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66fcc0d3af44ad6a9e7e1d47be3848c)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:35.343364 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fd2d8-2043-417f-abe1-b9e4debec18a admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:35.385919 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a5a18-d1db-4882-b216-7be0e180e213 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:35.390045 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ac2fd2d8-2043-417f-abe1-b9e4debec18a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66fcc0d3af44ad6a9e7e1d47be3848c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.390700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da281a-56b6-42ea-9eb2-77a08a0ffbef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:35.390879 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ac2fd2d8-2043-417f-abe1-b9e4debec18a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66fcc0d3af44ad6a9e7e1d47be3848c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.391586 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da281a-56b6-42ea-9eb2-77a08a0ffbef service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:35.391868 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da281a-56b6-42ea-9eb2-77a08a0ffbef service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:35.392135 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da281a-56b6-42ea-9eb2-77a08a0ffbef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:35.401386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da281a-56b6-42ea-9eb2-77a08a0ffbef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:35.403798 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ac2fd2d8-2043-417f-abe1-b9e4debec18a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66fcc0d3af44ad6a9e7e1d47be3848c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.404313 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da281a-56b6-42ea-9eb2-77a08a0ffbef service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:35.404681 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ac2fd2d8-2043-417f-abe1-b9e4debec18a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66fcc0d3af44ad6a9e7e1d47be3848c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.411630 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ac2fd2d8-2043-417f-abe1-b9e4debec18a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66fcc0d3af44ad6a9e7e1d47be3848c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.413850 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1257/2526] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:50:35.427494 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1270/2527] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:35 2022] DELETE /identity/v3/users/b66fcc0d3af44ad6a9e7e1d47be3848c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:35.432088 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccf00f-ceb8-4f75-a177-7fa4ad54eec3 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:35.432553 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccf00f-ceb8-4f75-a177-7fa4ad54eec3 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:35.432829 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccf00f-ceb8-4f75-a177-7fa4ad54eec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:35.452022 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-48ccf00f-ceb8-4f75-a177-7fa4ad54eec3 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:35.453212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-48ccf00f-ceb8-4f75-a177-7fa4ad54eec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:35.514535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1258/2528] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:35.524397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fd2d8-2043-417f-abe1-b9e4debec18a admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:35.525922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ac2fd2d8-2043-417f-abe1-b9e4debec18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:35.584634 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fd2d8-2043-417f-abe1-b9e4debec18a admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:35.588265 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc4038-333a-4817-81b9-4932063f80e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:35.588903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc4038-333a-4817-81b9-4932063f80e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:35.589182 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc4038-333a-4817-81b9-4932063f80e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:35.589452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc4038-333a-4817-81b9-4932063f80e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:35.599421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc4038-333a-4817-81b9-4932063f80e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:35.601303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc4038-333a-4817-81b9-4932063f80e9 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:35.613625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1271/2529] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:35.770653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccf00f-ceb8-4f75-a177-7fa4ad54eec3 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:35.772172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-48ccf00f-ceb8-4f75-a177-7fa4ad54eec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:35.785294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccf00f-ceb8-4f75-a177-7fa4ad54eec3 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:35.800869 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:35.801998 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:35.802279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:35.803215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] PATH_INFO: `/v3/projects/11afdea7f8b94d6b98111fe2969177ba` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:35.805442 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] RBAC: Authorizing `identity:delete_project(project_id=11afdea7f8b94d6b98111fe2969177ba)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:35.807970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:35.887788 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11afdea7f8b94d6b98111fe2969177ba', 'request_id': 'req-872a9e79-98f2-4301-9fb6-54911cdb847d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.897099 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11afdea7f8b94d6b98111fe2969177ba', 'request_id': 'req-872a9e79-98f2-4301-9fb6-54911cdb847d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.904883 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11afdea7f8b94d6b98111fe2969177ba', 'request_id': 'req-872a9e79-98f2-4301-9fb6-54911cdb847d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.916598 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] The token cache is being invalidate because project 11afdea7f8b94d6b98111fe2969177ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:35.917076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.918607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:35.920363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1259/2530] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:35 2022] DELETE /identity/v3/projects/11afdea7f8b94d6b98111fe2969177ba => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:35.924767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc4038-333a-4817-81b9-4932063f80e9 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:35.936426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc4038-333a-4817-81b9-4932063f80e9 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:35.993528 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62807a11-74c8-494e-ba06-3f05779454ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:35.994534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807a11-74c8-494e-ba06-3f05779454ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:35.994846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807a11-74c8-494e-ba06-3f05779454ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:35.995120 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807a11-74c8-494e-ba06-3f05779454ce admin admin] PATH_INFO: `/v3/users/92b0522169594f6fa4169ee1bf911850` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:35.997324 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:35.997815 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62807a11-74c8-494e-ba06-3f05779454ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b0522169594f6fa4169ee1bf911850)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:35.999347 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:35.999586 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62807a11-74c8-494e-ba06-3f05779454ce admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:36.019044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a9e79-98f2-4301-9fb6-54911cdb847d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:36.024627 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:36.025738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:36.026085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:36.026423 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] PATH_INFO: `/v3/projects/1d252f717d76405c9892f4255d48d2e9` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:36.027865 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d252f717d76405c9892f4255d48d2e9)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:36.029987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:36.052012 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-62807a11-74c8-494e-ba06-3f05779454ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b0522169594f6fa4169ee1bf911850'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.052663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-62807a11-74c8-494e-ba06-3f05779454ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b0522169594f6fa4169ee1bf911850'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.066015 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-62807a11-74c8-494e-ba06-3f05779454ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b0522169594f6fa4169ee1bf911850'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.066735 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-62807a11-74c8-494e-ba06-3f05779454ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b0522169594f6fa4169ee1bf911850'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.073352 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-62807a11-74c8-494e-ba06-3f05779454ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b0522169594f6fa4169ee1bf911850'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.078939 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d252f717d76405c9892f4255d48d2e9', 'request_id': 'req-80ec41bf-f12e-4362-b81d-c7b8a201a405'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.086034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1272/2531] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:35 2022] DELETE /identity/v3/users/92b0522169594f6fa4169ee1bf911850 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:36.089138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d252f717d76405c9892f4255d48d2e9', 'request_id': 'req-80ec41bf-f12e-4362-b81d-c7b8a201a405'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.092712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d252f717d76405c9892f4255d48d2e9', 'request_id': 'req-80ec41bf-f12e-4362-b81d-c7b8a201a405'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.104779 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] The token cache is being invalidate because project 1d252f717d76405c9892f4255d48d2e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:36.105069 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.106439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.108226 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1260/2532] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:35 2022] DELETE /identity/v3/projects/1d252f717d76405c9892f4255d48d2e9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:36.112921 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62807a11-74c8-494e-ba06-3f05779454ce admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:36.114815 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-62807a11-74c8-494e-ba06-3f05779454ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:36.185285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62807a11-74c8-494e-ba06-3f05779454ce admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:36.190945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab91ef1-4b4a-4c52-97c5-0a8ba54ae38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:36.192148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab91ef1-4b4a-4c52-97c5-0a8ba54ae38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:36.192510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab91ef1-4b4a-4c52-97c5-0a8ba54ae38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:36.192839 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab91ef1-4b4a-4c52-97c5-0a8ba54ae38e admin admin] PATH_INFO: `/v3/users/51cae3dd394d4c8b8d1274e065e0fb02` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:36.195793 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab91ef1-4b4a-4c52-97c5-0a8ba54ae38e admin admin] RBAC: Authorizing `identity:delete_user(user_id=51cae3dd394d4c8b8d1274e065e0fb02)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:36.197911 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab91ef1-4b4a-4c52-97c5-0a8ba54ae38e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:36.268148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-bab91ef1-4b4a-4c52-97c5-0a8ba54ae38e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51cae3dd394d4c8b8d1274e065e0fb02'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.269115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-bab91ef1-4b4a-4c52-97c5-0a8ba54ae38e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51cae3dd394d4c8b8d1274e065e0fb02'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.283553 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-bab91ef1-4b4a-4c52-97c5-0a8ba54ae38e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51cae3dd394d4c8b8d1274e065e0fb02'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.284283 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-bab91ef1-4b4a-4c52-97c5-0a8ba54ae38e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51cae3dd394d4c8b8d1274e065e0fb02'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.293895 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-bab91ef1-4b4a-4c52-97c5-0a8ba54ae38e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51cae3dd394d4c8b8d1274e065e0fb02'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.309687 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1273/2533] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:36 2022] DELETE /identity/v3/users/51cae3dd394d4c8b8d1274e065e0fb02 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:36.400292 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:36.403062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:36.471618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec41bf-f12e-4362-b81d-c7b8a201a405 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:36.536076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b890a17-7042-4c6b-9900-4d88ee2318a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:36.536968 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b890a17-7042-4c6b-9900-4d88ee2318a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:36.537331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b890a17-7042-4c6b-9900-4d88ee2318a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:36.537506 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b890a17-7042-4c6b-9900-4d88ee2318a8 admin admin] PATH_INFO: `/v3/projects/f79c894f0f5041a694b4318767ebd510` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:36.543409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b890a17-7042-4c6b-9900-4d88ee2318a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79c894f0f5041a694b4318767ebd510)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:36.545351 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b890a17-7042-4c6b-9900-4d88ee2318a8 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:36.606325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1b890a17-7042-4c6b-9900-4d88ee2318a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79c894f0f5041a694b4318767ebd510', 'request_id': 'req-1b890a17-7042-4c6b-9900-4d88ee2318a8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.613711 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab91ef1-4b4a-4c52-97c5-0a8ba54ae38e admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:36.615250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-bab91ef1-4b4a-4c52-97c5-0a8ba54ae38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:36.615778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1b890a17-7042-4c6b-9900-4d88ee2318a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79c894f0f5041a694b4318767ebd510', 'request_id': 'req-1b890a17-7042-4c6b-9900-4d88ee2318a8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.625986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1b890a17-7042-4c6b-9900-4d88ee2318a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79c894f0f5041a694b4318767ebd510', 'request_id': 'req-1b890a17-7042-4c6b-9900-4d88ee2318a8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.637279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1b890a17-7042-4c6b-9900-4d88ee2318a8 admin admin] The token cache is being invalidate because project f79c894f0f5041a694b4318767ebd510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:36.637483 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1b890a17-7042-4c6b-9900-4d88ee2318a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.638117 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-1b890a17-7042-4c6b-9900-4d88ee2318a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.639910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1261/2534] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:36 2022] DELETE /identity/v3/projects/f79c894f0f5041a694b4318767ebd510 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:36.641906 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab91ef1-4b4a-4c52-97c5-0a8ba54ae38e admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:36.644835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d97eb1-5400-40c7-8d91-da99696b3dab None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:36.645190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d97eb1-5400-40c7-8d91-da99696b3dab None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:36.645388 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d97eb1-5400-40c7-8d91-da99696b3dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:36.669004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-91d97eb1-5400-40c7-8d91-da99696b3dab None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:36.670618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-91d97eb1-5400-40c7-8d91-da99696b3dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:36.716155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0c85e-443f-484c-845a-c4223fab096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:36.717015 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0c85e-443f-484c-845a-c4223fab096e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:36.717453 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0c85e-443f-484c-845a-c4223fab096e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:36.717733 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0c85e-443f-484c-845a-c4223fab096e admin admin] PATH_INFO: `/v3/projects/255cc12ee5104adf9a8aef83603ec500` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:36.719072 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0c85e-443f-484c-845a-c4223fab096e admin admin] RBAC: Authorizing `identity:delete_project(project_id=255cc12ee5104adf9a8aef83603ec500)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:36.720984 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0c85e-443f-484c-845a-c4223fab096e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:36.753231 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1262/2535] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:36.762089 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5a1ae-bc54-4d46-a0b0-d09547f0adf9 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:36.762450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5a1ae-bc54-4d46-a0b0-d09547f0adf9 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:36.763686 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5a1ae-bc54-4d46-a0b0-d09547f0adf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:36.785807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a1e0c85e-443f-484c-845a-c4223fab096e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '255cc12ee5104adf9a8aef83603ec500', 'request_id': 'req-a1e0c85e-443f-484c-845a-c4223fab096e'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.785935 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-47d5a1ae-bc54-4d46-a0b0-d09547f0adf9 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:36.786863 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-47d5a1ae-bc54-4d46-a0b0-d09547f0adf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:36.795181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a1e0c85e-443f-484c-845a-c4223fab096e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '255cc12ee5104adf9a8aef83603ec500', 'request_id': 'req-a1e0c85e-443f-484c-845a-c4223fab096e'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.803135 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a1e0c85e-443f-484c-845a-c4223fab096e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '255cc12ee5104adf9a8aef83603ec500', 'request_id': 'req-a1e0c85e-443f-484c-845a-c4223fab096e'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.816444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a1e0c85e-443f-484c-845a-c4223fab096e admin admin] The token cache is being invalidate because project 255cc12ee5104adf9a8aef83603ec500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:36.816810 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a1e0c85e-443f-484c-845a-c4223fab096e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.817604 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a1e0c85e-443f-484c-845a-c4223fab096e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:36.819513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1274/2536] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:36 2022] DELETE /identity/v3/projects/255cc12ee5104adf9a8aef83603ec500 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:36.824009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e4427-3a08-4506-97c5-efd3a8561e33 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:36.825063 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e4427-3a08-4506-97c5-efd3a8561e33 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:36.825444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e4427-3a08-4506-97c5-efd3a8561e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:36.845994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-791e4427-3a08-4506-97c5-efd3a8561e33 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:36.847280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-791e4427-3a08-4506-97c5-efd3a8561e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:36.861812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1263/2537] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:36.866029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5a1ae-bc54-4d46-a0b0-d09547f0adf9 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:36.877149 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5a1ae-bc54-4d46-a0b0-d09547f0adf9 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:36.885926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745c585-ff14-455d-8fd0-f3067671e542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:36.886645 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745c585-ff14-455d-8fd0-f3067671e542 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:36.886959 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745c585-ff14-455d-8fd0-f3067671e542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:36.888003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745c585-ff14-455d-8fd0-f3067671e542 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:36.888003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745c585-ff14-455d-8fd0-f3067671e542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:36.888300 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745c585-ff14-455d-8fd0-f3067671e542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:36.890036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745c585-ff14-455d-8fd0-f3067671e542 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:36.906531 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1264/2538] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:50:36.911274 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745c585-ff14-455d-8fd0-f3067671e542 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:36.911652 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1275/2539] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:36.920106 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b72c0-5513-4a4a-9fce-392ca378f711 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:36.924576 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b72c0-5513-4a4a-9fce-392ca378f711 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:36.924867 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b72c0-5513-4a4a-9fce-392ca378f711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:36.934343 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745c585-ff14-455d-8fd0-f3067671e542 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:36.940154 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5f4d7-08bf-4745-9a93-282e07a5f546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:36.940887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5f4d7-08bf-4745-9a93-282e07a5f546 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:36.941086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5f4d7-08bf-4745-9a93-282e07a5f546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:36.941362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5f4d7-08bf-4745-9a93-282e07a5f546 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:36.942057 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5f4d7-08bf-4745-9a93-282e07a5f546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:36.944318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5f4d7-08bf-4745-9a93-282e07a5f546 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:36.960483 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-688b72c0-5513-4a4a-9fce-392ca378f711 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:36.962541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-688b72c0-5513-4a4a-9fce-392ca378f711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:36.973976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1276/2540] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:36.977938 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b72c0-5513-4a4a-9fce-392ca378f711 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:36.986590 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1265/2541] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:36 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:36.987678 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5f4d7-08bf-4745-9a93-282e07a5f546 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:36.988876 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b72c0-5513-4a4a-9fce-392ca378f711 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.047990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b5f04-8342-47d2-83c3-b55ada30d10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.048650 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b5f04-8342-47d2-83c3-b55ada30d10b admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.048925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b5f04-8342-47d2-83c3-b55ada30d10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.049445 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b5f04-8342-47d2-83c3-b55ada30d10b admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.049909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b5f04-8342-47d2-83c3-b55ada30d10b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:37.050214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b5f04-8342-47d2-83c3-b55ada30d10b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.051865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b5f04-8342-47d2-83c3-b55ada30d10b admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.062133 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5f4d7-08bf-4745-9a93-282e07a5f546 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.067183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1277/2542] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:50:37.067320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259b2e5-d548-4b35-aff7-7443a64eee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.067463 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259b2e5-d548-4b35-aff7-7443a64eee72 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.067752 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259b2e5-d548-4b35-aff7-7443a64eee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.068028 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259b2e5-d548-4b35-aff7-7443a64eee72 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.068603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b5f04-8342-47d2-83c3-b55ada30d10b admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.068763 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259b2e5-d548-4b35-aff7-7443a64eee72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.070626 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259b2e5-d548-4b35-aff7-7443a64eee72 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.078305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b5f04-8342-47d2-83c3-b55ada30d10b admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.083129 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e2e00-2b5f-436d-9162-8ba8ed799ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.083763 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e2e00-2b5f-436d-9162-8ba8ed799ced admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.084040 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e2e00-2b5f-436d-9162-8ba8ed799ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.084315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e2e00-2b5f-436d-9162-8ba8ed799ced admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.084997 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e2e00-2b5f-436d-9162-8ba8ed799ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.086890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e2e00-2b5f-436d-9162-8ba8ed799ced admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.095324 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1266/2543] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:36 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:37.096362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259b2e5-d548-4b35-aff7-7443a64eee72 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.107041 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259b2e5-d548-4b35-aff7-7443a64eee72 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.112102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d940760-670a-4160-939c-11cfdfc91063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.112751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d940760-670a-4160-939c-11cfdfc91063 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.113040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d940760-670a-4160-939c-11cfdfc91063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.113319 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d940760-670a-4160-939c-11cfdfc91063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.114035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d940760-670a-4160-939c-11cfdfc91063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.118487 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1278/2544] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:37 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:37.118649 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d940760-670a-4160-939c-11cfdfc91063 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.119438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e2e00-2b5f-436d-9162-8ba8ed799ced admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.126270 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1267/2545] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:37.129916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d940760-670a-4160-939c-11cfdfc91063 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.139172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d940760-670a-4160-939c-11cfdfc91063 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.184214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e2e00-2b5f-436d-9162-8ba8ed799ced admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.188951 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f05a8-0e89-4b38-9c41-5332389f5d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.189641 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f05a8-0e89-4b38-9c41-5332389f5d0c admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.189943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f05a8-0e89-4b38-9c41-5332389f5d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.190211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f05a8-0e89-4b38-9c41-5332389f5d0c admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.190915 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f05a8-0e89-4b38-9c41-5332389f5d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.192832 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f05a8-0e89-4b38-9c41-5332389f5d0c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.195623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38aebf-3d39-41d3-bc79-fa8ee9c5fa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.196362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38aebf-3d39-41d3-bc79-fa8ee9c5fa84 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.196719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38aebf-3d39-41d3-bc79-fa8ee9c5fa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.197062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38aebf-3d39-41d3-bc79-fa8ee9c5fa84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.197859 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38aebf-3d39-41d3-bc79-fa8ee9c5fa84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.200753 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38aebf-3d39-41d3-bc79-fa8ee9c5fa84 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.215977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1279/2546] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:37 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:37.216361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1268/2547] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:37.217629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f05a8-0e89-4b38-9c41-5332389f5d0c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.218719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38aebf-3d39-41d3-bc79-fa8ee9c5fa84 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.228716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38aebf-3d39-41d3-bc79-fa8ee9c5fa84 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.229237 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f05a8-0e89-4b38-9c41-5332389f5d0c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.234013 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda572-7957-4f70-8f5c-4b1782d19c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.234303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f74df9-7c0f-4f9e-8cc0-febfcedcb1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.234716 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda572-7957-4f70-8f5c-4b1782d19c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.234997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda572-7957-4f70-8f5c-4b1782d19c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.235264 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f74df9-7c0f-4f9e-8cc0-febfcedcb1c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.235387 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda572-7957-4f70-8f5c-4b1782d19c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.235670 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f74df9-7c0f-4f9e-8cc0-febfcedcb1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.235977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abda572-7957-4f70-8f5c-4b1782d19c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.236084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f74df9-7c0f-4f9e-8cc0-febfcedcb1c3 admin admin] PATH_INFO: `/v3/projects/4e88bed0848d4e82a4dc5caa4ea3a870/users/58bd40845c524620bc368e5c28b0df9d/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.237803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abda572-7957-4f70-8f5c-4b1782d19c09 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.252398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1269/2548] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:37.253500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda572-7957-4f70-8f5c-4b1782d19c09 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.257926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f74df9-7c0f-4f9e-8cc0-febfcedcb1c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e88bed0848d4e82a4dc5caa4ea3a870, user_id=58bd40845c524620bc368e5c28b0df9d, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.260743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f74df9-7c0f-4f9e-8cc0-febfcedcb1c3 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.264867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda572-7957-4f70-8f5c-4b1782d19c09 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.270818 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cab1e6-3863-4128-8bf3-c80e7294d3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.271541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cab1e6-3863-4128-8bf3-c80e7294d3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.271823 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cab1e6-3863-4128-8bf3-c80e7294d3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.272098 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cab1e6-3863-4128-8bf3-c80e7294d3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.273042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cab1e6-3863-4128-8bf3-c80e7294d3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.275371 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cab1e6-3863-4128-8bf3-c80e7294d3e2 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.279219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1280/2549] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:37 2022] PUT /identity/v3/projects/4e88bed0848d4e82a4dc5caa4ea3a870/users/58bd40845c524620bc368e5c28b0df9d/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:37.287440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1270/2550] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:37.291738 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cab1e6-3863-4128-8bf3-c80e7294d3e2 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.292312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90b481-8e82-466b-b5fd-39a8fcb7dce6 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.292604 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90b481-8e82-466b-b5fd-39a8fcb7dce6 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.293084 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90b481-8e82-466b-b5fd-39a8fcb7dce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.304688 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cab1e6-3863-4128-8bf3-c80e7294d3e2 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.323003 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-6d90b481-8e82-466b-b5fd-39a8fcb7dce6 None None] MFA Rules not processed for user `58bd40845c524620bc368e5c28b0df9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:37.324963 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-6d90b481-8e82-466b-b5fd-39a8fcb7dce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:37.368953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8e625-e147-460d-9775-8b3ee8ea82dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.369848 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e625-e147-460d-9775-8b3ee8ea82dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.370127 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e625-e147-460d-9775-8b3ee8ea82dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.370427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e625-e147-460d-9775-8b3ee8ea82dc admin admin] PATH_INFO: `/v3/projects/db74614018fb44fb9e4e8a3c1e0d0af0/users/2d5478b1fb9c4261a10fb1b8e1a47eee/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.386407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8e625-e147-460d-9775-8b3ee8ea82dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=db74614018fb44fb9e4e8a3c1e0d0af0, user_id=2d5478b1fb9c4261a10fb1b8e1a47eee, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.389675 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8e625-e147-460d-9775-8b3ee8ea82dc admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.396021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1281/2551] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:37.401805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90b481-8e82-466b-b5fd-39a8fcb7dce6 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.404836 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1271/2552] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:37 2022] PUT /identity/v3/projects/db74614018fb44fb9e4e8a3c1e0d0af0/users/2d5478b1fb9c4261a10fb1b8e1a47eee/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:37.415371 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90b481-8e82-466b-b5fd-39a8fcb7dce6 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.416075 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7828ff-1a5c-42fd-8a58-826a1311ef4f None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.416372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7828ff-1a5c-42fd-8a58-826a1311ef4f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.416650 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7828ff-1a5c-42fd-8a58-826a1311ef4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.443985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-bc7828ff-1a5c-42fd-8a58-826a1311ef4f None None] MFA Rules not processed for user `2d5478b1fb9c4261a10fb1b8e1a47eee`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:37.445331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-bc7828ff-1a5c-42fd-8a58-826a1311ef4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:37.475483 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d97808-9760-466b-a975-e087908b8aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.476038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d97808-9760-466b-a975-e087908b8aca admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.476323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d97808-9760-466b-a975-e087908b8aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.476633 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d97808-9760-466b-a975-e087908b8aca admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.477325 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d97808-9760-466b-a975-e087908b8aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.479270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d97808-9760-466b-a975-e087908b8aca admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.505365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1282/2553] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:37 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:37.509285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d97808-9760-466b-a975-e087908b8aca admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.509873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1272/2554] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:37.514390 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7828ff-1a5c-42fd-8a58-826a1311ef4f None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.524750 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7828ff-1a5c-42fd-8a58-826a1311ef4f None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.569539 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d97808-9760-466b-a975-e087908b8aca admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.574219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d3df4-8293-419d-a845-827adc7d300e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.574952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d3df4-8293-419d-a845-827adc7d300e admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.575228 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d3df4-8293-419d-a845-827adc7d300e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.575499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d3df4-8293-419d-a845-827adc7d300e admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.576174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d3df4-8293-419d-a845-827adc7d300e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.578081 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d3df4-8293-419d-a845-827adc7d300e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.579450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf2c92-c1dc-4774-a955-77e1e0e84770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.580102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2c92-c1dc-4774-a955-77e1e0e84770 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.580383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2c92-c1dc-4774-a955-77e1e0e84770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.580657 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2c92-c1dc-4774-a955-77e1e0e84770 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.581341 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf2c92-c1dc-4774-a955-77e1e0e84770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.583255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf2c92-c1dc-4774-a955-77e1e0e84770 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.598842 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1283/2555] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:37 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:37.603169 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d3df4-8293-419d-a845-827adc7d300e admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.608527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1273/2556] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:37 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:37.612342 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf2c92-c1dc-4774-a955-77e1e0e84770 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.614714 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d3df4-8293-419d-a845-827adc7d300e admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.680973 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf2c92-c1dc-4774-a955-77e1e0e84770 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.686451 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd352e69-1e3c-4821-bc88-b239a014f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.687329 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd352e69-1e3c-4821-bc88-b239a014f4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.687686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb943523-3aed-4a15-8d24-2e0b4a4024e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.687846 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd352e69-1e3c-4821-bc88-b239a014f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.688203 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd352e69-1e3c-4821-bc88-b239a014f4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.688344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb943523-3aed-4a15-8d24-2e0b4a4024e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.688618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb943523-3aed-4a15-8d24-2e0b4a4024e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.688893 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb943523-3aed-4a15-8d24-2e0b4a4024e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.689269 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd352e69-1e3c-4821-bc88-b239a014f4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.689618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb943523-3aed-4a15-8d24-2e0b4a4024e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.691238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb943523-3aed-4a15-8d24-2e0b4a4024e8 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.691551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd352e69-1e3c-4821-bc88-b239a014f4c1 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.702023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1284/2557] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:37.706449 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb943523-3aed-4a15-8d24-2e0b4a4024e8 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.714202 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1274/2558] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:37 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:37.718442 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd352e69-1e3c-4821-bc88-b239a014f4c1 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.719925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb943523-3aed-4a15-8d24-2e0b4a4024e8 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.724860 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85078ab4-679d-4de5-8438-c5f16ed7c82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.725824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078ab4-679d-4de5-8438-c5f16ed7c82a admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.726039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078ab4-679d-4de5-8438-c5f16ed7c82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.726315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078ab4-679d-4de5-8438-c5f16ed7c82a admin admin] PATH_INFO: `/v3/projects/a37a18586b034059ba8c6e21d7519518/users/ae4048d8b7ff4d6bab94050ab9d4c170/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.729985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd352e69-1e3c-4821-bc88-b239a014f4c1 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.735268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff4b62-0516-4a89-81cf-b4d129ca1382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.735927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff4b62-0516-4a89-81cf-b4d129ca1382 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.736245 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff4b62-0516-4a89-81cf-b4d129ca1382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.736521 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff4b62-0516-4a89-81cf-b4d129ca1382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.737249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff4b62-0516-4a89-81cf-b4d129ca1382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.739036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff4b62-0516-4a89-81cf-b4d129ca1382 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.743027 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85078ab4-679d-4de5-8438-c5f16ed7c82a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a37a18586b034059ba8c6e21d7519518, user_id=ae4048d8b7ff4d6bab94050ab9d4c170, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.745955 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85078ab4-679d-4de5-8438-c5f16ed7c82a admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.751905 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1275/2559] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:37.755005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff4b62-0516-4a89-81cf-b4d129ca1382 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.768230 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff4b62-0516-4a89-81cf-b4d129ca1382 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.768373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1285/2560] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:37 2022] PUT /identity/v3/projects/a37a18586b034059ba8c6e21d7519518/users/ae4048d8b7ff4d6bab94050ab9d4c170/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:37.772516 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85078ab4-679d-4de5-8438-c5f16ed7c82a admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.853521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85078ab4-679d-4de5-8438-c5f16ed7c82a admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.864159 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c69f0f-f964-4a54-bc20-4c63267fcd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.865011 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c69f0f-f964-4a54-bc20-4c63267fcd10 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.865395 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c69f0f-f964-4a54-bc20-4c63267fcd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.865598 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486df6c3-3c04-4ba0-bbab-a9ff3b16cd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.865898 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c69f0f-f964-4a54-bc20-4c63267fcd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.866714 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486df6c3-3c04-4ba0-bbab-a9ff3b16cd3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.867002 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486df6c3-3c04-4ba0-bbab-a9ff3b16cd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.867281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486df6c3-3c04-4ba0-bbab-a9ff3b16cd3c admin admin] PATH_INFO: `/v3/projects/15775cbd595942fb903a046a267e9588/users/22dd56d219bd44459a2e6371278f9d5f/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.867507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c69f0f-f964-4a54-bc20-4c63267fcd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.870383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c69f0f-f964-4a54-bc20-4c63267fcd10 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.889964 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1286/2561] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:37.891097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c69f0f-f964-4a54-bc20-4c63267fcd10 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.897641 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486df6c3-3c04-4ba0-bbab-a9ff3b16cd3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=15775cbd595942fb903a046a267e9588, user_id=22dd56d219bd44459a2e6371278f9d5f, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.902783 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486df6c3-3c04-4ba0-bbab-a9ff3b16cd3c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.903239 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c69f0f-f964-4a54-bc20-4c63267fcd10 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:37.909915 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b73660-5da8-4bdc-bfbb-3aca1eebdf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:37.911187 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b73660-5da8-4bdc-bfbb-3aca1eebdf6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.911637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b73660-5da8-4bdc-bfbb-3aca1eebdf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.912095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b73660-5da8-4bdc-bfbb-3aca1eebdf6c admin admin] PATH_INFO: `/v3/projects/a37a18586b034059ba8c6e21d7519518/users/ae4048d8b7ff4d6bab94050ab9d4c170/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.914744 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b73660-5da8-4bdc-bfbb-3aca1eebdf6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a37a18586b034059ba8c6e21d7519518, user_id=ae4048d8b7ff4d6bab94050ab9d4c170, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:37.918376 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b73660-5da8-4bdc-bfbb-3aca1eebdf6c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:37.924002 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1276/2562] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:37 2022] PUT /identity/v3/projects/15775cbd595942fb903a046a267e9588/users/22dd56d219bd44459a2e6371278f9d5f/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:37.928708 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486df6c3-3c04-4ba0-bbab-a9ff3b16cd3c admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:37.934743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1287/2563] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:37 2022] PUT /identity/v3/projects/a37a18586b034059ba8c6e21d7519518/users/ae4048d8b7ff4d6bab94050ab9d4c170/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:37.948133 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144430a5-096a-4260-9036-aee37f7d775b None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:37.948444 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144430a5-096a-4260-9036-aee37f7d775b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:37.948694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144430a5-096a-4260-9036-aee37f7d775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:37.982318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-144430a5-096a-4260-9036-aee37f7d775b None None] MFA Rules not processed for user `ae4048d8b7ff4d6bab94050ab9d4c170`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:37.983478 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-144430a5-096a-4260-9036-aee37f7d775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:38.006662 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486df6c3-3c04-4ba0-bbab-a9ff3b16cd3c admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:38.080294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf81c-dbc5-413b-a970-3a0f0c44f500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:38.081693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf81c-dbc5-413b-a970-3a0f0c44f500 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:38.082143 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf81c-dbc5-413b-a970-3a0f0c44f500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:38.082527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf81c-dbc5-413b-a970-3a0f0c44f500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:38.083687 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badf81c-dbc5-413b-a970-3a0f0c44f500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:38.086565 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badf81c-dbc5-413b-a970-3a0f0c44f500 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:38.099033 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1277/2564] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:38.101082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1288/2565] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:38.104661 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf81c-dbc5-413b-a970-3a0f0c44f500 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:38.113514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144430a5-096a-4260-9036-aee37f7d775b None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:38.115204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-144430a5-096a-4260-9036-aee37f7d775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:38.119998 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf81c-dbc5-413b-a970-3a0f0c44f500 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:38.129115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0ae71-b5be-408b-ae58-5639374a3991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:38.131681 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0ae71-b5be-408b-ae58-5639374a3991 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:38.133522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0ae71-b5be-408b-ae58-5639374a3991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:38.133910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0ae71-b5be-408b-ae58-5639374a3991 admin admin] PATH_INFO: `/v3/projects/15775cbd595942fb903a046a267e9588/users/22dd56d219bd44459a2e6371278f9d5f/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:38.140630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0ae71-b5be-408b-ae58-5639374a3991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15775cbd595942fb903a046a267e9588, user_id=22dd56d219bd44459a2e6371278f9d5f, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:38.142209 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0ae71-b5be-408b-ae58-5639374a3991 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:38.158711 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1278/2566] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:38 2022] PUT /identity/v3/projects/15775cbd595942fb903a046a267e9588/users/22dd56d219bd44459a2e6371278f9d5f/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:38.166508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71239f4e-9489-4c8b-828a-af038486cb93 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:38.166508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71239f4e-9489-4c8b-828a-af038486cb93 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:38.166508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71239f4e-9489-4c8b-828a-af038486cb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:38.204203 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-71239f4e-9489-4c8b-828a-af038486cb93 None None] MFA Rules not processed for user `22dd56d219bd44459a2e6371278f9d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:38.205432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-71239f4e-9489-4c8b-828a-af038486cb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:38.265008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144430a5-096a-4260-9036-aee37f7d775b None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:38.302308 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1279/2567] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:38.313634 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71239f4e-9489-4c8b-828a-af038486cb93 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:38.315415 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-71239f4e-9489-4c8b-828a-af038486cb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:38.331818 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe9790-e711-44f2-ac8f-2933e50d6e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:38.332468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe9790-e711-44f2-ac8f-2933e50d6e6c service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:38.332773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe9790-e711-44f2-ac8f-2933e50d6e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:38.333181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe9790-e711-44f2-ac8f-2933e50d6e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:38.391385 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe9790-e711-44f2-ac8f-2933e50d6e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:38.392883 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71239f4e-9489-4c8b-828a-af038486cb93 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:38.393920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe9790-e711-44f2-ac8f-2933e50d6e6c service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:38.396728 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a896052-402e-4b0f-b794-fcaf48605802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:38.397418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a896052-402e-4b0f-b794-fcaf48605802 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:38.397704 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a896052-402e-4b0f-b794-fcaf48605802 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:38.397982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a896052-402e-4b0f-b794-fcaf48605802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:38.407940 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1289/2568] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:50:38.409386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a896052-402e-4b0f-b794-fcaf48605802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:38.410879 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a896052-402e-4b0f-b794-fcaf48605802 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:38.424876 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1280/2569] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:50:38.472289 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe9790-e711-44f2-ac8f-2933e50d6e6c service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:38.481242 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe9790-e711-44f2-ac8f-2933e50d6e6c service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:38.487365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb406cdd-5217-491b-b995-61f773055fc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:38.488139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb406cdd-5217-491b-b995-61f773055fc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:38.488523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb406cdd-5217-491b-b995-61f773055fc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:38.489066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb406cdd-5217-491b-b995-61f773055fc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:38.556121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb406cdd-5217-491b-b995-61f773055fc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:38.557804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb406cdd-5217-491b-b995-61f773055fc2 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:38.567332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1290/2570] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:40.200302 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a896052-402e-4b0f-b794-fcaf48605802 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:40.202761 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2a896052-402e-4b0f-b794-fcaf48605802 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:40.294248 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a896052-402e-4b0f-b794-fcaf48605802 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:40.300267 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbed44-2c58-49f1-96a5-51b6359c6f0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01fa037b14c456eb533b5a86da0a370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:40.301051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbed44-2c58-49f1-96a5-51b6359c6f0c service placement] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:40.301336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbed44-2c58-49f1-96a5-51b6359c6f0c service placement] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:40.301661 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbed44-2c58-49f1-96a5-51b6359c6f0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:40.303780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b6cbed44-2c58-49f1-96a5-51b6359c6f0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:40.320244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbed44-2c58-49f1-96a5-51b6359c6f0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:40.322252 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbed44-2c58-49f1-96a5-51b6359c6f0c service placement] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:40.335516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1281/2571] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:40.934076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb406cdd-5217-491b-b995-61f773055fc2 service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:40.936186 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-eb406cdd-5217-491b-b995-61f773055fc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:40.987614 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbed44-2c58-49f1-96a5-51b6359c6f0c service placement] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:41.013358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb406cdd-5217-491b-b995-61f773055fc2 service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:41.018175 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745e2ad-bea0-4415-989c-2b31b71bf557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:41.018866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745e2ad-bea0-4415-989c-2b31b71bf557 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:41.019157 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745e2ad-bea0-4415-989c-2b31b71bf557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:41.019418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745e2ad-bea0-4415-989c-2b31b71bf557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:41.021198 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e745e2ad-bea0-4415-989c-2b31b71bf557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:41.063622 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbed44-2c58-49f1-96a5-51b6359c6f0c service placement] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:41.069140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40effa55-dac9-4dc4-bac0-b17495402799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:41.070112 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40effa55-dac9-4dc4-bac0-b17495402799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:41.070401 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40effa55-dac9-4dc4-bac0-b17495402799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:41.070754 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40effa55-dac9-4dc4-bac0-b17495402799 admin admin] PATH_INFO: `/v3/users/58bd40845c524620bc368e5c28b0df9d` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:41.072212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40effa55-dac9-4dc4-bac0-b17495402799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58bd40845c524620bc368e5c28b0df9d)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:41.074470 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40effa55-dac9-4dc4-bac0-b17495402799 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:41.110824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745e2ad-bea0-4415-989c-2b31b71bf557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:41.112829 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745e2ad-bea0-4415-989c-2b31b71bf557 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:41.125233 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1291/2572] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:41.130385 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-40effa55-dac9-4dc4-bac0-b17495402799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58bd40845c524620bc368e5c28b0df9d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:41.131060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-40effa55-dac9-4dc4-bac0-b17495402799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58bd40845c524620bc368e5c28b0df9d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:41.131664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-40effa55-dac9-4dc4-bac0-b17495402799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58bd40845c524620bc368e5c28b0df9d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:41.148530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-40effa55-dac9-4dc4-bac0-b17495402799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58bd40845c524620bc368e5c28b0df9d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:41.160464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-40effa55-dac9-4dc4-bac0-b17495402799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58bd40845c524620bc368e5c28b0df9d'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:41.175246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1282/2573] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:40 2022] DELETE /identity/v3/users/58bd40845c524620bc368e5c28b0df9d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:41.180318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985954a-6192-4703-b0d8-b48c5aab9241 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:41.180609 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985954a-6192-4703-b0d8-b48c5aab9241 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:41.180886 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985954a-6192-4703-b0d8-b48c5aab9241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:41.200357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-4985954a-6192-4703-b0d8-b48c5aab9241 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:41.202915 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4985954a-6192-4703-b0d8-b48c5aab9241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:41.271181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1292/2574] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:41.282239 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40effa55-dac9-4dc4-bac0-b17495402799 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:41.283777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-40effa55-dac9-4dc4-bac0-b17495402799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:41.343586 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40effa55-dac9-4dc4-bac0-b17495402799 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:41.347327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e996-1650-4ace-8b3c-c7f3d8fdb792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:41.347981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e996-1650-4ace-8b3c-c7f3d8fdb792 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:41.348260 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e996-1650-4ace-8b3c-c7f3d8fdb792 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:41.348535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e996-1650-4ace-8b3c-c7f3d8fdb792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:41.358337 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58e996-1650-4ace-8b3c-c7f3d8fdb792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:41.359823 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58e996-1650-4ace-8b3c-c7f3d8fdb792 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:41.369706 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1283/2575] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:41.694864 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985954a-6192-4703-b0d8-b48c5aab9241 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:41.696311 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4985954a-6192-4703-b0d8-b48c5aab9241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:41.715734 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985954a-6192-4703-b0d8-b48c5aab9241 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:41.726519 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:41.727268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:41.727943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:41.728357 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] PATH_INFO: `/v3/projects/4e88bed0848d4e82a4dc5caa4ea3a870` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:41.730702 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e88bed0848d4e82a4dc5caa4ea3a870)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:41.732922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:41.794047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e88bed0848d4e82a4dc5caa4ea3a870', 'request_id': 'req-882a28b1-c236-4885-a04e-cf4bbe65cc46'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:41.806408 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e88bed0848d4e82a4dc5caa4ea3a870', 'request_id': 'req-882a28b1-c236-4885-a04e-cf4bbe65cc46'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:41.813363 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e88bed0848d4e82a4dc5caa4ea3a870', 'request_id': 'req-882a28b1-c236-4885-a04e-cf4bbe65cc46'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:41.828092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] The token cache is being invalidate because project 4e88bed0848d4e82a4dc5caa4ea3a870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:41.828429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:41.829185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:41.834772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1293/2576] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:41 2022] DELETE /identity/v3/projects/4e88bed0848d4e82a4dc5caa4ea3a870 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:41.838758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e996-1650-4ace-8b3c-c7f3d8fdb792 service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:41.850875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e996-1650-4ace-8b3c-c7f3d8fdb792 service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:41.927331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d019eb-47c3-4178-a96d-8efc34ddc70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:41.929162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d019eb-47c3-4178-a96d-8efc34ddc70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:41.929636 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d019eb-47c3-4178-a96d-8efc34ddc70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:41.930118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d019eb-47c3-4178-a96d-8efc34ddc70f admin admin] PATH_INFO: `/v3/users/ae4048d8b7ff4d6bab94050ab9d4c170` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:41.931658 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d019eb-47c3-4178-a96d-8efc34ddc70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4048d8b7ff4d6bab94050ab9d4c170)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:41.934749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d019eb-47c3-4178-a96d-8efc34ddc70f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:41.997400 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-88d019eb-47c3-4178-a96d-8efc34ddc70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4048d8b7ff4d6bab94050ab9d4c170'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:41.998097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-88d019eb-47c3-4178-a96d-8efc34ddc70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4048d8b7ff4d6bab94050ab9d4c170'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:41.998832 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-88d019eb-47c3-4178-a96d-8efc34ddc70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4048d8b7ff4d6bab94050ab9d4c170'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:42.017688 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-88d019eb-47c3-4178-a96d-8efc34ddc70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4048d8b7ff4d6bab94050ab9d4c170'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:42.025647 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-88d019eb-47c3-4178-a96d-8efc34ddc70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4048d8b7ff4d6bab94050ab9d4c170'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:42.043118 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1284/2577] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:41 2022] DELETE /identity/v3/users/ae4048d8b7ff4d6bab94050ab9d4c170 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:42.093266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:42.094813 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:42.112046 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a28b1-c236-4885-a04e-cf4bbe65cc46 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:42.178343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b6ccf-fd8d-4b00-9772-cb02f98b47fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:42.179253 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b6ccf-fd8d-4b00-9772-cb02f98b47fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:42.179534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b6ccf-fd8d-4b00-9772-cb02f98b47fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:42.179809 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b6ccf-fd8d-4b00-9772-cb02f98b47fc admin admin] PATH_INFO: `/v3/users/2d5478b1fb9c4261a10fb1b8e1a47eee` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:42.181028 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b6ccf-fd8d-4b00-9772-cb02f98b47fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5478b1fb9c4261a10fb1b8e1a47eee)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:42.182988 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b6ccf-fd8d-4b00-9772-cb02f98b47fc admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:42.248735 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ec3b6ccf-fd8d-4b00-9772-cb02f98b47fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5478b1fb9c4261a10fb1b8e1a47eee'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:42.249691 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ec3b6ccf-fd8d-4b00-9772-cb02f98b47fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5478b1fb9c4261a10fb1b8e1a47eee'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:42.289193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ec3b6ccf-fd8d-4b00-9772-cb02f98b47fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5478b1fb9c4261a10fb1b8e1a47eee'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:42.289193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ec3b6ccf-fd8d-4b00-9772-cb02f98b47fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5478b1fb9c4261a10fb1b8e1a47eee'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:42.296541 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ec3b6ccf-fd8d-4b00-9772-cb02f98b47fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5478b1fb9c4261a10fb1b8e1a47eee'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:42.314605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1294/2578] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:42 2022] DELETE /identity/v3/users/2d5478b1fb9c4261a10fb1b8e1a47eee => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:42.318979 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf09aae-78a4-4146-b011-63156875212c None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:42.319822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf09aae-78a4-4146-b011-63156875212c None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:42.320266 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf09aae-78a4-4146-b011-63156875212c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:42.344831 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-5cf09aae-78a4-4146-b011-63156875212c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:42.346965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-5cf09aae-78a4-4146-b011-63156875212c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:42.441301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1285/2579] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:42.455396 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b6ccf-fd8d-4b00-9772-cb02f98b47fc admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:42.456895 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ec3b6ccf-fd8d-4b00-9772-cb02f98b47fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:42.536484 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b6ccf-fd8d-4b00-9772-cb02f98b47fc admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:42.541359 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee5a14-d87d-4d09-b7d1-a6a0e58a21b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:42.542226 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee5a14-d87d-4d09-b7d1-a6a0e58a21b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:42.542535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee5a14-d87d-4d09-b7d1-a6a0e58a21b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:42.545587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee5a14-d87d-4d09-b7d1-a6a0e58a21b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:42.556163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee5a14-d87d-4d09-b7d1-a6a0e58a21b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:42.557924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee5a14-d87d-4d09-b7d1-a6a0e58a21b7 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:42.584286 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1295/2580] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:42.600720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf09aae-78a4-4146-b011-63156875212c None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:42.602309 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-5cf09aae-78a4-4146-b011-63156875212c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:42.619396 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf09aae-78a4-4146-b011-63156875212c None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:42.630807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:42.631713 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:42.632126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:42.632440 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] PATH_INFO: `/v3/projects/a37a18586b034059ba8c6e21d7519518` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:42.633800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a37a18586b034059ba8c6e21d7519518)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:42.636061 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:42.710216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a37a18586b034059ba8c6e21d7519518', 'request_id': 'req-db304d95-7d0e-4baa-9eee-b3497c8728ea'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:42.719419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a37a18586b034059ba8c6e21d7519518', 'request_id': 'req-db304d95-7d0e-4baa-9eee-b3497c8728ea'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:42.727051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a37a18586b034059ba8c6e21d7519518', 'request_id': 'req-db304d95-7d0e-4baa-9eee-b3497c8728ea'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:42.749556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] The token cache is being invalidate because project a37a18586b034059ba8c6e21d7519518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:42.750894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:42.759625 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:42.764082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1286/2581] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:42 2022] DELETE /identity/v3/projects/a37a18586b034059ba8c6e21d7519518 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:42.769379 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6837fd7-f640-44d9-a530-73d75567399b None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:42.770002 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6837fd7-f640-44d9-a530-73d75567399b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:42.770452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6837fd7-f640-44d9-a530-73d75567399b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:42.796409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-e6837fd7-f640-44d9-a530-73d75567399b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:42.797605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e6837fd7-f640-44d9-a530-73d75567399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:42.891857 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:42.898416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1296/2582] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:42.899875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:42.904115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbd997-a6b2-470c-9f6a-e4905f075dce None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:42.904443 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbd997-a6b2-470c-9f6a-e4905f075dce None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:42.904685 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbd997-a6b2-470c-9f6a-e4905f075dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:42.925714 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-68dbd997-a6b2-470c-9f6a-e4905f075dce None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:42.926509 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-68dbd997-a6b2-470c-9f6a-e4905f075dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:42.928854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db304d95-7d0e-4baa-9eee-b3497c8728ea admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:42.935226 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:42.936496 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:42.936775 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:42.937047 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] PATH_INFO: `/v3/projects/db74614018fb44fb9e4e8a3c1e0d0af0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:42.937781 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1297/2583] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:42.938988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db74614018fb44fb9e4e8a3c1e0d0af0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:42.940979 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:42.941522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbd997-a6b2-470c-9f6a-e4905f075dce None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:42.952560 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbd997-a6b2-470c-9f6a-e4905f075dce None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:42.960835 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec56f3-2b19-4f16-ab9e-89dcae170872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:42.961564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec56f3-2b19-4f16-ab9e-89dcae170872 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:42.961907 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec56f3-2b19-4f16-ab9e-89dcae170872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:42.962306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec56f3-2b19-4f16-ab9e-89dcae170872 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:42.963130 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec56f3-2b19-4f16-ab9e-89dcae170872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:42.963492 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec56f3-2b19-4f16-ab9e-89dcae170872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:42.965468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec56f3-2b19-4f16-ab9e-89dcae170872 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:42.979019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1298/2584] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:50:42.984170 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec56f3-2b19-4f16-ab9e-89dcae170872 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:42.995281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db74614018fb44fb9e4e8a3c1e0d0af0', 'request_id': 'req-421f4cf0-022d-4fce-9280-50354a9e9c03'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:42.996565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec56f3-2b19-4f16-ab9e-89dcae170872 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:43.004594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db74614018fb44fb9e4e8a3c1e0d0af0', 'request_id': 'req-421f4cf0-022d-4fce-9280-50354a9e9c03'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:43.011654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db74614018fb44fb9e4e8a3c1e0d0af0', 'request_id': 'req-421f4cf0-022d-4fce-9280-50354a9e9c03'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:43.023412 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] The token cache is being invalidate because project db74614018fb44fb9e4e8a3c1e0d0af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:43.023701 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:43.024651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:43.026602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1287/2585] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:42 2022] DELETE /identity/v3/projects/db74614018fb44fb9e4e8a3c1e0d0af0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:43.030917 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:43.032594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:43.066934 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891b6ca-ba8d-4481-b305-c8f44b449e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:43.067510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891b6ca-ba8d-4481-b305-c8f44b449e67 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:43.067793 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891b6ca-ba8d-4481-b305-c8f44b449e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:43.068075 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891b6ca-ba8d-4481-b305-c8f44b449e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:43.069023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891b6ca-ba8d-4481-b305-c8f44b449e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:43.070966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891b6ca-ba8d-4481-b305-c8f44b449e67 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:43.098661 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1299/2586] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:42 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:43.102416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891b6ca-ba8d-4481-b305-c8f44b449e67 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:43.104708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b891b6ca-ba8d-4481-b305-c8f44b449e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:43.106035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4cf0-022d-4fce-9280-50354a9e9c03 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:43.170136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed606b45-b3a7-48b0-b3f7-0c7e83399805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:43.171041 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed606b45-b3a7-48b0-b3f7-0c7e83399805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:43.171320 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed606b45-b3a7-48b0-b3f7-0c7e83399805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:43.171590 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed606b45-b3a7-48b0-b3f7-0c7e83399805 admin admin] PATH_INFO: `/v3/users/22dd56d219bd44459a2e6371278f9d5f` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:43.172784 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed606b45-b3a7-48b0-b3f7-0c7e83399805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22dd56d219bd44459a2e6371278f9d5f)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:43.173562 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891b6ca-ba8d-4481-b305-c8f44b449e67 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:43.174775 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed606b45-b3a7-48b0-b3f7-0c7e83399805 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:43.179134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fae3d-e38d-4a94-9a5e-fe3d64fb98d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:43.179802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fae3d-e38d-4a94-9a5e-fe3d64fb98d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:43.180082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fae3d-e38d-4a94-9a5e-fe3d64fb98d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:43.180361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fae3d-e38d-4a94-9a5e-fe3d64fb98d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:43.181054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fae3d-e38d-4a94-9a5e-fe3d64fb98d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:43.183021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fae3d-e38d-4a94-9a5e-fe3d64fb98d1 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:43.207189 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1300/2587] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:43 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:43.209778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fae3d-e38d-4a94-9a5e-fe3d64fb98d1 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:43.220109 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fae3d-e38d-4a94-9a5e-fe3d64fb98d1 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:43.225008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225c48f-db93-46d2-ab27-8ed45e06c6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:43.225613 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ed606b45-b3a7-48b0-b3f7-0c7e83399805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22dd56d219bd44459a2e6371278f9d5f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:43.225763 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c48f-db93-46d2-ab27-8ed45e06c6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:43.226006 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c48f-db93-46d2-ab27-8ed45e06c6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:43.226288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225c48f-db93-46d2-ab27-8ed45e06c6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:43.227058 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225c48f-db93-46d2-ab27-8ed45e06c6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:43.227268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ed606b45-b3a7-48b0-b3f7-0c7e83399805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22dd56d219bd44459a2e6371278f9d5f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:43.228056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ed606b45-b3a7-48b0-b3f7-0c7e83399805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22dd56d219bd44459a2e6371278f9d5f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:43.228661 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225c48f-db93-46d2-ab27-8ed45e06c6a5 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:43.241626 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1301/2588] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:43.242718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225c48f-db93-46d2-ab27-8ed45e06c6a5 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:43.244462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d225c48f-db93-46d2-ab27-8ed45e06c6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:43.251128 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ed606b45-b3a7-48b0-b3f7-0c7e83399805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22dd56d219bd44459a2e6371278f9d5f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:43.258126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225c48f-db93-46d2-ab27-8ed45e06c6a5 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:43.258280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ed606b45-b3a7-48b0-b3f7-0c7e83399805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22dd56d219bd44459a2e6371278f9d5f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:43.264361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc731a-c274-422f-9d3d-9277f0dda19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:43.265111 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc731a-c274-422f-9d3d-9277f0dda19b admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:43.265464 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc731a-c274-422f-9d3d-9277f0dda19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:43.265814 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc731a-c274-422f-9d3d-9277f0dda19b admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:43.266926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc731a-c274-422f-9d3d-9277f0dda19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:43.268830 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc731a-c274-422f-9d3d-9277f0dda19b admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:43.273088 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1288/2589] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:43 2022] DELETE /identity/v3/users/22dd56d219bd44459a2e6371278f9d5f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:43.280386 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1302/2590] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:43.284305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed606b45-b3a7-48b0-b3f7-0c7e83399805 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:43.368901 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed606b45-b3a7-48b0-b3f7-0c7e83399805 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:43.376010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a7ca1-a313-45c5-abab-cc89c69121ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:43.377054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a7ca1-a313-45c5-abab-cc89c69121ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:43.377335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a7ca1-a313-45c5-abab-cc89c69121ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:43.377609 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a7ca1-a313-45c5-abab-cc89c69121ea admin admin] PATH_INFO: `/v3/projects/e2cacca967694ec3ade4594dd70ffb18/users/0e8d0b42d8f049478af5983e4ba6f21c/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:43.395527 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a7ca1-a313-45c5-abab-cc89c69121ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2cacca967694ec3ade4594dd70ffb18, user_id=0e8d0b42d8f049478af5983e4ba6f21c, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:43.399560 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a7ca1-a313-45c5-abab-cc89c69121ea admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:43.430950 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1289/2591] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:43 2022] PUT /identity/v3/projects/e2cacca967694ec3ade4594dd70ffb18/users/0e8d0b42d8f049478af5983e4ba6f21c/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:43.439302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f7015-fae9-4b50-975c-4958c67dcedb None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:43.439421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f7015-fae9-4b50-975c-4958c67dcedb None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:43.439637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f7015-fae9-4b50-975c-4958c67dcedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:43.476448 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-8d8f7015-fae9-4b50-975c-4958c67dcedb None None] MFA Rules not processed for user `0e8d0b42d8f049478af5983e4ba6f21c`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:43.477370 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8d8f7015-fae9-4b50-975c-4958c67dcedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:43.573339 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1303/2592] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:43 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:43.584175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a7ca1-a313-45c5-abab-cc89c69121ea admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:43.585952 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b60a7ca1-a313-45c5-abab-cc89c69121ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:43.598226 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f7015-fae9-4b50-975c-4958c67dcedb None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:43.599894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8d8f7015-fae9-4b50-975c-4958c67dcedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:43.699660 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f7015-fae9-4b50-975c-4958c67dcedb None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:43.704932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691ab2b-da41-4187-ad07-096bc0d91419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:43.705974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691ab2b-da41-4187-ad07-096bc0d91419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:43.706358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691ab2b-da41-4187-ad07-096bc0d91419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:43.706540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691ab2b-da41-4187-ad07-096bc0d91419 admin admin] PATH_INFO: `/v3/projects/15775cbd595942fb903a046a267e9588` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:43.708946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691ab2b-da41-4187-ad07-096bc0d91419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15775cbd595942fb903a046a267e9588)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:43.709883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691ab2b-da41-4187-ad07-096bc0d91419 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:43.719991 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a7ca1-a313-45c5-abab-cc89c69121ea admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:43.723870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e575d-fa9e-4e21-bdd7-ef7761a9b40d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:43.724526 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e575d-fa9e-4e21-bdd7-ef7761a9b40d service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:43.724808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e575d-fa9e-4e21-bdd7-ef7761a9b40d service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:43.725084 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e575d-fa9e-4e21-bdd7-ef7761a9b40d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:43.742557 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e575d-fa9e-4e21-bdd7-ef7761a9b40d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:43.745148 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e575d-fa9e-4e21-bdd7-ef7761a9b40d service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:43.757995 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1290/2593] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:43 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:43.798354 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9691ab2b-da41-4187-ad07-096bc0d91419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15775cbd595942fb903a046a267e9588', 'request_id': 'req-9691ab2b-da41-4187-ad07-096bc0d91419'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:43.825279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9691ab2b-da41-4187-ad07-096bc0d91419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15775cbd595942fb903a046a267e9588', 'request_id': 'req-9691ab2b-da41-4187-ad07-096bc0d91419'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:43.831775 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9691ab2b-da41-4187-ad07-096bc0d91419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15775cbd595942fb903a046a267e9588', 'request_id': 'req-9691ab2b-da41-4187-ad07-096bc0d91419'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:43.858039 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9691ab2b-da41-4187-ad07-096bc0d91419 admin admin] The token cache is being invalidate because project 15775cbd595942fb903a046a267e9588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:43.858423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9691ab2b-da41-4187-ad07-096bc0d91419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:43.859910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9691ab2b-da41-4187-ad07-096bc0d91419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:43.865009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1304/2594] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:43 2022] DELETE /identity/v3/projects/15775cbd595942fb903a046a267e9588 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:43.870821 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dd3e2-b86d-4d90-b550-0684553e1f1b None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:43.871450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dd3e2-b86d-4d90-b550-0684553e1f1b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:43.871855 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dd3e2-b86d-4d90-b550-0684553e1f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:43.902897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-444dd3e2-b86d-4d90-b550-0684553e1f1b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:43.904808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-444dd3e2-b86d-4d90-b550-0684553e1f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:43.999900 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1291/2595] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:44.002195 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bacd95-47f5-4832-95b6-39f0aaa22313 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:44.002759 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bacd95-47f5-4832-95b6-39f0aaa22313 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:44.003130 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bacd95-47f5-4832-95b6-39f0aaa22313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:44.028549 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-c7bacd95-47f5-4832-95b6-39f0aaa22313 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:44.030716 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c7bacd95-47f5-4832-95b6-39f0aaa22313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:44.041831 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1305/2596] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:44.046907 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dd3e2-b86d-4d90-b550-0684553e1f1b None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:44.057961 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dd3e2-b86d-4d90-b550-0684553e1f1b None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:44.065398 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3e9dc-6420-4b1c-a3e0-36c86c2f709e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:44.065863 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e9dc-6420-4b1c-a3e0-36c86c2f709e admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:44.066345 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e9dc-6420-4b1c-a3e0-36c86c2f709e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:44.066923 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e9dc-6420-4b1c-a3e0-36c86c2f709e admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:44.067668 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3e9dc-6420-4b1c-a3e0-36c86c2f709e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:44.068602 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3e9dc-6420-4b1c-a3e0-36c86c2f709e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:44.070316 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3e9dc-6420-4b1c-a3e0-36c86c2f709e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:44.086821 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1292/2597] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:50:44.088393 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bacd95-47f5-4832-95b6-39f0aaa22313 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:44.101407 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bacd95-47f5-4832-95b6-39f0aaa22313 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:44.110174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e187e-ed47-4e7d-aa48-cd67b4aa9f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:44.110920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e187e-ed47-4e7d-aa48-cd67b4aa9f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:44.111680 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e187e-ed47-4e7d-aa48-cd67b4aa9f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:44.112034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e187e-ed47-4e7d-aa48-cd67b4aa9f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:44.112803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e187e-ed47-4e7d-aa48-cd67b4aa9f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:44.115342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e187e-ed47-4e7d-aa48-cd67b4aa9f01 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:44.186553 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1306/2598] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:44 2022] POST /identity/v3/projects => generated 409 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:44.187558 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3e9dc-6420-4b1c-a3e0-36c86c2f709e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:44.205413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3e9dc-6420-4b1c-a3e0-36c86c2f709e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:44.313529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9891f-056c-487f-95db-9e581482c2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:44.314284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9891f-056c-487f-95db-9e581482c2da admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:44.314632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9891f-056c-487f-95db-9e581482c2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:44.315210 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9891f-056c-487f-95db-9e581482c2da admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:44.316012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9891f-056c-487f-95db-9e581482c2da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:44.318004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9891f-056c-487f-95db-9e581482c2da admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:44.342709 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1293/2599] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:44 2022] POST /identity/v3/users => generated 305 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:44.346055 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e187e-ed47-4e7d-aa48-cd67b4aa9f01 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:44.356843 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e187e-ed47-4e7d-aa48-cd67b4aa9f01 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:44.361630 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52626e4a-f788-45d6-bd59-5e2de917d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:44.362558 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52626e4a-f788-45d6-bd59-5e2de917d29e admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:44.363137 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52626e4a-f788-45d6-bd59-5e2de917d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:44.363494 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52626e4a-f788-45d6-bd59-5e2de917d29e admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:44.364339 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52626e4a-f788-45d6-bd59-5e2de917d29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:44.366022 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52626e4a-f788-45d6-bd59-5e2de917d29e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:44.377530 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1307/2600] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:44.381653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9891f-056c-487f-95db-9e581482c2da admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:44.393085 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9891f-056c-487f-95db-9e581482c2da admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:44.399139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7d0d8-4c67-4b91-9713-677dfe344533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:44.400019 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7d0d8-4c67-4b91-9713-677dfe344533 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:44.400305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7d0d8-4c67-4b91-9713-677dfe344533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:44.400581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7d0d8-4c67-4b91-9713-677dfe344533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:44.401336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7d0d8-4c67-4b91-9713-677dfe344533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:44.403943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7d0d8-4c67-4b91-9713-677dfe344533 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:44.418065 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1294/2601] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:44.422424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52626e4a-f788-45d6-bd59-5e2de917d29e admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:44.432598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52626e4a-f788-45d6-bd59-5e2de917d29e admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:44.437654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbf074-95f9-4e96-8c7c-c2b5b030d3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:44.443750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbf074-95f9-4e96-8c7c-c2b5b030d3c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:44.443750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbf074-95f9-4e96-8c7c-c2b5b030d3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:44.443750 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbf074-95f9-4e96-8c7c-c2b5b030d3c1 admin admin] PATH_INFO: `/v3/projects/2014462d74c84b66acf760ccd949ab91/users/30d04362c4a94f888c6117545a88cc2e/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:44.463711 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbf074-95f9-4e96-8c7c-c2b5b030d3c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2014462d74c84b66acf760ccd949ab91, user_id=30d04362c4a94f888c6117545a88cc2e, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:44.467234 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbf074-95f9-4e96-8c7c-c2b5b030d3c1 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:44.482192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1308/2602] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:44 2022] PUT /identity/v3/projects/2014462d74c84b66acf760ccd949ab91/users/30d04362c4a94f888c6117545a88cc2e/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:44.492863 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085dbd4-ca73-4265-ab3c-a89aa4a251fb None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:44.493321 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085dbd4-ca73-4265-ab3c-a89aa4a251fb None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:44.493706 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085dbd4-ca73-4265-ab3c-a89aa4a251fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:44.526847 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-9085dbd4-ca73-4265-ab3c-a89aa4a251fb None None] MFA Rules not processed for user `30d04362c4a94f888c6117545a88cc2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:44.528205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9085dbd4-ca73-4265-ab3c-a89aa4a251fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:44.597122 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1295/2603] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:44 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:44.601657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbf074-95f9-4e96-8c7c-c2b5b030d3c1 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:44.664326 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbf074-95f9-4e96-8c7c-c2b5b030d3c1 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:44.670510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897edfeb-3b09-4c49-8675-6a913c88802c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:44.671254 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897edfeb-3b09-4c49-8675-6a913c88802c admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:44.671811 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897edfeb-3b09-4c49-8675-6a913c88802c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:44.672092 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897edfeb-3b09-4c49-8675-6a913c88802c admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:44.672807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897edfeb-3b09-4c49-8675-6a913c88802c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:44.674739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897edfeb-3b09-4c49-8675-6a913c88802c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:44.704466 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1309/2604] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:44 2022] POST /identity/v3/projects => generated 409 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:44.708927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085dbd4-ca73-4265-ab3c-a89aa4a251fb None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:44.720997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085dbd4-ca73-4265-ab3c-a89aa4a251fb None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:44.783246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c3ea1-51fa-4ba4-9bc6-d1223b25427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:44.784247 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c3ea1-51fa-4ba4-9bc6-d1223b25427d admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:44.784717 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c3ea1-51fa-4ba4-9bc6-d1223b25427d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:44.784997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c3ea1-51fa-4ba4-9bc6-d1223b25427d admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:44.785692 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c3ea1-51fa-4ba4-9bc6-d1223b25427d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:44.787658 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c3ea1-51fa-4ba4-9bc6-d1223b25427d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:44.813402 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1296/2605] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:44 2022] POST /identity/v3/users => generated 311 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:44.814690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897edfeb-3b09-4c49-8675-6a913c88802c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:44.825438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897edfeb-3b09-4c49-8675-6a913c88802c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:44.830097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04b421-2dbf-420c-9738-65fe25c8c415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:44.830778 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04b421-2dbf-420c-9738-65fe25c8c415 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:44.831068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04b421-2dbf-420c-9738-65fe25c8c415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:44.831329 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04b421-2dbf-420c-9738-65fe25c8c415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:44.832047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04b421-2dbf-420c-9738-65fe25c8c415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:44.833629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04b421-2dbf-420c-9738-65fe25c8c415 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:44.848517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1310/2606] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:44.849875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c3ea1-51fa-4ba4-9bc6-d1223b25427d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:44.860574 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c3ea1-51fa-4ba4-9bc6-d1223b25427d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:44.865265 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb5d69-bb70-4767-b56d-0426b26e69e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:44.866141 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb5d69-bb70-4767-b56d-0426b26e69e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:44.866428 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb5d69-bb70-4767-b56d-0426b26e69e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:44.866736 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb5d69-bb70-4767-b56d-0426b26e69e2 admin admin] PATH_INFO: `/v3/projects/c277d65ec8e048658b05e6a9941e9bce/users/8897b280db0548f2b19f0878732ccb83/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:44.883576 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb5d69-bb70-4767-b56d-0426b26e69e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c277d65ec8e048658b05e6a9941e9bce, user_id=8897b280db0548f2b19f0878732ccb83, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:44.887174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb5d69-bb70-4767-b56d-0426b26e69e2 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:44.900948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1297/2607] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:44 2022] PUT /identity/v3/projects/c277d65ec8e048658b05e6a9941e9bce/users/8897b280db0548f2b19f0878732ccb83/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:44.905358 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04b421-2dbf-420c-9738-65fe25c8c415 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:44.915827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04b421-2dbf-420c-9738-65fe25c8c415 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:44.971908 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325e288-9e85-4172-ba5b-fd141eb39e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:44.972580 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e288-9e85-4172-ba5b-fd141eb39e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:44.972853 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e288-9e85-4172-ba5b-fd141eb39e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:44.973127 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e288-9e85-4172-ba5b-fd141eb39e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:44.973926 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325e288-9e85-4172-ba5b-fd141eb39e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:44.975564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325e288-9e85-4172-ba5b-fd141eb39e54 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:44.986472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1311/2608] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:44.990419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb5d69-bb70-4767-b56d-0426b26e69e2 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:45.003090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb5d69-bb70-4767-b56d-0426b26e69e2 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:45.011125 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749f886-e183-436e-80d6-4c8dbd6a674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:45.011125 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749f886-e183-436e-80d6-4c8dbd6a674c admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:45.011125 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749f886-e183-436e-80d6-4c8dbd6a674c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:45.011125 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749f886-e183-436e-80d6-4c8dbd6a674c admin admin] PATH_INFO: `/v3/projects/c277d65ec8e048658b05e6a9941e9bce/users/8897b280db0548f2b19f0878732ccb83/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:45.012947 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749f886-e183-436e-80d6-4c8dbd6a674c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c277d65ec8e048658b05e6a9941e9bce, user_id=8897b280db0548f2b19f0878732ccb83, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:45.017360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749f886-e183-436e-80d6-4c8dbd6a674c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:45.028354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1298/2609] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:44 2022] PUT /identity/v3/projects/c277d65ec8e048658b05e6a9941e9bce/users/8897b280db0548f2b19f0878732ccb83/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:45.038655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e0784-a9b4-406e-8970-cdb90a3383f1 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:45.038975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e0784-a9b4-406e-8970-cdb90a3383f1 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:45.039253 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e0784-a9b4-406e-8970-cdb90a3383f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:45.060020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749f886-e183-436e-80d6-4c8dbd6a674c admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:45.061775 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d749f886-e183-436e-80d6-4c8dbd6a674c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:45.068224 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ee0e0784-a9b4-406e-8970-cdb90a3383f1 None None] MFA Rules not processed for user `8897b280db0548f2b19f0878732ccb83`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:45.069419 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ee0e0784-a9b4-406e-8970-cdb90a3383f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:45.117796 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749f886-e183-436e-80d6-4c8dbd6a674c admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:45.122354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb348f-e596-4be0-a7fa-74a17a5b6440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:45.123055 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb348f-e596-4be0-a7fa-74a17a5b6440 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:45.123335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb348f-e596-4be0-a7fa-74a17a5b6440 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:45.123611 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb348f-e596-4be0-a7fa-74a17a5b6440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:45.125485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-6bbb348f-e596-4be0-a7fa-74a17a5b6440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:45.138385 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1312/2610] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:45 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:45.149550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e0784-a9b4-406e-8970-cdb90a3383f1 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:45.150908 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ee0e0784-a9b4-406e-8970-cdb90a3383f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:45.189243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb348f-e596-4be0-a7fa-74a17a5b6440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:45.190725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb348f-e596-4be0-a7fa-74a17a5b6440 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:45.200468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1299/2611] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:50:45.206602 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e0784-a9b4-406e-8970-cdb90a3383f1 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:45.210241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296308d5-83e3-4ba2-b8f2-bd1e66a76165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:45.210907 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296308d5-83e3-4ba2-b8f2-bd1e66a76165 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:45.211184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296308d5-83e3-4ba2-b8f2-bd1e66a76165 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:45.211454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296308d5-83e3-4ba2-b8f2-bd1e66a76165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:45.221425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296308d5-83e3-4ba2-b8f2-bd1e66a76165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:45.222563 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296308d5-83e3-4ba2-b8f2-bd1e66a76165 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:45.233650 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1313/2612] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:45 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:50:45.396458 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb348f-e596-4be0-a7fa-74a17a5b6440 service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:45.406624 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb348f-e596-4be0-a7fa-74a17a5b6440 service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:45.411221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ca53e-2b0e-4f1f-9033-e485f4319a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:45.411969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ca53e-2b0e-4f1f-9033-e485f4319a24 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:45.412451 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ca53e-2b0e-4f1f-9033-e485f4319a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:45.412979 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ca53e-2b0e-4f1f-9033-e485f4319a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:45.472441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ca53e-2b0e-4f1f-9033-e485f4319a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:45.474144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ca53e-2b0e-4f1f-9033-e485f4319a24 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:45.484867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1300/2613] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:48.769422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296308d5-83e3-4ba2-b8f2-bd1e66a76165 service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:48.769422 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-296308d5-83e3-4ba2-b8f2-bd1e66a76165 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:48.784276 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296308d5-83e3-4ba2-b8f2-bd1e66a76165 service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:48.788656 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62599d-ba00-4d91-981d-97a72d48853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:48.789511 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62599d-ba00-4d91-981d-97a72d48853a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:48.789786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62599d-ba00-4d91-981d-97a72d48853a admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:48.790056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62599d-ba00-4d91-981d-97a72d48853a admin admin] PATH_INFO: `/v3/users/10626535b6874ef58b63d259f059cd15` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:48.791239 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62599d-ba00-4d91-981d-97a72d48853a admin admin] RBAC: Authorizing `identity:delete_user(user_id=10626535b6874ef58b63d259f059cd15)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:48.793525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62599d-ba00-4d91-981d-97a72d48853a admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:48.842058 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5a62599d-ba00-4d91-981d-97a72d48853a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10626535b6874ef58b63d259f059cd15'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:48.842740 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5a62599d-ba00-4d91-981d-97a72d48853a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10626535b6874ef58b63d259f059cd15'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:48.854245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5a62599d-ba00-4d91-981d-97a72d48853a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10626535b6874ef58b63d259f059cd15'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:48.854998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5a62599d-ba00-4d91-981d-97a72d48853a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10626535b6874ef58b63d259f059cd15'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:48.861752 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-5a62599d-ba00-4d91-981d-97a72d48853a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10626535b6874ef58b63d259f059cd15'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:48.873940 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1314/2614] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:48 2022] DELETE /identity/v3/users/10626535b6874ef58b63d259f059cd15 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:49.045359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ca53e-2b0e-4f1f-9033-e485f4319a24 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:49.059135 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ca53e-2b0e-4f1f-9033-e485f4319a24 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:49.119777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:49.120581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:49.120881 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:49.121248 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b admin admin] PATH_INFO: `/v3/projects/c07bc791aa8d45d4a9e72758f39f6a85` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:49.122461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c07bc791aa8d45d4a9e72758f39f6a85)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:49.124387 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:49.170382 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c07bc791aa8d45d4a9e72758f39f6a85', 'request_id': 'req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:49.177715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c07bc791aa8d45d4a9e72758f39f6a85', 'request_id': 'req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:49.187664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c07bc791aa8d45d4a9e72758f39f6a85', 'request_id': 'req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:49.198325 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b admin admin] The token cache is being invalidate because project c07bc791aa8d45d4a9e72758f39f6a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:49.198654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:49.199376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-65421ca9-3cc0-4e72-ae68-6c32d155fe0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:49.200934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1301/2615] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:49 2022] DELETE /identity/v3/projects/c07bc791aa8d45d4a9e72758f39f6a85 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:49.205786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5328dc-1f71-4bae-bec0-20c7655d8611 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:49.206160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5328dc-1f71-4bae-bec0-20c7655d8611 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:49.206343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5328dc-1f71-4bae-bec0-20c7655d8611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:49.224728 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-4b5328dc-1f71-4bae-bec0-20c7655d8611 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:49.225985 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4b5328dc-1f71-4bae-bec0-20c7655d8611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:49.284457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1315/2616] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:49.293651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a05c-3780-4e8e-8164-27f068a2d972 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:49.293936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a05c-3780-4e8e-8164-27f068a2d972 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:49.294211 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286a05c-3780-4e8e-8164-27f068a2d972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:49.312342 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-0286a05c-3780-4e8e-8164-27f068a2d972 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:49.313569 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0286a05c-3780-4e8e-8164-27f068a2d972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:49.321538 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1302/2617] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:49.325849 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5328dc-1f71-4bae-bec0-20c7655d8611 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:49.335533 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5328dc-1f71-4bae-bec0-20c7655d8611 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:49.340760 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518d0ae-0302-4d5e-b3d4-3f5e63f93314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:49.341400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518d0ae-0302-4d5e-b3d4-3f5e63f93314 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:49.341686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518d0ae-0302-4d5e-b3d4-3f5e63f93314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:49.341958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518d0ae-0302-4d5e-b3d4-3f5e63f93314 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:49.342712 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518d0ae-0302-4d5e-b3d4-3f5e63f93314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:49.343021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518d0ae-0302-4d5e-b3d4-3f5e63f93314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:49.344599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518d0ae-0302-4d5e-b3d4-3f5e63f93314 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:49.356664 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1316/2618] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:50:49.360806 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286a05c-3780-4e8e-8164-27f068a2d972 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:49.370005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286a05c-3780-4e8e-8164-27f068a2d972 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:49.374587 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc21807-8bfd-4c66-be8a-d320729a1449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:49.375259 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc21807-8bfd-4c66-be8a-d320729a1449 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:49.375539 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc21807-8bfd-4c66-be8a-d320729a1449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:49.375812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc21807-8bfd-4c66-be8a-d320729a1449 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:49.376529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc21807-8bfd-4c66-be8a-d320729a1449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:49.378447 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc21807-8bfd-4c66-be8a-d320729a1449 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:49.405241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1303/2619] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:49 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:49.408673 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518d0ae-0302-4d5e-b3d4-3f5e63f93314 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:49.418904 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518d0ae-0302-4d5e-b3d4-3f5e63f93314 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:49.474029 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d1616-2e07-4091-b61b-bcdf6ed57cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:49.475034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1616-2e07-4091-b61b-bcdf6ed57cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:49.475318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1616-2e07-4091-b61b-bcdf6ed57cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:49.475593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d1616-2e07-4091-b61b-bcdf6ed57cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:49.476279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d1616-2e07-4091-b61b-bcdf6ed57cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:49.478184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d1616-2e07-4091-b61b-bcdf6ed57cf4 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:49.498127 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1317/2620] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:49 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:49.501378 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc21807-8bfd-4c66-be8a-d320729a1449 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:49.512090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc21807-8bfd-4c66-be8a-d320729a1449 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:49.517082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684df5e-f15f-4c56-9eb7-9d2704ed24ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:49.517777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684df5e-f15f-4c56-9eb7-9d2704ed24ad admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:49.518064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684df5e-f15f-4c56-9eb7-9d2704ed24ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:49.518339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684df5e-f15f-4c56-9eb7-9d2704ed24ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:49.519107 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684df5e-f15f-4c56-9eb7-9d2704ed24ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:49.520705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684df5e-f15f-4c56-9eb7-9d2704ed24ad admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:49.532364 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1304/2621] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:49.536287 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d1616-2e07-4091-b61b-bcdf6ed57cf4 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:49.546477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d1616-2e07-4091-b61b-bcdf6ed57cf4 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:49.551031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4aa1f-f6d9-440a-8294-98fceb2a27a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:49.551680 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4aa1f-f6d9-440a-8294-98fceb2a27a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:49.551964 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4aa1f-f6d9-440a-8294-98fceb2a27a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:49.552241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4aa1f-f6d9-440a-8294-98fceb2a27a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:49.552958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4aa1f-f6d9-440a-8294-98fceb2a27a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:49.554543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4aa1f-f6d9-440a-8294-98fceb2a27a2 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:49.564946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1318/2622] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:49.568875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684df5e-f15f-4c56-9eb7-9d2704ed24ad admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:49.578691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684df5e-f15f-4c56-9eb7-9d2704ed24ad admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:49.583234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0fb76-a61d-4bdb-89f9-e64ad40b01b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:49.584100 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0fb76-a61d-4bdb-89f9-e64ad40b01b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:49.584380 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0fb76-a61d-4bdb-89f9-e64ad40b01b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:49.584656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0fb76-a61d-4bdb-89f9-e64ad40b01b2 admin admin] PATH_INFO: `/v3/projects/b1b3eb8ddcb64ff3aaf4f1a0a72277a4/users/01aeadd13180431cae37208c347a85e8/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:49.598860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0fb76-a61d-4bdb-89f9-e64ad40b01b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b3eb8ddcb64ff3aaf4f1a0a72277a4, user_id=01aeadd13180431cae37208c347a85e8, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:49.601484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0fb76-a61d-4bdb-89f9-e64ad40b01b2 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:49.614803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1305/2623] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:49 2022] PUT /identity/v3/projects/b1b3eb8ddcb64ff3aaf4f1a0a72277a4/users/01aeadd13180431cae37208c347a85e8/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:49.625726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f676df9-9644-4995-85be-a8511e9565ad None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:49.626018 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f676df9-9644-4995-85be-a8511e9565ad None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:49.626295 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f676df9-9644-4995-85be-a8511e9565ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:49.654707 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-0f676df9-9644-4995-85be-a8511e9565ad None None] MFA Rules not processed for user `01aeadd13180431cae37208c347a85e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:49.655933 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-0f676df9-9644-4995-85be-a8511e9565ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:49.719960 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1319/2624] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:49.724390 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0fb76-a61d-4bdb-89f9-e64ad40b01b2 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:49.785598 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0fb76-a61d-4bdb-89f9-e64ad40b01b2 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:49.790156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b54167-98d8-425c-a23d-9087502efe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:49.790861 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b54167-98d8-425c-a23d-9087502efe6d admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:49.791114 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b54167-98d8-425c-a23d-9087502efe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:49.791383 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b54167-98d8-425c-a23d-9087502efe6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:49.792072 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b54167-98d8-425c-a23d-9087502efe6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:49.795064 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b54167-98d8-425c-a23d-9087502efe6d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:49.820872 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1306/2625] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:49 2022] POST /identity/v3/projects => generated 359 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:49.825131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f676df9-9644-4995-85be-a8511e9565ad None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:49.835552 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f676df9-9644-4995-85be-a8511e9565ad None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:49.892720 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64614856-6658-4b9b-acad-9885c32a5359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:49.893303 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64614856-6658-4b9b-acad-9885c32a5359 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:49.893584 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64614856-6658-4b9b-acad-9885c32a5359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:49.893857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64614856-6658-4b9b-acad-9885c32a5359 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:49.894537 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64614856-6658-4b9b-acad-9885c32a5359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:49.896536 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64614856-6658-4b9b-acad-9885c32a5359 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:49.916029 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1320/2626] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:49 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:49.920792 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b54167-98d8-425c-a23d-9087502efe6d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:49.930800 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b54167-98d8-425c-a23d-9087502efe6d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:49.935425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d048569-2c92-40b4-8b6a-0cd3137f0c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:49.936073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d048569-2c92-40b4-8b6a-0cd3137f0c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:49.936358 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d048569-2c92-40b4-8b6a-0cd3137f0c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:49.936634 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d048569-2c92-40b4-8b6a-0cd3137f0c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:49.937349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d048569-2c92-40b4-8b6a-0cd3137f0c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:49.938969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d048569-2c92-40b4-8b6a-0cd3137f0c64 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:49.949431 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1307/2627] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:49.953373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64614856-6658-4b9b-acad-9885c32a5359 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:49.962925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64614856-6658-4b9b-acad-9885c32a5359 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:49.968306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553af87-895a-4f35-b1c0-4025faf87422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:49.969217 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553af87-895a-4f35-b1c0-4025faf87422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:49.969526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553af87-895a-4f35-b1c0-4025faf87422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:49.969830 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553af87-895a-4f35-b1c0-4025faf87422 admin admin] PATH_INFO: `/v3/projects/cd248936f8c842228aced3f7189dc094/users/4cac0c4ebf2748af93bfe48c5af28d8b/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:49.984966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553af87-895a-4f35-b1c0-4025faf87422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd248936f8c842228aced3f7189dc094, user_id=4cac0c4ebf2748af93bfe48c5af28d8b, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:49.987663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553af87-895a-4f35-b1c0-4025faf87422 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:50.000012 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1321/2628] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:49 2022] PUT /identity/v3/projects/cd248936f8c842228aced3f7189dc094/users/4cac0c4ebf2748af93bfe48c5af28d8b/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:50.003874 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d048569-2c92-40b4-8b6a-0cd3137f0c64 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:50.014008 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d048569-2c92-40b4-8b6a-0cd3137f0c64 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:50.070494 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04263627-afd5-4f44-b369-13ba80879b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:50.071332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04263627-afd5-4f44-b369-13ba80879b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:50.071459 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04263627-afd5-4f44-b369-13ba80879b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:50.071732 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04263627-afd5-4f44-b369-13ba80879b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:50.072477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04263627-afd5-4f44-b369-13ba80879b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:50.074128 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04263627-afd5-4f44-b369-13ba80879b06 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:50.084106 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1308/2629] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:50.088258 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553af87-895a-4f35-b1c0-4025faf87422 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:50.099356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553af87-895a-4f35-b1c0-4025faf87422 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:50.103936 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c113252-0f33-4e6d-aa66-d499183e9454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:50.105610 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113252-0f33-4e6d-aa66-d499183e9454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:50.105919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113252-0f33-4e6d-aa66-d499183e9454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:50.106189 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113252-0f33-4e6d-aa66-d499183e9454 admin admin] PATH_INFO: `/v3/projects/cd248936f8c842228aced3f7189dc094/users/4cac0c4ebf2748af93bfe48c5af28d8b/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:50.108170 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113252-0f33-4e6d-aa66-d499183e9454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd248936f8c842228aced3f7189dc094, user_id=4cac0c4ebf2748af93bfe48c5af28d8b, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:50.110855 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113252-0f33-4e6d-aa66-d499183e9454 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:50.121532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1322/2630] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:50 2022] PUT /identity/v3/projects/cd248936f8c842228aced3f7189dc094/users/4cac0c4ebf2748af93bfe48c5af28d8b/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:50.131804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6203218-16b5-41bd-86b1-dd95c6ed742e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:50.132092 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6203218-16b5-41bd-86b1-dd95c6ed742e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:50.132367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6203218-16b5-41bd-86b1-dd95c6ed742e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:50.160268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-a6203218-16b5-41bd-86b1-dd95c6ed742e None None] MFA Rules not processed for user `4cac0c4ebf2748af93bfe48c5af28d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:50.161426 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a6203218-16b5-41bd-86b1-dd95c6ed742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:50.232449 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1309/2631] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:50 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:50.246398 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c113252-0f33-4e6d-aa66-d499183e9454 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:50.248373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-2c113252-0f33-4e6d-aa66-d499183e9454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:50.308773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c113252-0f33-4e6d-aa66-d499183e9454 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:50.312409 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8aef5-7e4e-4a8a-9436-5613a87ff2bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:50.313044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8aef5-7e4e-4a8a-9436-5613a87ff2bc service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:50.313323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8aef5-7e4e-4a8a-9436-5613a87ff2bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:50.313595 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8aef5-7e4e-4a8a-9436-5613a87ff2bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:50.322467 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8aef5-7e4e-4a8a-9436-5613a87ff2bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:50.324671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8aef5-7e4e-4a8a-9436-5613a87ff2bc service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:50.334090 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1323/2632] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:50 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:50:50.407216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6203218-16b5-41bd-86b1-dd95c6ed742e None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:50.417635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6203218-16b5-41bd-86b1-dd95c6ed742e None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:50.421250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f23cfc-6762-4468-80c4-73476605e764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:50.421928 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f23cfc-6762-4468-80c4-73476605e764 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:50.422256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f23cfc-6762-4468-80c4-73476605e764 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:50.422945 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f23cfc-6762-4468-80c4-73476605e764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:50.477998 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f23cfc-6762-4468-80c4-73476605e764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:50.479465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f23cfc-6762-4468-80c4-73476605e764 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:50.488596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1310/2633] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:53.207093 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8aef5-7e4e-4a8a-9436-5613a87ff2bc service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:53.268153 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8aef5-7e4e-4a8a-9436-5613a87ff2bc service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:53.272783 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fce9cd-b896-4d0a-a466-c0ae95b091dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:53.273965 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fce9cd-b896-4d0a-a466-c0ae95b091dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:53.274243 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fce9cd-b896-4d0a-a466-c0ae95b091dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:53.274513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fce9cd-b896-4d0a-a466-c0ae95b091dd admin admin] PATH_INFO: `/v3/users/01aeadd13180431cae37208c347a85e8` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:53.275854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fce9cd-b896-4d0a-a466-c0ae95b091dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=01aeadd13180431cae37208c347a85e8)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:53.278394 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fce9cd-b896-4d0a-a466-c0ae95b091dd admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:53.322521 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-d1fce9cd-b896-4d0a-a466-c0ae95b091dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01aeadd13180431cae37208c347a85e8'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:53.323229 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-d1fce9cd-b896-4d0a-a466-c0ae95b091dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01aeadd13180431cae37208c347a85e8'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:53.334763 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-d1fce9cd-b896-4d0a-a466-c0ae95b091dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01aeadd13180431cae37208c347a85e8'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:53.335397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-d1fce9cd-b896-4d0a-a466-c0ae95b091dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01aeadd13180431cae37208c347a85e8'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:53.342146 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-d1fce9cd-b896-4d0a-a466-c0ae95b091dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01aeadd13180431cae37208c347a85e8'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:53.354219 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1324/2634] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:53 2022] DELETE /identity/v3/users/01aeadd13180431cae37208c347a85e8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:53.359392 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b214b-be9e-4a39-846a-2146b41d0b9b None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:53.359906 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b214b-be9e-4a39-846a-2146b41d0b9b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:53.360010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b214b-be9e-4a39-846a-2146b41d0b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:53.377206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-cd7b214b-be9e-4a39-846a-2146b41d0b9b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:53.378404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-cd7b214b-be9e-4a39-846a-2146b41d0b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:53.435982 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1311/2635] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:53.445720 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fce9cd-b896-4d0a-a466-c0ae95b091dd admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:53.447170 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d1fce9cd-b896-4d0a-a466-c0ae95b091dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:53.503317 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fce9cd-b896-4d0a-a466-c0ae95b091dd admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:53.506999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c12002-251e-43b6-910b-77bdcc3cf5b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:53.507637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c12002-251e-43b6-910b-77bdcc3cf5b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:53.507919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c12002-251e-43b6-910b-77bdcc3cf5b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:53.508192 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c12002-251e-43b6-910b-77bdcc3cf5b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:53.517154 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c12002-251e-43b6-910b-77bdcc3cf5b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:53.518607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c12002-251e-43b6-910b-77bdcc3cf5b7 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:53.529061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1325/2636] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:53.790235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b214b-be9e-4a39-846a-2146b41d0b9b None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:53.791852 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-cd7b214b-be9e-4a39-846a-2146b41d0b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:53.811062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b214b-be9e-4a39-846a-2146b41d0b9b None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:53.815626 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:53.816858 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:53.817143 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:53.817705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] PATH_INFO: `/v3/projects/b1b3eb8ddcb64ff3aaf4f1a0a72277a4` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:53.819750 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1b3eb8ddcb64ff3aaf4f1a0a72277a4)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:53.821926 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:53.869904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1b3eb8ddcb64ff3aaf4f1a0a72277a4', 'request_id': 'req-092c646d-3352-43e8-ada1-3cccb8f82632'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:53.878315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1b3eb8ddcb64ff3aaf4f1a0a72277a4', 'request_id': 'req-092c646d-3352-43e8-ada1-3cccb8f82632'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:53.884046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1b3eb8ddcb64ff3aaf4f1a0a72277a4', 'request_id': 'req-092c646d-3352-43e8-ada1-3cccb8f82632'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:53.896121 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] The token cache is being invalidate because project b1b3eb8ddcb64ff3aaf4f1a0a72277a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:53.896415 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:53.897081 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:53.899036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1312/2637] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:53 2022] DELETE /identity/v3/projects/b1b3eb8ddcb64ff3aaf4f1a0a72277a4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:53.903864 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c12002-251e-43b6-910b-77bdcc3cf5b7 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:53.923495 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c12002-251e-43b6-910b-77bdcc3cf5b7 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:53.975789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:53.977381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:53.986723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f21954-4b4b-47ce-b118-ed47a2850ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:53.987629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f21954-4b4b-47ce-b118-ed47a2850ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:53.987908 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f21954-4b4b-47ce-b118-ed47a2850ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:53.988204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f21954-4b4b-47ce-b118-ed47a2850ff6 admin admin] PATH_INFO: `/v3/users/4cac0c4ebf2748af93bfe48c5af28d8b` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:53.989552 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f21954-4b4b-47ce-b118-ed47a2850ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cac0c4ebf2748af93bfe48c5af28d8b)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:53.991493 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f21954-4b4b-47ce-b118-ed47a2850ff6 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:54.039135 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-52f21954-4b4b-47ce-b118-ed47a2850ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cac0c4ebf2748af93bfe48c5af28d8b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.039801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-52f21954-4b4b-47ce-b118-ed47a2850ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cac0c4ebf2748af93bfe48c5af28d8b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.043420 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c646d-3352-43e8-ada1-3cccb8f82632 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:54.048436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64749f-ad05-49a0-bb44-a1170553903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:54.049305 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64749f-ad05-49a0-bb44-a1170553903d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.049611 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64749f-ad05-49a0-bb44-a1170553903d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.049883 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64749f-ad05-49a0-bb44-a1170553903d admin admin] PATH_INFO: `/v3/users/30d04362c4a94f888c6117545a88cc2e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.051136 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64749f-ad05-49a0-bb44-a1170553903d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d04362c4a94f888c6117545a88cc2e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:54.053086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64749f-ad05-49a0-bb44-a1170553903d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:54.053445 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-52f21954-4b4b-47ce-b118-ed47a2850ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cac0c4ebf2748af93bfe48c5af28d8b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.054120 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-52f21954-4b4b-47ce-b118-ed47a2850ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cac0c4ebf2748af93bfe48c5af28d8b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.061103 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-52f21954-4b4b-47ce-b118-ed47a2850ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cac0c4ebf2748af93bfe48c5af28d8b'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.075343 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1326/2638] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:53 2022] DELETE /identity/v3/users/4cac0c4ebf2748af93bfe48c5af28d8b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:54.115853 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3a64749f-ad05-49a0-bb44-a1170553903d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d04362c4a94f888c6117545a88cc2e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.116597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3a64749f-ad05-49a0-bb44-a1170553903d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d04362c4a94f888c6117545a88cc2e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.117295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3a64749f-ad05-49a0-bb44-a1170553903d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d04362c4a94f888c6117545a88cc2e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.130863 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3a64749f-ad05-49a0-bb44-a1170553903d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d04362c4a94f888c6117545a88cc2e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.138715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3a64749f-ad05-49a0-bb44-a1170553903d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d04362c4a94f888c6117545a88cc2e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.153535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1313/2639] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:53 2022] DELETE /identity/v3/users/30d04362c4a94f888c6117545a88cc2e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:54.158036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93461782-f47c-46ae-93f8-d2bdedf080f4 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.158426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93461782-f47c-46ae-93f8-d2bdedf080f4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.158747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93461782-f47c-46ae-93f8-d2bdedf080f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.175833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-93461782-f47c-46ae-93f8-d2bdedf080f4 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:54.177166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-93461782-f47c-46ae-93f8-d2bdedf080f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:54.249054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1327/2640] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:54.258766 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64749f-ad05-49a0-bb44-a1170553903d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:54.260189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3a64749f-ad05-49a0-bb44-a1170553903d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:54.319747 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64749f-ad05-49a0-bb44-a1170553903d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:54.324368 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e85869-fab2-4302-b942-d1f9e25f608c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:54.325014 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e85869-fab2-4302-b942-d1f9e25f608c service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.325409 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e85869-fab2-4302-b942-d1f9e25f608c service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.325693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e85869-fab2-4302-b942-d1f9e25f608c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.335778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e85869-fab2-4302-b942-d1f9e25f608c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:54.336793 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e85869-fab2-4302-b942-d1f9e25f608c service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:54.347031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1314/2641] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:54.364082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93461782-f47c-46ae-93f8-d2bdedf080f4 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:54.365758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-93461782-f47c-46ae-93f8-d2bdedf080f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:54.379181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93461782-f47c-46ae-93f8-d2bdedf080f4 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:54.384459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623f029-1d98-4bd7-bb57-090cd301c3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:54.385323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623f029-1d98-4bd7-bb57-090cd301c3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.385639 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623f029-1d98-4bd7-bb57-090cd301c3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.386454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623f029-1d98-4bd7-bb57-090cd301c3bd admin admin] PATH_INFO: `/v3/projects/cd248936f8c842228aced3f7189dc094` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.388055 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623f029-1d98-4bd7-bb57-090cd301c3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd248936f8c842228aced3f7189dc094)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:54.389993 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623f029-1d98-4bd7-bb57-090cd301c3bd admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:54.439619 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1623f029-1d98-4bd7-bb57-090cd301c3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd248936f8c842228aced3f7189dc094', 'request_id': 'req-1623f029-1d98-4bd7-bb57-090cd301c3bd'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.446892 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1623f029-1d98-4bd7-bb57-090cd301c3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd248936f8c842228aced3f7189dc094', 'request_id': 'req-1623f029-1d98-4bd7-bb57-090cd301c3bd'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.453503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1623f029-1d98-4bd7-bb57-090cd301c3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd248936f8c842228aced3f7189dc094', 'request_id': 'req-1623f029-1d98-4bd7-bb57-090cd301c3bd'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.465239 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1623f029-1d98-4bd7-bb57-090cd301c3bd admin admin] The token cache is being invalidate because project cd248936f8c842228aced3f7189dc094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:54.465747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1623f029-1d98-4bd7-bb57-090cd301c3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.466455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-1623f029-1d98-4bd7-bb57-090cd301c3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.468074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1328/2642] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:54 2022] DELETE /identity/v3/projects/cd248936f8c842228aced3f7189dc094 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:54.472949 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1366d-e63b-42a6-bc26-a4c55327b0e0 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.473445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1366d-e63b-42a6-bc26-a4c55327b0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.473700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1366d-e63b-42a6-bc26-a4c55327b0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.494035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-5dc1366d-e63b-42a6-bc26-a4c55327b0e0 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:54.494035 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-5dc1366d-e63b-42a6-bc26-a4c55327b0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:54.562794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1315/2643] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:54.571889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a7849-6484-4348-a881-f2d7701f7cbd None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.572176 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a7849-6484-4348-a881-f2d7701f7cbd None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.572454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a7849-6484-4348-a881-f2d7701f7cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.591189 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-386a7849-6484-4348-a881-f2d7701f7cbd None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:54.592377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-386a7849-6484-4348-a881-f2d7701f7cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:54.601085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1329/2644] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:54.606186 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1366d-e63b-42a6-bc26-a4c55327b0e0 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:54.616493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1366d-e63b-42a6-bc26-a4c55327b0e0 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:54.624250 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a7849-6484-4348-a881-f2d7701f7cbd None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:54.625244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332eefda-5292-4c11-b3ec-9d9e610162e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:54.626052 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-386a7849-6484-4348-a881-f2d7701f7cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:54.626197 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332eefda-5292-4c11-b3ec-9d9e610162e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.626346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332eefda-5292-4c11-b3ec-9d9e610162e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.626605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332eefda-5292-4c11-b3ec-9d9e610162e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.627374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332eefda-5292-4c11-b3ec-9d9e610162e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:54.627683 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332eefda-5292-4c11-b3ec-9d9e610162e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:54.630970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332eefda-5292-4c11-b3ec-9d9e610162e3 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:54.647079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1316/2645] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:50:54.647278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a7849-6484-4348-a881-f2d7701f7cbd None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:54.648489 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332eefda-5292-4c11-b3ec-9d9e610162e3 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:54.649441 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:54.650864 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.651168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.651472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] PATH_INFO: `/v3/projects/2014462d74c84b66acf760ccd949ab91` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.652909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2014462d74c84b66acf760ccd949ab91)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:54.654894 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:54.658822 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332eefda-5292-4c11-b3ec-9d9e610162e3 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:54.663700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9614cfc-3670-4dca-83f0-3f6a8bc2a0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:54.664411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614cfc-3670-4dca-83f0-3f6a8bc2a0de admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.664691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614cfc-3670-4dca-83f0-3f6a8bc2a0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.664968 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614cfc-3670-4dca-83f0-3f6a8bc2a0de admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.665774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9614cfc-3670-4dca-83f0-3f6a8bc2a0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:54.668349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9614cfc-3670-4dca-83f0-3f6a8bc2a0de admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:54.698356 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1317/2646] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:54 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:54.700063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9614cfc-3670-4dca-83f0-3f6a8bc2a0de admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:54.702019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2014462d74c84b66acf760ccd949ab91', 'request_id': 'req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.711799 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2014462d74c84b66acf760ccd949ab91', 'request_id': 'req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.717519 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2014462d74c84b66acf760ccd949ab91', 'request_id': 'req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.728690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] The token cache is being invalidate because project 2014462d74c84b66acf760ccd949ab91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:54.728974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.730304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.731994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1330/2647] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:54 2022] DELETE /identity/v3/projects/2014462d74c84b66acf760ccd949ab91 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:54.735753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:54.737364 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:54.763652 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9614cfc-3670-4dca-83f0-3f6a8bc2a0de admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:54.768318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a3a48-72f1-428c-8eb4-cc2f7e242c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:54.768980 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a3a48-72f1-428c-8eb4-cc2f7e242c92 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.769262 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a3a48-72f1-428c-8eb4-cc2f7e242c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.769535 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a3a48-72f1-428c-8eb4-cc2f7e242c92 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.770213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a3a48-72f1-428c-8eb4-cc2f7e242c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:54.772165 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a3a48-72f1-428c-8eb4-cc2f7e242c92 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:54.791704 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1318/2648] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:54 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:54.796377 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a3a48-72f1-428c-8eb4-cc2f7e242c92 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:54.798098 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d18a3a48-72f1-428c-8eb4-cc2f7e242c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:54.803836 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fbeb5-4870-40cf-a8f8-77da089a2f93 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:54.809082 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9594aea-c4ce-4e5f-b13a-94e1d178f987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:54.809945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9594aea-c4ce-4e5f-b13a-94e1d178f987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.810224 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9594aea-c4ce-4e5f-b13a-94e1d178f987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.810525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9594aea-c4ce-4e5f-b13a-94e1d178f987 admin admin] PATH_INFO: `/v3/users/8897b280db0548f2b19f0878732ccb83` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.811751 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9594aea-c4ce-4e5f-b13a-94e1d178f987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8897b280db0548f2b19f0878732ccb83)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:54.811860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a3a48-72f1-428c-8eb4-cc2f7e242c92 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:54.813669 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9594aea-c4ce-4e5f-b13a-94e1d178f987 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:54.816504 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa34d3-d61d-4f2e-a3b1-63a825cc2d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:54.817208 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa34d3-d61d-4f2e-a3b1-63a825cc2d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.817488 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa34d3-d61d-4f2e-a3b1-63a825cc2d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.817755 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa34d3-d61d-4f2e-a3b1-63a825cc2d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.818471 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa34d3-d61d-4f2e-a3b1-63a825cc2d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:54.820216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa34d3-d61d-4f2e-a3b1-63a825cc2d05 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:54.830818 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1319/2649] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:54.834584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa34d3-d61d-4f2e-a3b1-63a825cc2d05 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:54.845199 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa34d3-d61d-4f2e-a3b1-63a825cc2d05 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:54.850720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d496c60-fd8e-4b77-894c-39a32632cc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:54.851379 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d496c60-fd8e-4b77-894c-39a32632cc16 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.851668 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d496c60-fd8e-4b77-894c-39a32632cc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.851940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d496c60-fd8e-4b77-894c-39a32632cc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.852660 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d496c60-fd8e-4b77-894c-39a32632cc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:54.854254 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d496c60-fd8e-4b77-894c-39a32632cc16 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:54.862900 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f9594aea-c4ce-4e5f-b13a-94e1d178f987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8897b280db0548f2b19f0878732ccb83'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.863572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f9594aea-c4ce-4e5f-b13a-94e1d178f987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8897b280db0548f2b19f0878732ccb83'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.866762 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1320/2650] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:54.871661 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d496c60-fd8e-4b77-894c-39a32632cc16 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:54.876262 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f9594aea-c4ce-4e5f-b13a-94e1d178f987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8897b280db0548f2b19f0878732ccb83'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.876984 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f9594aea-c4ce-4e5f-b13a-94e1d178f987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8897b280db0548f2b19f0878732ccb83'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.881167 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d496c60-fd8e-4b77-894c-39a32632cc16 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:54.883792 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f9594aea-c4ce-4e5f-b13a-94e1d178f987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8897b280db0548f2b19f0878732ccb83'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:54.885697 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3082a4-3e47-45e5-aec9-09d7b47f07d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:54.886976 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3082a4-3e47-45e5-aec9-09d7b47f07d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.887257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3082a4-3e47-45e5-aec9-09d7b47f07d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.887526 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3082a4-3e47-45e5-aec9-09d7b47f07d1 admin admin] PATH_INFO: `/v3/projects/12f75b31805d4251ab2007d343b547ab/users/3d742840471a430e9546d562015c5ee3/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.896751 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1331/2651] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:54 2022] DELETE /identity/v3/users/8897b280db0548f2b19f0878732ccb83 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:54.902396 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3082a4-3e47-45e5-aec9-09d7b47f07d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f75b31805d4251ab2007d343b547ab, user_id=3d742840471a430e9546d562015c5ee3, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:54.905082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3082a4-3e47-45e5-aec9-09d7b47f07d1 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:54.918408 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1321/2652] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:54 2022] PUT /identity/v3/projects/12f75b31805d4251ab2007d343b547ab/users/3d742840471a430e9546d562015c5ee3/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:54.928897 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb2d1a-1f3a-43e7-803c-d233a2ca45ee None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:54.929314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb2d1a-1f3a-43e7-803c-d233a2ca45ee None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:54.929663 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb2d1a-1f3a-43e7-803c-d233a2ca45ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:54.958263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-89eb2d1a-1f3a-43e7-803c-d233a2ca45ee None None] MFA Rules not processed for user `3d742840471a430e9546d562015c5ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:54.960623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-89eb2d1a-1f3a-43e7-803c-d233a2ca45ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:55.029826 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1332/2653] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:55.034896 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3082a4-3e47-45e5-aec9-09d7b47f07d1 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.036854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1f3082a4-3e47-45e5-aec9-09d7b47f07d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:55.101210 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3082a4-3e47-45e5-aec9-09d7b47f07d1 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.106655 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c78d8-b796-4ead-8467-332213e10221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.107332 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c78d8-b796-4ead-8467-332213e10221 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.107608 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c78d8-b796-4ead-8467-332213e10221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.107899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c78d8-b796-4ead-8467-332213e10221 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.108581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c78d8-b796-4ead-8467-332213e10221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.110465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c78d8-b796-4ead-8467-332213e10221 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.135843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1322/2654] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:55 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:55.139958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb2d1a-1f3a-43e7-803c-d233a2ca45ee None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.151173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb2d1a-1f3a-43e7-803c-d233a2ca45ee None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.181844 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c78d8-b796-4ead-8467-332213e10221 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.184037 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-860c78d8-b796-4ead-8467-332213e10221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:55.216209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd21cc6-88d6-4463-8220-2eec80655fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.216913 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd21cc6-88d6-4463-8220-2eec80655fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.217191 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd21cc6-88d6-4463-8220-2eec80655fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.217459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd21cc6-88d6-4463-8220-2eec80655fbc admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.218155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd21cc6-88d6-4463-8220-2eec80655fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.220869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd21cc6-88d6-4463-8220-2eec80655fbc admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.244078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1333/2655] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:55 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:55.248013 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd21cc6-88d6-4463-8220-2eec80655fbc admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.257907 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd21cc6-88d6-4463-8220-2eec80655fbc admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.262298 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c78d8-b796-4ead-8467-332213e10221 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.263057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b1dc4-11f5-4ffa-8caf-17ebbb76ac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.263707 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b1dc4-11f5-4ffa-8caf-17ebbb76ac80 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.264000 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b1dc4-11f5-4ffa-8caf-17ebbb76ac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.264271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b1dc4-11f5-4ffa-8caf-17ebbb76ac80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.264993 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b1dc4-11f5-4ffa-8caf-17ebbb76ac80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.266607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b1dc4-11f5-4ffa-8caf-17ebbb76ac80 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.267224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.268076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.268354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.268626 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe admin admin] PATH_INFO: `/v3/projects/c277d65ec8e048658b05e6a9941e9bce` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.269836 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c277d65ec8e048658b05e6a9941e9bce)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.271756 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.278047 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1334/2656] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:55.281827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b1dc4-11f5-4ffa-8caf-17ebbb76ac80 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.292613 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b1dc4-11f5-4ffa-8caf-17ebbb76ac80 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.298015 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08976fd5-9dda-4e27-9922-c99e8864f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.298785 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08976fd5-9dda-4e27-9922-c99e8864f535 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.299139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08976fd5-9dda-4e27-9922-c99e8864f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.299484 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08976fd5-9dda-4e27-9922-c99e8864f535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.300306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08976fd5-9dda-4e27-9922-c99e8864f535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.301911 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08976fd5-9dda-4e27-9922-c99e8864f535 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.312762 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1335/2657] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:55.316735 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08976fd5-9dda-4e27-9922-c99e8864f535 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.323541 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c277d65ec8e048658b05e6a9941e9bce', 'request_id': 'req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:55.326204 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08976fd5-9dda-4e27-9922-c99e8864f535 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.331748 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c277d65ec8e048658b05e6a9941e9bce', 'request_id': 'req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:55.337634 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c277d65ec8e048658b05e6a9941e9bce', 'request_id': 'req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:55.349429 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe admin admin] The token cache is being invalidate because project c277d65ec8e048658b05e6a9941e9bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:55.349715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:55.350381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-efc9bcbe-288d-4fe1-9f57-244dbdc54abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:55.352014 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1323/2658] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:55 2022] DELETE /identity/v3/projects/c277d65ec8e048658b05e6a9941e9bce => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:55.357214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6839-6cbe-4be8-8203-b88c28817031 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.357584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6839-6cbe-4be8-8203-b88c28817031 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.357862 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6839-6cbe-4be8-8203-b88c28817031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.375184 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-972a6839-6cbe-4be8-8203-b88c28817031 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:55.376367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-972a6839-6cbe-4be8-8203-b88c28817031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:55.382536 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fa2a0-5a00-4b4d-a9a2-0da5e3c98255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.383522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fa2a0-5a00-4b4d-a9a2-0da5e3c98255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.383804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fa2a0-5a00-4b4d-a9a2-0da5e3c98255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.384076 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fa2a0-5a00-4b4d-a9a2-0da5e3c98255 admin admin] PATH_INFO: `/v3/projects/3af5165e82a14f98a731ce2357a8b54d/users/35cee31ce7a3423ab5b0fdb3870344bc/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.399197 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fa2a0-5a00-4b4d-a9a2-0da5e3c98255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af5165e82a14f98a731ce2357a8b54d, user_id=35cee31ce7a3423ab5b0fdb3870344bc, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.402959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fa2a0-5a00-4b4d-a9a2-0da5e3c98255 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.415655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1336/2659] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:55 2022] PUT /identity/v3/projects/3af5165e82a14f98a731ce2357a8b54d/users/35cee31ce7a3423ab5b0fdb3870344bc/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:55.427740 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c76355-5d3f-4276-948f-0ad2c2e11463 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.428026 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c76355-5d3f-4276-948f-0ad2c2e11463 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.428305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c76355-5d3f-4276-948f-0ad2c2e11463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.436456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1324/2660] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:55.445052 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1389bfc-741c-4c00-b6d7-7dbc020affbd None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.445344 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1389bfc-741c-4c00-b6d7-7dbc020affbd None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.445623 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1389bfc-741c-4c00-b6d7-7dbc020affbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.455839 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-51c76355-5d3f-4276-948f-0ad2c2e11463 None None] MFA Rules not processed for user `35cee31ce7a3423ab5b0fdb3870344bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:55.457079 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-51c76355-5d3f-4276-948f-0ad2c2e11463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:55.465049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c1389bfc-741c-4c00-b6d7-7dbc020affbd None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:55.466244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c1389bfc-741c-4c00-b6d7-7dbc020affbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:55.518928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1337/2661] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:55.523494 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c76355-5d3f-4276-948f-0ad2c2e11463 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.528233 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1325/2662] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:55.528747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-51c76355-5d3f-4276-948f-0ad2c2e11463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:55.529275 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1389bfc-741c-4c00-b6d7-7dbc020affbd None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.538222 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1389bfc-741c-4c00-b6d7-7dbc020affbd None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.539304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c76355-5d3f-4276-948f-0ad2c2e11463 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.543455 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacf1dc-5899-4015-b734-03ec50469458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.543960 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93dc7d-ac68-4f5c-b8ad-ace9391e414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.544079 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacf1dc-5899-4015-b734-03ec50469458 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.544361 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacf1dc-5899-4015-b734-03ec50469458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.544603 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93dc7d-ac68-4f5c-b8ad-ace9391e414d admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.544707 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacf1dc-5899-4015-b734-03ec50469458 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.544883 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93dc7d-ac68-4f5c-b8ad-ace9391e414d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.545155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93dc7d-ac68-4f5c-b8ad-ace9391e414d admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.545326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacf1dc-5899-4015-b734-03ec50469458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:55.545653 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacf1dc-5899-4015-b734-03ec50469458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.545842 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93dc7d-ac68-4f5c-b8ad-ace9391e414d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.547241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacf1dc-5899-4015-b734-03ec50469458 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.547762 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93dc7d-ac68-4f5c-b8ad-ace9391e414d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.559182 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1326/2663] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:50:55.563520 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacf1dc-5899-4015-b734-03ec50469458 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.572754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1338/2664] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:55 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:55.573825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacf1dc-5899-4015-b734-03ec50469458 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.577455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93dc7d-ac68-4f5c-b8ad-ace9391e414d admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.631629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37e9a6-0249-4a09-ac88-d240d0fd73a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.632298 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37e9a6-0249-4a09-ac88-d240d0fd73a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.632577 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37e9a6-0249-4a09-ac88-d240d0fd73a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.632854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37e9a6-0249-4a09-ac88-d240d0fd73a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.633544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37e9a6-0249-4a09-ac88-d240d0fd73a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.635484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37e9a6-0249-4a09-ac88-d240d0fd73a9 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.638118 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93dc7d-ac68-4f5c-b8ad-ace9391e414d admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.642757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e37aed-0bb4-476e-9273-056a90f8a948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.643408 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e37aed-0bb4-476e-9273-056a90f8a948 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.643710 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e37aed-0bb4-476e-9273-056a90f8a948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.643977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e37aed-0bb4-476e-9273-056a90f8a948 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.644655 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e37aed-0bb4-476e-9273-056a90f8a948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.646545 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e37aed-0bb4-476e-9273-056a90f8a948 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.668330 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1327/2665] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:55 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:55.672064 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1339/2666] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:55 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:55.672301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37e9a6-0249-4a09-ac88-d240d0fd73a9 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.673024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e37aed-0bb4-476e-9273-056a90f8a948 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.682431 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e37aed-0bb4-476e-9273-056a90f8a948 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.729934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37e9a6-0249-4a09-ac88-d240d0fd73a9 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.735066 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b09648-9451-4b12-b1e1-af1df379c1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.735724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b09648-9451-4b12-b1e1-af1df379c1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.736005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b09648-9451-4b12-b1e1-af1df379c1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.736489 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b09648-9451-4b12-b1e1-af1df379c1d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.736949 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b09648-9451-4b12-b1e1-af1df379c1d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.738894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b09648-9451-4b12-b1e1-af1df379c1d9 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.739587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bd396-93ae-4f64-a49e-6b6a75849901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.740263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bd396-93ae-4f64-a49e-6b6a75849901 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.740682 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bd396-93ae-4f64-a49e-6b6a75849901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.740991 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bd396-93ae-4f64-a49e-6b6a75849901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.741738 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bd396-93ae-4f64-a49e-6b6a75849901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.743923 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bd396-93ae-4f64-a49e-6b6a75849901 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.755722 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1340/2667] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:55.759835 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bd396-93ae-4f64-a49e-6b6a75849901 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.765748 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1328/2668] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:55 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:50:55.766780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b09648-9451-4b12-b1e1-af1df379c1d9 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.769999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bd396-93ae-4f64-a49e-6b6a75849901 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.774948 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0e5f6-472e-4a22-b58e-8ba56e1c2929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.775814 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0e5f6-472e-4a22-b58e-8ba56e1c2929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.776097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0e5f6-472e-4a22-b58e-8ba56e1c2929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.776909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0e5f6-472e-4a22-b58e-8ba56e1c2929 admin admin] PATH_INFO: `/v3/projects/71f0e936709145a59e1ff754d7f5db73/users/81dfbb99457d4778854688cd5628c4b8/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.777616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b09648-9451-4b12-b1e1-af1df379c1d9 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.782418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e485e-c09c-4510-a9ad-e7f382d3e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.783106 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e485e-c09c-4510-a9ad-e7f382d3e4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.783386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e485e-c09c-4510-a9ad-e7f382d3e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.783657 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e485e-c09c-4510-a9ad-e7f382d3e4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.784373 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e485e-c09c-4510-a9ad-e7f382d3e4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.786003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e485e-c09c-4510-a9ad-e7f382d3e4a1 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.793868 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0e5f6-472e-4a22-b58e-8ba56e1c2929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f0e936709145a59e1ff754d7f5db73, user_id=81dfbb99457d4778854688cd5628c4b8, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.796532 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0e5f6-472e-4a22-b58e-8ba56e1c2929 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.796669 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1329/2669] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:55.800809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e485e-c09c-4510-a9ad-e7f382d3e4a1 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.810850 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e485e-c09c-4510-a9ad-e7f382d3e4a1 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.811973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1341/2670] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:55 2022] PUT /identity/v3/projects/71f0e936709145a59e1ff754d7f5db73/users/81dfbb99457d4778854688cd5628c4b8/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:55.816038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0e5f6-472e-4a22-b58e-8ba56e1c2929 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.867723 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c29fc-1570-456f-92dd-80001f012108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.868389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c29fc-1570-456f-92dd-80001f012108 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.868677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c29fc-1570-456f-92dd-80001f012108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.868951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c29fc-1570-456f-92dd-80001f012108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.869673 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c29fc-1570-456f-92dd-80001f012108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.871441 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c29fc-1570-456f-92dd-80001f012108 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.876033 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0e5f6-472e-4a22-b58e-8ba56e1c2929 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.884531 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1330/2671] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:55.884686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baeb68-72f1-4d78-aa29-80f2b88f8569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.884686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baeb68-72f1-4d78-aa29-80f2b88f8569 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.884686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baeb68-72f1-4d78-aa29-80f2b88f8569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.884686 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baeb68-72f1-4d78-aa29-80f2b88f8569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.885053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8baeb68-72f1-4d78-aa29-80f2b88f8569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.885508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c29fc-1570-456f-92dd-80001f012108 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.886285 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8baeb68-72f1-4d78-aa29-80f2b88f8569 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.895589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c29fc-1570-456f-92dd-80001f012108 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.896896 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1342/2672] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:50:55.901073 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baeb68-72f1-4d78-aa29-80f2b88f8569 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:55.903171 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8870868-b998-4133-ab37-2c43c296b8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.904057 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8870868-b998-4133-ab37-2c43c296b8bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.904341 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8870868-b998-4133-ab37-2c43c296b8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.904618 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8870868-b998-4133-ab37-2c43c296b8bf admin admin] PATH_INFO: `/v3/projects/6947042c96074ec296704102de01374d/users/1d1d72f0e23940e28a3829a1b3501979/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.911314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baeb68-72f1-4d78-aa29-80f2b88f8569 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:55.915807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33501-9a92-4929-8dc5-c477dd9a51f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:55.916662 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33501-9a92-4929-8dc5-c477dd9a51f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.918271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33501-9a92-4929-8dc5-c477dd9a51f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.918271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33501-9a92-4929-8dc5-c477dd9a51f2 admin admin] PATH_INFO: `/v3/projects/71f0e936709145a59e1ff754d7f5db73/users/81dfbb99457d4778854688cd5628c4b8/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.919939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c33501-9a92-4929-8dc5-c477dd9a51f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f0e936709145a59e1ff754d7f5db73, user_id=81dfbb99457d4778854688cd5628c4b8, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.920177 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8870868-b998-4133-ab37-2c43c296b8bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6947042c96074ec296704102de01374d, user_id=1d1d72f0e23940e28a3829a1b3501979, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:55.922478 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c33501-9a92-4929-8dc5-c477dd9a51f2 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.922951 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8870868-b998-4133-ab37-2c43c296b8bf admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:55.932858 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1343/2673] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:55 2022] PUT /identity/v3/projects/71f0e936709145a59e1ff754d7f5db73/users/81dfbb99457d4778854688cd5628c4b8/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:50:55.936156 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1331/2674] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:55 2022] PUT /identity/v3/projects/6947042c96074ec296704102de01374d/users/1d1d72f0e23940e28a3829a1b3501979/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:55.944798 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6b1d0-f2b8-4f1e-8540-9a292f1eb633 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.944798 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6b1d0-f2b8-4f1e-8540-9a292f1eb633 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.944798 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6b1d0-f2b8-4f1e-8540-9a292f1eb633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.946025 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e174f5e-b4a5-4df1-8df2-e4dae967a29d None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:55.946313 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e174f5e-b4a5-4df1-8df2-e4dae967a29d None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:55.946591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e174f5e-b4a5-4df1-8df2-e4dae967a29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:55.970928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-3ab6b1d0-f2b8-4f1e-8540-9a292f1eb633 None None] MFA Rules not processed for user `81dfbb99457d4778854688cd5628c4b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:55.972144 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3ab6b1d0-f2b8-4f1e-8540-9a292f1eb633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:55.972814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-1e174f5e-b4a5-4df1-8df2-e4dae967a29d None None] MFA Rules not processed for user `1d1d72f0e23940e28a3829a1b3501979`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:55.974062 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1e174f5e-b4a5-4df1-8df2-e4dae967a29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:56.038967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1332/2675] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:56.044564 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e174f5e-b4a5-4df1-8df2-e4dae967a29d None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:56.048774 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1344/2676] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:56.065105 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6b1d0-f2b8-4f1e-8540-9a292f1eb633 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:56.065105 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-3ab6b1d0-f2b8-4f1e-8540-9a292f1eb633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:56.108902 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e174f5e-b4a5-4df1-8df2-e4dae967a29d None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:56.113474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1deb4e-d09f-413b-8039-7d807b115a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:56.114124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1deb4e-d09f-413b-8039-7d807b115a2c admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:56.114404 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1deb4e-d09f-413b-8039-7d807b115a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:56.114694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1deb4e-d09f-413b-8039-7d807b115a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:56.115397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1deb4e-d09f-413b-8039-7d807b115a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:56.117287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1deb4e-d09f-413b-8039-7d807b115a2c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:56.119298 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6b1d0-f2b8-4f1e-8540-9a292f1eb633 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:56.123247 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc988f02-a306-4a2c-8dd2-8e87732bf833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:56.123891 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc988f02-a306-4a2c-8dd2-8e87732bf833 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:56.124173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc988f02-a306-4a2c-8dd2-8e87732bf833 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:56.124474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc988f02-a306-4a2c-8dd2-8e87732bf833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:56.134067 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc988f02-a306-4a2c-8dd2-8e87732bf833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:56.136126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc988f02-a306-4a2c-8dd2-8e87732bf833 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:56.146051 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1333/2677] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:56 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:56.146267 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1345/2678] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:50:56.147183 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1deb4e-d09f-413b-8039-7d807b115a2c admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:56.213772 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1deb4e-d09f-413b-8039-7d807b115a2c admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:56.219744 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b016c6c-0af2-458c-9b0b-b545cf52317c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:56.220811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b016c6c-0af2-458c-9b0b-b545cf52317c admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:56.221158 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b016c6c-0af2-458c-9b0b-b545cf52317c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:56.221515 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b016c6c-0af2-458c-9b0b-b545cf52317c admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:56.222354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b016c6c-0af2-458c-9b0b-b545cf52317c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:56.224403 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b016c6c-0af2-458c-9b0b-b545cf52317c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:56.250765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1334/2679] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:56 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:56.251949 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc988f02-a306-4a2c-8dd2-8e87732bf833 service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:56.265317 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc988f02-a306-4a2c-8dd2-8e87732bf833 service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:56.270969 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cbe38-4381-4286-a659-686a24c52fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:56.271936 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cbe38-4381-4286-a659-686a24c52fcb admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:56.272215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cbe38-4381-4286-a659-686a24c52fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:56.272730 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cbe38-4381-4286-a659-686a24c52fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:56.273906 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cbe38-4381-4286-a659-686a24c52fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:56.275945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cbe38-4381-4286-a659-686a24c52fcb admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:56.290648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1346/2680] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:56.296145 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b016c6c-0af2-458c-9b0b-b545cf52317c admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:56.311034 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b016c6c-0af2-458c-9b0b-b545cf52317c admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:56.314097 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01b910-bfb6-4ba6-b273-fb20a57702b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:56.315068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b910-bfb6-4ba6-b273-fb20a57702b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:56.315619 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b910-bfb6-4ba6-b273-fb20a57702b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:56.315904 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b910-bfb6-4ba6-b273-fb20a57702b6 admin admin] PATH_INFO: `/v3/projects/1e1a1a2617a24cfa96a03d33aa3031ac/users/a65801a4fd98498c9cdff331f3e20867/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:56.333215 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01b910-bfb6-4ba6-b273-fb20a57702b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1a1a2617a24cfa96a03d33aa3031ac, user_id=a65801a4fd98498c9cdff331f3e20867, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:56.335940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01b910-bfb6-4ba6-b273-fb20a57702b6 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:56.349922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1335/2681] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:56 2022] PUT /identity/v3/projects/1e1a1a2617a24cfa96a03d33aa3031ac/users/a65801a4fd98498c9cdff331f3e20867/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:56.354157 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cbe38-4381-4286-a659-686a24c52fcb admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:56.364241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cbe38-4381-4286-a659-686a24c52fcb admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:56.421747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290d4e5-61fe-46ae-bec9-0a51d68695ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:56.422413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290d4e5-61fe-46ae-bec9-0a51d68695ec admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:56.422725 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290d4e5-61fe-46ae-bec9-0a51d68695ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:56.423004 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290d4e5-61fe-46ae-bec9-0a51d68695ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:56.423758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290d4e5-61fe-46ae-bec9-0a51d68695ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:56.425400 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290d4e5-61fe-46ae-bec9-0a51d68695ec admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:56.435585 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1347/2682] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:56.439895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01b910-bfb6-4ba6-b273-fb20a57702b6 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:56.451326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01b910-bfb6-4ba6-b273-fb20a57702b6 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:56.456162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251c73c-833d-4fec-b408-7823d0de795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:56.457104 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251c73c-833d-4fec-b408-7823d0de795e admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:56.457426 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251c73c-833d-4fec-b408-7823d0de795e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:56.457712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251c73c-833d-4fec-b408-7823d0de795e admin admin] PATH_INFO: `/v3/projects/1e1a1a2617a24cfa96a03d33aa3031ac/users/a65801a4fd98498c9cdff331f3e20867/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:56.459710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251c73c-833d-4fec-b408-7823d0de795e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1a1a2617a24cfa96a03d33aa3031ac, user_id=a65801a4fd98498c9cdff331f3e20867, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:56.462339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251c73c-833d-4fec-b408-7823d0de795e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:56.473318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1336/2683] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:56 2022] PUT /identity/v3/projects/1e1a1a2617a24cfa96a03d33aa3031ac/users/a65801a4fd98498c9cdff331f3e20867/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:56.486261 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72671b5-e6c9-47e9-a32f-37ed8564c441 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:56.486639 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72671b5-e6c9-47e9-a32f-37ed8564c441 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:56.487044 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72671b5-e6c9-47e9-a32f-37ed8564c441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:56.514304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-c72671b5-e6c9-47e9-a32f-37ed8564c441 None None] MFA Rules not processed for user `a65801a4fd98498c9cdff331f3e20867`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:56.515559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c72671b5-e6c9-47e9-a32f-37ed8564c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:56.593893 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1348/2684] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:56.601746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251c73c-833d-4fec-b408-7823d0de795e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:56.659972 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251c73c-833d-4fec-b408-7823d0de795e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:56.663772 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8070-1bc6-4379-90c3-01075b36fed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:56.664411 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8070-1bc6-4379-90c3-01075b36fed1 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:56.664688 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8070-1bc6-4379-90c3-01075b36fed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:56.664959 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d8070-1bc6-4379-90c3-01075b36fed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:56.669827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72671b5-e6c9-47e9-a32f-37ed8564c441 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:56.671834 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c72671b5-e6c9-47e9-a32f-37ed8564c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:56.676144 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d8070-1bc6-4379-90c3-01075b36fed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:56.677581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d8070-1bc6-4379-90c3-01075b36fed1 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:56.684601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72671b5-e6c9-47e9-a32f-37ed8564c441 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:56.687509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1337/2685] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:56.688504 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0aaf39-e673-4dc1-bea5-1126e7dd74a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:56.689216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aaf39-e673-4dc1-bea5-1126e7dd74a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:56.689637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aaf39-e673-4dc1-bea5-1126e7dd74a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:56.689920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aaf39-e673-4dc1-bea5-1126e7dd74a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:56.691945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8e0aaf39-e673-4dc1-bea5-1126e7dd74a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:56.754654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0aaf39-e673-4dc1-bea5-1126e7dd74a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:56.756124 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0aaf39-e673-4dc1-bea5-1126e7dd74a2 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:56.765045 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1349/2686] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:57.227087 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8070-1bc6-4379-90c3-01075b36fed1 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:57.292813 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d8070-1bc6-4379-90c3-01075b36fed1 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:57.298279 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc82b5-eeed-4eeb-b6ca-693009cdb98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:57.299207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc82b5-eeed-4eeb-b6ca-693009cdb98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:57.299522 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc82b5-eeed-4eeb-b6ca-693009cdb98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:57.299847 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc82b5-eeed-4eeb-b6ca-693009cdb98f admin admin] PATH_INFO: `/v3/users/1d1d72f0e23940e28a3829a1b3501979` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:57.301054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc82b5-eeed-4eeb-b6ca-693009cdb98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d1d72f0e23940e28a3829a1b3501979)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:57.303654 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc82b5-eeed-4eeb-b6ca-693009cdb98f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:57.351105 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2bbc82b5-eeed-4eeb-b6ca-693009cdb98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d1d72f0e23940e28a3829a1b3501979'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:57.351840 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2bbc82b5-eeed-4eeb-b6ca-693009cdb98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d1d72f0e23940e28a3829a1b3501979'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:57.352490 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2bbc82b5-eeed-4eeb-b6ca-693009cdb98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d1d72f0e23940e28a3829a1b3501979'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:57.365266 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2bbc82b5-eeed-4eeb-b6ca-693009cdb98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d1d72f0e23940e28a3829a1b3501979'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:57.372243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-2bbc82b5-eeed-4eeb-b6ca-693009cdb98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d1d72f0e23940e28a3829a1b3501979'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:57.384996 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1338/2687] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:57 2022] DELETE /identity/v3/users/1d1d72f0e23940e28a3829a1b3501979 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:57.389960 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa7b62-766d-46d8-b31e-8838f09427ff None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:57.390466 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa7b62-766d-46d8-b31e-8838f09427ff None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:57.390568 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa7b62-766d-46d8-b31e-8838f09427ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:57.408804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-88aa7b62-766d-46d8-b31e-8838f09427ff None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:57.410093 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-88aa7b62-766d-46d8-b31e-8838f09427ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:57.469790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1350/2688] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:57.480163 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc82b5-eeed-4eeb-b6ca-693009cdb98f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:57.481664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-2bbc82b5-eeed-4eeb-b6ca-693009cdb98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:57.540639 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc82b5-eeed-4eeb-b6ca-693009cdb98f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:57.545124 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216f723-78d7-4a7e-b500-2e3d706c06ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:57.545778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216f723-78d7-4a7e-b500-2e3d706c06ce service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:57.546059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216f723-78d7-4a7e-b500-2e3d706c06ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:57.546334 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216f723-78d7-4a7e-b500-2e3d706c06ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:57.555838 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216f723-78d7-4a7e-b500-2e3d706c06ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:57.557281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216f723-78d7-4a7e-b500-2e3d706c06ce service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:57.567317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1339/2689] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:50:57.833373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa7b62-766d-46d8-b31e-8838f09427ff None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:57.834850 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-88aa7b62-766d-46d8-b31e-8838f09427ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:57.851279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa7b62-766d-46d8-b31e-8838f09427ff None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:57.856842 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:57.857773 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:57.858043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:57.858403 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] PATH_INFO: `/v3/projects/6947042c96074ec296704102de01374d` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:57.859651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6947042c96074ec296704102de01374d)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:57.861650 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:57.908615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6947042c96074ec296704102de01374d', 'request_id': 'req-de9bce2c-ed6f-41c4-bdcf-8c015a978892'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:57.915561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6947042c96074ec296704102de01374d', 'request_id': 'req-de9bce2c-ed6f-41c4-bdcf-8c015a978892'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:57.921356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6947042c96074ec296704102de01374d', 'request_id': 'req-de9bce2c-ed6f-41c4-bdcf-8c015a978892'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:57.932216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] The token cache is being invalidate because project 6947042c96074ec296704102de01374d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:57.932543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:57.933315 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:57.934897 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1351/2690] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:57 2022] DELETE /identity/v3/projects/6947042c96074ec296704102de01374d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:57.938819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216f723-78d7-4a7e-b500-2e3d706c06ce service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:57.949450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216f723-78d7-4a7e-b500-2e3d706c06ce service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:58.003835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebcca4-0b23-4d8a-bb7d-539ecc45ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:58.004619 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebcca4-0b23-4d8a-bb7d-539ecc45ae17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:58.004899 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebcca4-0b23-4d8a-bb7d-539ecc45ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:58.005172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebcca4-0b23-4d8a-bb7d-539ecc45ae17 admin admin] PATH_INFO: `/v3/users/a65801a4fd98498c9cdff331f3e20867` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:58.006339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebcca4-0b23-4d8a-bb7d-539ecc45ae17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65801a4fd98498c9cdff331f3e20867)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:58.008292 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebcca4-0b23-4d8a-bb7d-539ecc45ae17 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:58.053843 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4cebcca4-0b23-4d8a-bb7d-539ecc45ae17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65801a4fd98498c9cdff331f3e20867'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:58.054488 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4cebcca4-0b23-4d8a-bb7d-539ecc45ae17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65801a4fd98498c9cdff331f3e20867'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:58.055119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4cebcca4-0b23-4d8a-bb7d-539ecc45ae17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65801a4fd98498c9cdff331f3e20867'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:58.067309 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4cebcca4-0b23-4d8a-bb7d-539ecc45ae17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65801a4fd98498c9cdff331f3e20867'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:58.075467 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4cebcca4-0b23-4d8a-bb7d-539ecc45ae17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65801a4fd98498c9cdff331f3e20867'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:58.087770 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1340/2691] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:50:57 2022] DELETE /identity/v3/users/a65801a4fd98498c9cdff331f3e20867 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:58.368730 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:58.370730 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:58.384334 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bce2c-ed6f-41c4-bdcf-8c015a978892 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:58.452405 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557cb62-1764-40c5-9d05-62abb52990ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:58.453330 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557cb62-1764-40c5-9d05-62abb52990ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:58.453624 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557cb62-1764-40c5-9d05-62abb52990ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:58.453908 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557cb62-1764-40c5-9d05-62abb52990ed admin admin] PATH_INFO: `/v3/projects/1e1a1a2617a24cfa96a03d33aa3031ac` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:58.455238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557cb62-1764-40c5-9d05-62abb52990ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1a1a2617a24cfa96a03d33aa3031ac)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:58.457185 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557cb62-1764-40c5-9d05-62abb52990ed admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:58.502939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-4557cb62-1764-40c5-9d05-62abb52990ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1a1a2617a24cfa96a03d33aa3031ac', 'request_id': 'req-4557cb62-1764-40c5-9d05-62abb52990ed'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:58.510199 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-4557cb62-1764-40c5-9d05-62abb52990ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1a1a2617a24cfa96a03d33aa3031ac', 'request_id': 'req-4557cb62-1764-40c5-9d05-62abb52990ed'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:58.516179 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-4557cb62-1764-40c5-9d05-62abb52990ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1a1a2617a24cfa96a03d33aa3031ac', 'request_id': 'req-4557cb62-1764-40c5-9d05-62abb52990ed'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:58.527729 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-4557cb62-1764-40c5-9d05-62abb52990ed admin admin] The token cache is being invalidate because project 1e1a1a2617a24cfa96a03d33aa3031ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:50:58.528013 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-4557cb62-1764-40c5-9d05-62abb52990ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:58.528656 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-4557cb62-1764-40c5-9d05-62abb52990ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:50:58.530195 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1352/2692] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:50:58 2022] DELETE /identity/v3/projects/1e1a1a2617a24cfa96a03d33aa3031ac => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:58.536067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f58c7-250a-4a21-95ef-a1ed97fa5b01 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:58.536374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f58c7-250a-4a21-95ef-a1ed97fa5b01 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:58.536651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f58c7-250a-4a21-95ef-a1ed97fa5b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:58.554086 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-101f58c7-250a-4a21-95ef-a1ed97fa5b01 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:58.555342 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-101f58c7-250a-4a21-95ef-a1ed97fa5b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:58.614416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1341/2693] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:58.625344 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463187-034e-4e46-a6f7-8ad991db64e6 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:58.625635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463187-034e-4e46-a6f7-8ad991db64e6 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:58.625906 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463187-034e-4e46-a6f7-8ad991db64e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:58.645284 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-a8463187-034e-4e46-a6f7-8ad991db64e6 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:58.646543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a8463187-034e-4e46-a6f7-8ad991db64e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:58.655793 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1353/2694] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:50:58.660032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f58c7-250a-4a21-95ef-a1ed97fa5b01 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:58.669723 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f58c7-250a-4a21-95ef-a1ed97fa5b01 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:58.674403 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836000c-377e-4a73-9181-4f30409f5876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:58.675110 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836000c-377e-4a73-9181-4f30409f5876 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:58.675372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836000c-377e-4a73-9181-4f30409f5876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:58.675648 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836000c-377e-4a73-9181-4f30409f5876 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:58.676375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836000c-377e-4a73-9181-4f30409f5876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:50:58.676679 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836000c-377e-4a73-9181-4f30409f5876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:58.678270 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836000c-377e-4a73-9181-4f30409f5876 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:58.692808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1342/2695] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:50:58.696946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8463187-034e-4e46-a6f7-8ad991db64e6 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:58.706793 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8463187-034e-4e46-a6f7-8ad991db64e6 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:58.711522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccc1fa-6545-4276-b138-4dfa047538bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:58.712174 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccc1fa-6545-4276-b138-4dfa047538bc admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:58.712456 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccc1fa-6545-4276-b138-4dfa047538bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:58.712728 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccc1fa-6545-4276-b138-4dfa047538bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:58.713424 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccc1fa-6545-4276-b138-4dfa047538bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:58.716179 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccc1fa-6545-4276-b138-4dfa047538bc admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:58.742804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1354/2696] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:50:58 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:58.747672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836000c-377e-4a73-9181-4f30409f5876 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:58.757677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836000c-377e-4a73-9181-4f30409f5876 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:58.817131 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569be60b-5b50-4dd8-b944-f1286f24f4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:58.817794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569be60b-5b50-4dd8-b944-f1286f24f4ea admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:58.818076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569be60b-5b50-4dd8-b944-f1286f24f4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:58.818345 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569be60b-5b50-4dd8-b944-f1286f24f4ea admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:58.819077 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569be60b-5b50-4dd8-b944-f1286f24f4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:58.821294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569be60b-5b50-4dd8-b944-f1286f24f4ea admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:58.841856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1343/2697] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:50:58 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:50:58.845972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccc1fa-6545-4276-b138-4dfa047538bc admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:58.856170 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccc1fa-6545-4276-b138-4dfa047538bc admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:58.860705 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e4fb7-1bfe-452e-9c25-ea814d35ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:58.861348 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4fb7-1bfe-452e-9c25-ea814d35ee0d admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:58.861629 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4fb7-1bfe-452e-9c25-ea814d35ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:58.861909 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4fb7-1bfe-452e-9c25-ea814d35ee0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:58.862622 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e4fb7-1bfe-452e-9c25-ea814d35ee0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:58.864233 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e4fb7-1bfe-452e-9c25-ea814d35ee0d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:58.874886 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1355/2698] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:58.878910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569be60b-5b50-4dd8-b944-f1286f24f4ea admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:58.889367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569be60b-5b50-4dd8-b944-f1286f24f4ea admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:58.893937 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47857770-3553-4c76-a0b1-a952e9e44210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:58.894583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47857770-3553-4c76-a0b1-a952e9e44210 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:58.894916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47857770-3553-4c76-a0b1-a952e9e44210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:58.895220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47857770-3553-4c76-a0b1-a952e9e44210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:58.895938 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47857770-3553-4c76-a0b1-a952e9e44210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:58.897519 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47857770-3553-4c76-a0b1-a952e9e44210 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:58.907705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1344/2699] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:50:58.911925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e4fb7-1bfe-452e-9c25-ea814d35ee0d admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:58.921677 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e4fb7-1bfe-452e-9c25-ea814d35ee0d admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:58.926217 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbb14f-3df3-453b-9930-4a021c4da262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:58.927116 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbb14f-3df3-453b-9930-4a021c4da262 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:58.927395 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbb14f-3df3-453b-9930-4a021c4da262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:58.927844 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbb14f-3df3-453b-9930-4a021c4da262 admin admin] PATH_INFO: `/v3/projects/33191abe2493419b91a6c40da029f81e/users/d14a81fc4dda425ebf8d48fdbf174839/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:58.943659 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbb14f-3df3-453b-9930-4a021c4da262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33191abe2493419b91a6c40da029f81e, user_id=d14a81fc4dda425ebf8d48fdbf174839, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:58.946309 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbb14f-3df3-453b-9930-4a021c4da262 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:58.959120 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1356/2700] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:50:58 2022] PUT /identity/v3/projects/33191abe2493419b91a6c40da029f81e/users/d14a81fc4dda425ebf8d48fdbf174839/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:50:58.970659 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9e53a-09a0-4c67-a88b-c5ea08ab9d82 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:58.971206 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9e53a-09a0-4c67-a88b-c5ea08ab9d82 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:58.971304 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9e53a-09a0-4c67-a88b-c5ea08ab9d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:58.998233 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-5fd9e53a-09a0-4c67-a88b-c5ea08ab9d82 None None] MFA Rules not processed for user `d14a81fc4dda425ebf8d48fdbf174839`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:50:58.999477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-5fd9e53a-09a0-4c67-a88b-c5ea08ab9d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:59.063170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1345/2701] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:50:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:50:59.074062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbb14f-3df3-453b-9930-4a021c4da262 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:50:59.075807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-77cbb14f-3df3-453b-9930-4a021c4da262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:50:59.131888 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbb14f-3df3-453b-9930-4a021c4da262 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:50:59.136183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669ebd3-420d-47eb-9c6e-db45b3dbf0b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:50:59.136912 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669ebd3-420d-47eb-9c6e-db45b3dbf0b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:50:59.137194 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669ebd3-420d-47eb-9c6e-db45b3dbf0b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:50:59.137469 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669ebd3-420d-47eb-9c6e-db45b3dbf0b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:50:59.145856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669ebd3-420d-47eb-9c6e-db45b3dbf0b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:50:59.147306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669ebd3-420d-47eb-9c6e-db45b3dbf0b5 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:50:59.156881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1357/2702] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:50:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:00.507759 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8cd9c-3ed5-4773-a4f8-0bad1535cf25 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:00.508261 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8cd9c-3ed5-4773-a4f8-0bad1535cf25 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:00.508386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8cd9c-3ed5-4773-a4f8-0bad1535cf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:00.525751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-6bf8cd9c-3ed5-4773-a4f8-0bad1535cf25 None None] MFA Rules not processed for user `d14a81fc4dda425ebf8d48fdbf174839`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:00.527672 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-6bf8cd9c-3ed5-4773-a4f8-0bad1535cf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:00.534407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1346/2703] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:00.780418 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669ebd3-420d-47eb-9c6e-db45b3dbf0b5 service cinder] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:00.781903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-0669ebd3-420d-47eb-9c6e-db45b3dbf0b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:00.793873 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669ebd3-420d-47eb-9c6e-db45b3dbf0b5 service cinder] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:00.797588 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac9a15-b30f-49dc-a204-bbe6801cc719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:00.798230 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac9a15-b30f-49dc-a204-bbe6801cc719 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:00.798612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac9a15-b30f-49dc-a204-bbe6801cc719 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:00.798988 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac9a15-b30f-49dc-a204-bbe6801cc719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:00.801165 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a1ac9a15-b30f-49dc-a204-bbe6801cc719 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:00.860510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac9a15-b30f-49dc-a204-bbe6801cc719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:00.861961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac9a15-b30f-49dc-a204-bbe6801cc719 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:00.872304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1358/2704] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:03.078191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8cd9c-3ed5-4773-a4f8-0bad1535cf25 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:03.079769 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-6bf8cd9c-3ed5-4773-a4f8-0bad1535cf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:03.155714 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8cd9c-3ed5-4773-a4f8-0bad1535cf25 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:03.160573 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a584fe-a35e-4c56-bf86-b8bbf213202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:03.161450 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a584fe-a35e-4c56-bf86-b8bbf213202e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:03.161736 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a584fe-a35e-4c56-bf86-b8bbf213202e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:03.162165 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a584fe-a35e-4c56-bf86-b8bbf213202e admin admin] PATH_INFO: `/v3/users/3d742840471a430e9546d562015c5ee3` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:03.163387 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a584fe-a35e-4c56-bf86-b8bbf213202e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d742840471a430e9546d562015c5ee3)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:03.165348 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a584fe-a35e-4c56-bf86-b8bbf213202e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:03.217003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-59a584fe-a35e-4c56-bf86-b8bbf213202e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d742840471a430e9546d562015c5ee3'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:03.217696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-59a584fe-a35e-4c56-bf86-b8bbf213202e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d742840471a430e9546d562015c5ee3'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:03.218589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-59a584fe-a35e-4c56-bf86-b8bbf213202e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d742840471a430e9546d562015c5ee3'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:03.234961 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-59a584fe-a35e-4c56-bf86-b8bbf213202e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d742840471a430e9546d562015c5ee3'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:03.246340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-59a584fe-a35e-4c56-bf86-b8bbf213202e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d742840471a430e9546d562015c5ee3'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:03.261109 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1347/2705] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:51:03 2022] DELETE /identity/v3/users/3d742840471a430e9546d562015c5ee3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:03.265758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fbed2-03a4-4bf3-bb69-e801a774d239 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:03.266292 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fbed2-03a4-4bf3-bb69-e801a774d239 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:03.266292 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fbed2-03a4-4bf3-bb69-e801a774d239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:03.283690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-244fbed2-03a4-4bf3-bb69-e801a774d239 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:03.285161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-244fbed2-03a4-4bf3-bb69-e801a774d239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:03.352341 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1359/2706] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:03.362072 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a584fe-a35e-4c56-bf86-b8bbf213202e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:03.363571 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-59a584fe-a35e-4c56-bf86-b8bbf213202e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:03.422548 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a584fe-a35e-4c56-bf86-b8bbf213202e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:03.426910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9dfc7-a12e-4fe6-9f09-b102273890ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:03.427567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9dfc7-a12e-4fe6-9f09-b102273890ee service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:03.427848 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9dfc7-a12e-4fe6-9f09-b102273890ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:03.428126 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9dfc7-a12e-4fe6-9f09-b102273890ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:03.438140 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9dfc7-a12e-4fe6-9f09-b102273890ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:03.439616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9dfc7-a12e-4fe6-9f09-b102273890ee service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:03.449747 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1348/2707] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:03.770742 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fbed2-03a4-4bf3-bb69-e801a774d239 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:03.779196 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-244fbed2-03a4-4bf3-bb69-e801a774d239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:03.795825 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fbed2-03a4-4bf3-bb69-e801a774d239 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:03.802345 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:03.803566 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:03.804008 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:03.804461 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] PATH_INFO: `/v3/projects/12f75b31805d4251ab2007d343b547ab` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:03.806741 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f75b31805d4251ab2007d343b547ab)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:03.809226 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:03.874327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f75b31805d4251ab2007d343b547ab', 'request_id': 'req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:03.894090 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f75b31805d4251ab2007d343b547ab', 'request_id': 'req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:03.902187 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f75b31805d4251ab2007d343b547ab', 'request_id': 'req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:03.919029 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] The token cache is being invalidate because project 12f75b31805d4251ab2007d343b547ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:51:03.919677 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:03.920540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:03.922518 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1360/2708] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:51:03 2022] DELETE /identity/v3/projects/12f75b31805d4251ab2007d343b547ab => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:03.926511 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9dfc7-a12e-4fe6-9f09-b102273890ee service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:03.939050 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9dfc7-a12e-4fe6-9f09-b102273890ee service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:04.003063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d003af6-dbd0-4f66-b624-cba1f6ac42ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:04.003945 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d003af6-dbd0-4f66-b624-cba1f6ac42ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:04.004221 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d003af6-dbd0-4f66-b624-cba1f6ac42ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:04.004493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d003af6-dbd0-4f66-b624-cba1f6ac42ef admin admin] PATH_INFO: `/v3/users/35cee31ce7a3423ab5b0fdb3870344bc` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:04.005711 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d003af6-dbd0-4f66-b624-cba1f6ac42ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cee31ce7a3423ab5b0fdb3870344bc)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:04.007887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d003af6-dbd0-4f66-b624-cba1f6ac42ef admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:04.063632 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-8d003af6-dbd0-4f66-b624-cba1f6ac42ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cee31ce7a3423ab5b0fdb3870344bc'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.064379 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-8d003af6-dbd0-4f66-b624-cba1f6ac42ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cee31ce7a3423ab5b0fdb3870344bc'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.065003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-8d003af6-dbd0-4f66-b624-cba1f6ac42ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cee31ce7a3423ab5b0fdb3870344bc'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.084718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-8d003af6-dbd0-4f66-b624-cba1f6ac42ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cee31ce7a3423ab5b0fdb3870344bc'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.094520 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-8d003af6-dbd0-4f66-b624-cba1f6ac42ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cee31ce7a3423ab5b0fdb3870344bc'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.108707 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1349/2709] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:51:03 2022] DELETE /identity/v3/users/35cee31ce7a3423ab5b0fdb3870344bc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:04.530713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:04.532145 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:04.554202 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd0c6f-5cb4-491a-86d8-1b4616c85b0f admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:04.621336 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:04.622316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:04.622685 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:04.622972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] PATH_INFO: `/v3/projects/3af5165e82a14f98a731ce2357a8b54d` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:04.624214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af5165e82a14f98a731ce2357a8b54d)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:04.626161 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:04.680253 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af5165e82a14f98a731ce2357a8b54d', 'request_id': 'req-fb2d994e-d62e-4bc4-a506-0f118cd39384'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.688348 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af5165e82a14f98a731ce2357a8b54d', 'request_id': 'req-fb2d994e-d62e-4bc4-a506-0f118cd39384'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.694657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af5165e82a14f98a731ce2357a8b54d', 'request_id': 'req-fb2d994e-d62e-4bc4-a506-0f118cd39384'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.705959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] The token cache is being invalidate because project 3af5165e82a14f98a731ce2357a8b54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:51:04.706240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.706928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.708475 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1361/2710] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:51:04 2022] DELETE /identity/v3/projects/3af5165e82a14f98a731ce2357a8b54d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:04.712524 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d003af6-dbd0-4f66-b624-cba1f6ac42ef admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:04.714002 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-8d003af6-dbd0-4f66-b624-cba1f6ac42ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:04.726984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d003af6-dbd0-4f66-b624-cba1f6ac42ef admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:04.783159 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408ab6d-d859-43c5-97c0-b3553dfcb40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:04.783932 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408ab6d-d859-43c5-97c0-b3553dfcb40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:04.784209 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408ab6d-d859-43c5-97c0-b3553dfcb40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:04.784477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408ab6d-d859-43c5-97c0-b3553dfcb40c admin admin] PATH_INFO: `/v3/users/81dfbb99457d4778854688cd5628c4b8` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:04.785645 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408ab6d-d859-43c5-97c0-b3553dfcb40c admin admin] RBAC: Authorizing `identity:delete_user(user_id=81dfbb99457d4778854688cd5628c4b8)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:04.787592 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408ab6d-d859-43c5-97c0-b3553dfcb40c admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:04.833882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4408ab6d-d859-43c5-97c0-b3553dfcb40c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81dfbb99457d4778854688cd5628c4b8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.834545 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4408ab6d-d859-43c5-97c0-b3553dfcb40c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81dfbb99457d4778854688cd5628c4b8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.835180 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4408ab6d-d859-43c5-97c0-b3553dfcb40c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81dfbb99457d4778854688cd5628c4b8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.847212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4408ab6d-d859-43c5-97c0-b3553dfcb40c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81dfbb99457d4778854688cd5628c4b8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.853745 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-4408ab6d-d859-43c5-97c0-b3553dfcb40c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81dfbb99457d4778854688cd5628c4b8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:04.867036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1350/2711] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:51:04 2022] DELETE /identity/v3/users/81dfbb99457d4778854688cd5628c4b8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:51:05.138785 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:05.140441 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:05.154523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d994e-d62e-4bc4-a506-0f118cd39384 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:05.218944 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:05.219803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:05.220085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:05.220361 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94 admin admin] PATH_INFO: `/v3/projects/71f0e936709145a59e1ff754d7f5db73` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:05.221586 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f0e936709145a59e1ff754d7f5db73)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:05.223540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:05.267599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f0e936709145a59e1ff754d7f5db73', 'request_id': 'req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:05.274631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f0e936709145a59e1ff754d7f5db73', 'request_id': 'req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:05.281121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f0e936709145a59e1ff754d7f5db73', 'request_id': 'req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:05.292183 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94 admin admin] The token cache is being invalidate because project 71f0e936709145a59e1ff754d7f5db73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:51:05.292465 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:05.293099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-cd12dbc5-71e8-404d-8f7a-98d27ffb1b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:05.294653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1362/2712] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:51:05 2022] DELETE /identity/v3/projects/71f0e936709145a59e1ff754d7f5db73 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:05.300622 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affb10e-0e71-4a71-8fc8-7c4205372190 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:05.301076 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affb10e-0e71-4a71-8fc8-7c4205372190 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:05.301174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affb10e-0e71-4a71-8fc8-7c4205372190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:05.318544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-6affb10e-0e71-4a71-8fc8-7c4205372190 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:05.319784 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-6affb10e-0e71-4a71-8fc8-7c4205372190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:05.378310 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1351/2713] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:51:05.387519 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d9456-4597-4e61-a67d-a2666d690014 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:05.387808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d9456-4597-4e61-a67d-a2666d690014 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:05.388087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d9456-4597-4e61-a67d-a2666d690014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:05.408429 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-358d9456-4597-4e61-a67d-a2666d690014 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:05.409646 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-358d9456-4597-4e61-a67d-a2666d690014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:05.418301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1363/2714] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:05.422658 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affb10e-0e71-4a71-8fc8-7c4205372190 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:05.432870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affb10e-0e71-4a71-8fc8-7c4205372190 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:05.437860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6ef7c-0de0-45b4-936e-5cbca01e6231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:05.438090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ef7c-0de0-45b4-936e-5cbca01e6231 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:05.438369 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ef7c-0de0-45b4-936e-5cbca01e6231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:05.438640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ef7c-0de0-45b4-936e-5cbca01e6231 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:05.439389 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6ef7c-0de0-45b4-936e-5cbca01e6231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:51:05.439692 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6ef7c-0de0-45b4-936e-5cbca01e6231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:05.441289 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6ef7c-0de0-45b4-936e-5cbca01e6231 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:05.453349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1352/2715] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:51:05.457757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d9456-4597-4e61-a67d-a2666d690014 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:05.468672 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d9456-4597-4e61-a67d-a2666d690014 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:05.473958 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338f83c-a58f-40d5-9a5a-4a08b9178bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:05.474918 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f83c-a58f-40d5-9a5a-4a08b9178bfe admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:05.475218 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f83c-a58f-40d5-9a5a-4a08b9178bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:05.475498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f83c-a58f-40d5-9a5a-4a08b9178bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:05.476248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338f83c-a58f-40d5-9a5a-4a08b9178bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:05.478350 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338f83c-a58f-40d5-9a5a-4a08b9178bfe admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:05.510944 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1364/2716] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:51:05 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:51:05.512737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6ef7c-0de0-45b4-936e-5cbca01e6231 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:05.522553 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6ef7c-0de0-45b4-936e-5cbca01e6231 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:05.578308 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a354cde-757b-4797-bdb4-7eccfed3c53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:05.578936 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354cde-757b-4797-bdb4-7eccfed3c53d admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:05.579223 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354cde-757b-4797-bdb4-7eccfed3c53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:05.579499 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354cde-757b-4797-bdb4-7eccfed3c53d admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:05.580201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a354cde-757b-4797-bdb4-7eccfed3c53d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:05.582148 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a354cde-757b-4797-bdb4-7eccfed3c53d admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:05.603165 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1353/2717] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:51:05 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:51:05.608131 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338f83c-a58f-40d5-9a5a-4a08b9178bfe admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:05.618737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338f83c-a58f-40d5-9a5a-4a08b9178bfe admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:05.624074 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056dfe0-b848-4af3-8cad-4b56edf1eda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:05.624736 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056dfe0-b848-4af3-8cad-4b56edf1eda7 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:05.625019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056dfe0-b848-4af3-8cad-4b56edf1eda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:05.625293 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056dfe0-b848-4af3-8cad-4b56edf1eda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:05.626017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056dfe0-b848-4af3-8cad-4b56edf1eda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:05.627703 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056dfe0-b848-4af3-8cad-4b56edf1eda7 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:05.639267 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1365/2718] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:05.643537 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a354cde-757b-4797-bdb4-7eccfed3c53d admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:05.654008 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a354cde-757b-4797-bdb4-7eccfed3c53d admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:05.659061 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebea42-f0cd-4e46-ac24-6f2bba9cdb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:05.659739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebea42-f0cd-4e46-ac24-6f2bba9cdb04 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:05.660021 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebea42-f0cd-4e46-ac24-6f2bba9cdb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:05.660293 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebea42-f0cd-4e46-ac24-6f2bba9cdb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:05.661014 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebea42-f0cd-4e46-ac24-6f2bba9cdb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:05.662613 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebea42-f0cd-4e46-ac24-6f2bba9cdb04 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:05.673664 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1354/2719] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:05.677795 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056dfe0-b848-4af3-8cad-4b56edf1eda7 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:05.688472 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056dfe0-b848-4af3-8cad-4b56edf1eda7 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:05.693105 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aedf72-dd9f-4921-91cb-da186bdbee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:05.693988 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aedf72-dd9f-4921-91cb-da186bdbee94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:05.694270 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aedf72-dd9f-4921-91cb-da186bdbee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:05.694545 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aedf72-dd9f-4921-91cb-da186bdbee94 admin admin] PATH_INFO: `/v3/projects/00d016292a72460fb57f48b4cba75f2c/users/f562b63214844178bc245fa33c8fe9c0/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:05.709925 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aedf72-dd9f-4921-91cb-da186bdbee94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d016292a72460fb57f48b4cba75f2c, user_id=f562b63214844178bc245fa33c8fe9c0, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:05.712596 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aedf72-dd9f-4921-91cb-da186bdbee94 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:05.730758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1366/2720] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:51:05 2022] PUT /identity/v3/projects/00d016292a72460fb57f48b4cba75f2c/users/f562b63214844178bc245fa33c8fe9c0/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:05.740435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554711-9ff7-4dc9-b57a-2a891b3e6f10 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:05.740826 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554711-9ff7-4dc9-b57a-2a891b3e6f10 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:05.741056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554711-9ff7-4dc9-b57a-2a891b3e6f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:05.770530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-a8554711-9ff7-4dc9-b57a-2a891b3e6f10 None None] MFA Rules not processed for user `f562b63214844178bc245fa33c8fe9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:05.771811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a8554711-9ff7-4dc9-b57a-2a891b3e6f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:05.844421 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1355/2721] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:05.848905 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aedf72-dd9f-4921-91cb-da186bdbee94 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:05.913411 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aedf72-dd9f-4921-91cb-da186bdbee94 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:05.918911 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180367f-0a9a-43f9-b5e7-5c17f00ec2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:05.919574 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180367f-0a9a-43f9-b5e7-5c17f00ec2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:05.919856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180367f-0a9a-43f9-b5e7-5c17f00ec2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:05.920134 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180367f-0a9a-43f9-b5e7-5c17f00ec2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:05.920869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180367f-0a9a-43f9-b5e7-5c17f00ec2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:05.922795 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180367f-0a9a-43f9-b5e7-5c17f00ec2a9 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:05.949122 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1367/2722] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:51:05 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:51:05.953193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8554711-9ff7-4dc9-b57a-2a891b3e6f10 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:05.963922 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8554711-9ff7-4dc9-b57a-2a891b3e6f10 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:06.022798 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206dffd-440e-4707-a0b4-2a32182e1e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:06.023778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206dffd-440e-4707-a0b4-2a32182e1e1a admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:06.024063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206dffd-440e-4707-a0b4-2a32182e1e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:06.024339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206dffd-440e-4707-a0b4-2a32182e1e1a admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:06.025040 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206dffd-440e-4707-a0b4-2a32182e1e1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:06.027130 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206dffd-440e-4707-a0b4-2a32182e1e1a admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:06.048183 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1356/2723] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:51:05 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:51:06.052302 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180367f-0a9a-43f9-b5e7-5c17f00ec2a9 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:06.063342 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180367f-0a9a-43f9-b5e7-5c17f00ec2a9 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:06.067839 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa110713-d3fa-4a43-b8b3-e4ea489ece35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:06.068640 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa110713-d3fa-4a43-b8b3-e4ea489ece35 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:06.068987 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa110713-d3fa-4a43-b8b3-e4ea489ece35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:06.069263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa110713-d3fa-4a43-b8b3-e4ea489ece35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:06.069976 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa110713-d3fa-4a43-b8b3-e4ea489ece35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:06.071601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa110713-d3fa-4a43-b8b3-e4ea489ece35 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:06.082177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1368/2724] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:06.086259 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206dffd-440e-4707-a0b4-2a32182e1e1a admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:06.096736 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206dffd-440e-4707-a0b4-2a32182e1e1a admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:06.101265 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa3390-15a7-44e3-8846-7eaa6abb600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:06.102138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa3390-15a7-44e3-8846-7eaa6abb600b admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:06.102419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa3390-15a7-44e3-8846-7eaa6abb600b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:06.102753 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa3390-15a7-44e3-8846-7eaa6abb600b admin admin] PATH_INFO: `/v3/projects/b310ad35f95a4b5eb30f4a18131cd71f/users/6b34393b637844c09f60c05992347831/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:06.117721 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa3390-15a7-44e3-8846-7eaa6abb600b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b310ad35f95a4b5eb30f4a18131cd71f, user_id=6b34393b637844c09f60c05992347831, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:06.121042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa3390-15a7-44e3-8846-7eaa6abb600b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:06.133489 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1357/2725] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:51:06 2022] PUT /identity/v3/projects/b310ad35f95a4b5eb30f4a18131cd71f/users/6b34393b637844c09f60c05992347831/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:51:06.137777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa110713-d3fa-4a43-b8b3-e4ea489ece35 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:06.147510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa110713-d3fa-4a43-b8b3-e4ea489ece35 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:06.205730 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa0961-de1c-4b30-aef0-f3e36642983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:06.206394 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa0961-de1c-4b30-aef0-f3e36642983e admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:06.206694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa0961-de1c-4b30-aef0-f3e36642983e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:06.206973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa0961-de1c-4b30-aef0-f3e36642983e admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:06.207718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa0961-de1c-4b30-aef0-f3e36642983e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:06.209297 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa0961-de1c-4b30-aef0-f3e36642983e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:06.219245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1369/2726] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:06.223491 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa3390-15a7-44e3-8846-7eaa6abb600b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:06.234234 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa3390-15a7-44e3-8846-7eaa6abb600b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:06.238995 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e0083-ca0d-47c0-a3e4-465d2eec15dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:06.239882 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e0083-ca0d-47c0-a3e4-465d2eec15dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:06.240162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e0083-ca0d-47c0-a3e4-465d2eec15dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:06.240438 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e0083-ca0d-47c0-a3e4-465d2eec15dd admin admin] PATH_INFO: `/v3/projects/b310ad35f95a4b5eb30f4a18131cd71f/users/6b34393b637844c09f60c05992347831/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:06.242433 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e0083-ca0d-47c0-a3e4-465d2eec15dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b310ad35f95a4b5eb30f4a18131cd71f, user_id=6b34393b637844c09f60c05992347831, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:06.246179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e0083-ca0d-47c0-a3e4-465d2eec15dd admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:06.256612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1358/2727] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:51:06 2022] PUT /identity/v3/projects/b310ad35f95a4b5eb30f4a18131cd71f/users/6b34393b637844c09f60c05992347831/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:06.266889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc9a37-c20b-4eae-a6f5-9b841ed165bd None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:06.267176 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc9a37-c20b-4eae-a6f5-9b841ed165bd None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:06.267452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc9a37-c20b-4eae-a6f5-9b841ed165bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:06.297632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-31fc9a37-c20b-4eae-a6f5-9b841ed165bd None None] MFA Rules not processed for user `6b34393b637844c09f60c05992347831`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:06.298828 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-31fc9a37-c20b-4eae-a6f5-9b841ed165bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:06.370426 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1370/2728] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:06.381400 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e0083-ca0d-47c0-a3e4-465d2eec15dd admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:06.383143 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-671e0083-ca0d-47c0-a3e4-465d2eec15dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:06.440413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e0083-ca0d-47c0-a3e4-465d2eec15dd admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:06.443988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc6981-d6d4-4594-a244-f08a1fb62ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:06.444707 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc6981-d6d4-4594-a244-f08a1fb62ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:06.444986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc6981-d6d4-4594-a244-f08a1fb62ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:06.445263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc6981-d6d4-4594-a244-f08a1fb62ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:06.454303 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc6981-d6d4-4594-a244-f08a1fb62ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:06.455839 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc6981-d6d4-4594-a244-f08a1fb62ec1 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:06.465625 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1359/2729] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:06.593980 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc9a37-c20b-4eae-a6f5-9b841ed165bd None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:06.655990 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc9a37-c20b-4eae-a6f5-9b841ed165bd None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:06.660635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445ea7f-c25f-48b7-8f3a-8b7ce913b78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:06.661507 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ea7f-c25f-48b7-8f3a-8b7ce913b78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:06.661786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ea7f-c25f-48b7-8f3a-8b7ce913b78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:06.662056 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ea7f-c25f-48b7-8f3a-8b7ce913b78f admin admin] PATH_INFO: `/v3/users/f562b63214844178bc245fa33c8fe9c0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:06.663259 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445ea7f-c25f-48b7-8f3a-8b7ce913b78f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f562b63214844178bc245fa33c8fe9c0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:06.665181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445ea7f-c25f-48b7-8f3a-8b7ce913b78f admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:06.720036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e445ea7f-c25f-48b7-8f3a-8b7ce913b78f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f562b63214844178bc245fa33c8fe9c0'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:06.720694 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e445ea7f-c25f-48b7-8f3a-8b7ce913b78f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f562b63214844178bc245fa33c8fe9c0'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:06.732664 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e445ea7f-c25f-48b7-8f3a-8b7ce913b78f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f562b63214844178bc245fa33c8fe9c0'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:06.733291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e445ea7f-c25f-48b7-8f3a-8b7ce913b78f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f562b63214844178bc245fa33c8fe9c0'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:06.739916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-e445ea7f-c25f-48b7-8f3a-8b7ce913b78f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f562b63214844178bc245fa33c8fe9c0'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:06.751942 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1371/2730] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:51:06 2022] DELETE /identity/v3/users/f562b63214844178bc245fa33c8fe9c0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:06.756505 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1fbe3-2e29-403d-b9ea-ef17613f2064 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:06.756779 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1fbe3-2e29-403d-b9ea-ef17613f2064 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:06.757060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1fbe3-2e29-403d-b9ea-ef17613f2064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:06.777610 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-0bc1fbe3-2e29-403d-b9ea-ef17613f2064 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:06.778848 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0bc1fbe3-2e29-403d-b9ea-ef17613f2064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:06.838339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1360/2731] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:06.849669 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445ea7f-c25f-48b7-8f3a-8b7ce913b78f admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:06.851205 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-e445ea7f-c25f-48b7-8f3a-8b7ce913b78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:06.909392 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445ea7f-c25f-48b7-8f3a-8b7ce913b78f admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:06.912882 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab09290-411d-4e60-a97c-f6c929aecd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:06.913515 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09290-411d-4e60-a97c-f6c929aecd23 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:06.913827 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09290-411d-4e60-a97c-f6c929aecd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:06.914099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09290-411d-4e60-a97c-f6c929aecd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:06.923474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab09290-411d-4e60-a97c-f6c929aecd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:06.924940 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab09290-411d-4e60-a97c-f6c929aecd23 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:06.935086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1372/2732] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:07.201968 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1fbe3-2e29-403d-b9ea-ef17613f2064 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:07.203568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0bc1fbe3-2e29-403d-b9ea-ef17613f2064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:07.216666 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1fbe3-2e29-403d-b9ea-ef17613f2064 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:07.221175 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:07.222049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:07.222318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:07.222591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] PATH_INFO: `/v3/projects/00d016292a72460fb57f48b4cba75f2c` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:07.223888 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d016292a72460fb57f48b4cba75f2c)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:07.225797 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:07.271530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d016292a72460fb57f48b4cba75f2c', 'request_id': 'req-63397efc-dce6-4b3a-aa04-c094824613ce'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.279236 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d016292a72460fb57f48b4cba75f2c', 'request_id': 'req-63397efc-dce6-4b3a-aa04-c094824613ce'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.284789 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d016292a72460fb57f48b4cba75f2c', 'request_id': 'req-63397efc-dce6-4b3a-aa04-c094824613ce'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.297000 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] The token cache is being invalidate because project 00d016292a72460fb57f48b4cba75f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:51:07.297281 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.297921 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.299503 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1361/2733] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:51:07 2022] DELETE /identity/v3/projects/00d016292a72460fb57f48b4cba75f2c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:07.303487 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab09290-411d-4e60-a97c-f6c929aecd23 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:07.313031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab09290-411d-4e60-a97c-f6c929aecd23 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:07.371269 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f41b1-6ec1-4fe9-a875-925bb6cb853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:07.372314 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f41b1-6ec1-4fe9-a875-925bb6cb853b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:07.372657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f41b1-6ec1-4fe9-a875-925bb6cb853b admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:07.373016 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f41b1-6ec1-4fe9-a875-925bb6cb853b admin admin] PATH_INFO: `/v3/users/6b34393b637844c09f60c05992347831` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:07.374377 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f41b1-6ec1-4fe9-a875-925bb6cb853b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b34393b637844c09f60c05992347831)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:07.376656 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f41b1-6ec1-4fe9-a875-925bb6cb853b admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:07.426816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-cd7f41b1-6ec1-4fe9-a875-925bb6cb853b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b34393b637844c09f60c05992347831'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.427477 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-cd7f41b1-6ec1-4fe9-a875-925bb6cb853b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b34393b637844c09f60c05992347831'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.439786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-cd7f41b1-6ec1-4fe9-a875-925bb6cb853b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b34393b637844c09f60c05992347831'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.440437 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-cd7f41b1-6ec1-4fe9-a875-925bb6cb853b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b34393b637844c09f60c05992347831'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.447182 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-cd7f41b1-6ec1-4fe9-a875-925bb6cb853b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b34393b637844c09f60c05992347831'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.459631 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1373/2734] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:51:07 2022] DELETE /identity/v3/users/6b34393b637844c09f60c05992347831 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:51:07.731887 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:07.733400 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:07.749693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63397efc-dce6-4b3a-aa04-c094824613ce admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:07.809573 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfc8f5-217b-456e-a134-17816edb2321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:07.810491 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfc8f5-217b-456e-a134-17816edb2321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:07.810812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfc8f5-217b-456e-a134-17816edb2321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:07.811116 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfc8f5-217b-456e-a134-17816edb2321 admin admin] PATH_INFO: `/v3/projects/b310ad35f95a4b5eb30f4a18131cd71f` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:07.812327 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfc8f5-217b-456e-a134-17816edb2321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b310ad35f95a4b5eb30f4a18131cd71f)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:07.814319 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfc8f5-217b-456e-a134-17816edb2321 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:07.862732 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d3dfc8f5-217b-456e-a134-17816edb2321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b310ad35f95a4b5eb30f4a18131cd71f', 'request_id': 'req-d3dfc8f5-217b-456e-a134-17816edb2321'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.871981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d3dfc8f5-217b-456e-a134-17816edb2321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b310ad35f95a4b5eb30f4a18131cd71f', 'request_id': 'req-d3dfc8f5-217b-456e-a134-17816edb2321'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.878893 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d3dfc8f5-217b-456e-a134-17816edb2321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b310ad35f95a4b5eb30f4a18131cd71f', 'request_id': 'req-d3dfc8f5-217b-456e-a134-17816edb2321'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.890407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d3dfc8f5-217b-456e-a134-17816edb2321 admin admin] The token cache is being invalidate because project b310ad35f95a4b5eb30f4a18131cd71f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:51:07.890719 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d3dfc8f5-217b-456e-a134-17816edb2321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.891399 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-d3dfc8f5-217b-456e-a134-17816edb2321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:07.892948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1362/2735] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:51:07 2022] DELETE /identity/v3/projects/b310ad35f95a4b5eb30f4a18131cd71f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:07.897806 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a66bb-9563-4860-af8c-9ab8b5d2e1bf None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:07.898294 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a66bb-9563-4860-af8c-9ab8b5d2e1bf None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:07.898394 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a66bb-9563-4860-af8c-9ab8b5d2e1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:07.916462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-930a66bb-9563-4860-af8c-9ab8b5d2e1bf None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:07.918456 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-930a66bb-9563-4860-af8c-9ab8b5d2e1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:07.974805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1374/2736] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:07.983675 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827475a-e8bb-4f76-841c-0acc39493d8f None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:07.983966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827475a-e8bb-4f76-841c-0acc39493d8f None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:07.984636 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827475a-e8bb-4f76-841c-0acc39493d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.002355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-b827475a-e8bb-4f76-841c-0acc39493d8f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:08.003604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b827475a-e8bb-4f76-841c-0acc39493d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:08.011835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1363/2737] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:08.015915 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a66bb-9563-4860-af8c-9ab8b5d2e1bf None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:08.025531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a66bb-9563-4860-af8c-9ab8b5d2e1bf None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:08.031024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ed712-a80d-491d-860b-64152ab1bceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:08.031675 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed712-a80d-491d-860b-64152ab1bceb admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:08.031956 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed712-a80d-491d-860b-64152ab1bceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:08.032230 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed712-a80d-491d-860b-64152ab1bceb admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.032949 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ed712-a80d-491d-860b-64152ab1bceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:51:08.033253 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ed712-a80d-491d-860b-64152ab1bceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:08.034869 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ed712-a80d-491d-860b-64152ab1bceb admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:08.046772 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1375/2738] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:51:08.050940 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827475a-e8bb-4f76-841c-0acc39493d8f None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:08.060295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827475a-e8bb-4f76-841c-0acc39493d8f None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:08.064889 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff45d2-a287-45a4-9f52-f85661decc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:08.065530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff45d2-a287-45a4-9f52-f85661decc27 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:08.065812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff45d2-a287-45a4-9f52-f85661decc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:08.066087 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff45d2-a287-45a4-9f52-f85661decc27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.066809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff45d2-a287-45a4-9f52-f85661decc27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:08.068710 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff45d2-a287-45a4-9f52-f85661decc27 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:08.094220 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1364/2739] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:51:08 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:51:08.099458 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ed712-a80d-491d-860b-64152ab1bceb admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:08.114932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ed712-a80d-491d-860b-64152ab1bceb admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:08.182842 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5541916-bdc8-4edc-a3cc-75f4d0c8846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:08.183597 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5541916-bdc8-4edc-a3cc-75f4d0c8846c admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:08.183789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5541916-bdc8-4edc-a3cc-75f4d0c8846c admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:08.184061 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5541916-bdc8-4edc-a3cc-75f4d0c8846c admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.184752 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5541916-bdc8-4edc-a3cc-75f4d0c8846c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:08.186664 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5541916-bdc8-4edc-a3cc-75f4d0c8846c admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:08.212114 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1376/2740] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:51:08 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:51:08.217258 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff45d2-a287-45a4-9f52-f85661decc27 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:08.227690 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff45d2-a287-45a4-9f52-f85661decc27 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:08.232927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3922d-6729-47bd-a4e1-8842f3801550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:08.233659 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3922d-6729-47bd-a4e1-8842f3801550 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:08.238977 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3922d-6729-47bd-a4e1-8842f3801550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:08.239261 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3922d-6729-47bd-a4e1-8842f3801550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.240031 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3922d-6729-47bd-a4e1-8842f3801550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:08.242130 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3922d-6729-47bd-a4e1-8842f3801550 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:08.253729 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1365/2741] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:08.257816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5541916-bdc8-4edc-a3cc-75f4d0c8846c admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:08.268803 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5541916-bdc8-4edc-a3cc-75f4d0c8846c admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:08.273991 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da28aa-35fa-4f11-b9b1-82efafe48027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:08.274653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da28aa-35fa-4f11-b9b1-82efafe48027 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:08.274961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da28aa-35fa-4f11-b9b1-82efafe48027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:08.275238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da28aa-35fa-4f11-b9b1-82efafe48027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.275994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da28aa-35fa-4f11-b9b1-82efafe48027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:08.278529 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da28aa-35fa-4f11-b9b1-82efafe48027 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:08.295070 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1377/2742] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:08.298983 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3922d-6729-47bd-a4e1-8842f3801550 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:08.309720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3922d-6729-47bd-a4e1-8842f3801550 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:08.314468 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42400c-fd34-47fb-ac41-e37838fc950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:08.315393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42400c-fd34-47fb-ac41-e37838fc950e admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:08.315677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42400c-fd34-47fb-ac41-e37838fc950e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:08.315979 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42400c-fd34-47fb-ac41-e37838fc950e admin admin] PATH_INFO: `/v3/projects/fa14d2e1e2274c178fa595b0d36a610f/users/0c4470c38b254afdbd841c1b2b32c8fe/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.331880 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42400c-fd34-47fb-ac41-e37838fc950e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa14d2e1e2274c178fa595b0d36a610f, user_id=0c4470c38b254afdbd841c1b2b32c8fe, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:08.334782 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42400c-fd34-47fb-ac41-e37838fc950e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:08.350644 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1366/2743] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:51:08 2022] PUT /identity/v3/projects/fa14d2e1e2274c178fa595b0d36a610f/users/0c4470c38b254afdbd841c1b2b32c8fe/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:08.366747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3775-bec6-4202-a9ec-597f0d3a7415 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:08.367211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3775-bec6-4202-a9ec-597f0d3a7415 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:08.367579 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc3775-bec6-4202-a9ec-597f0d3a7415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.397018 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-9acc3775-bec6-4202-a9ec-597f0d3a7415 None None] MFA Rules not processed for user `0c4470c38b254afdbd841c1b2b32c8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:08.398241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9acc3775-bec6-4202-a9ec-597f0d3a7415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:08.462470 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1378/2744] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:08.468131 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42400c-fd34-47fb-ac41-e37838fc950e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:08.529771 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42400c-fd34-47fb-ac41-e37838fc950e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:08.534323 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bafb3-1e8f-4a53-875b-29510f287c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:08.535011 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bafb3-1e8f-4a53-875b-29510f287c14 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:08.535295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bafb3-1e8f-4a53-875b-29510f287c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:08.535571 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bafb3-1e8f-4a53-875b-29510f287c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.536256 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bafb3-1e8f-4a53-875b-29510f287c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:08.538178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bafb3-1e8f-4a53-875b-29510f287c14 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:08.563562 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1367/2745] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:51:08 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:51:08.567625 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc3775-bec6-4202-a9ec-597f0d3a7415 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:08.579149 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc3775-bec6-4202-a9ec-597f0d3a7415 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:08.642482 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f916d5a-67bc-4b83-a620-8aa52e970cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:08.643189 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f916d5a-67bc-4b83-a620-8aa52e970cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:08.643474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f916d5a-67bc-4b83-a620-8aa52e970cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:08.643747 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f916d5a-67bc-4b83-a620-8aa52e970cbe admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.644455 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f916d5a-67bc-4b83-a620-8aa52e970cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:08.646379 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f916d5a-67bc-4b83-a620-8aa52e970cbe admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:08.669036 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1379/2746] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:51:08 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:51:08.670556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bafb3-1e8f-4a53-875b-29510f287c14 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:08.681308 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bafb3-1e8f-4a53-875b-29510f287c14 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:08.686819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8d40f-6f9f-4d74-9056-5295a54d7fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:08.687491 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d40f-6f9f-4d74-9056-5295a54d7fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:08.687773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d40f-6f9f-4d74-9056-5295a54d7fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:08.688048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d40f-6f9f-4d74-9056-5295a54d7fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.688774 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8d40f-6f9f-4d74-9056-5295a54d7fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:08.690367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8d40f-6f9f-4d74-9056-5295a54d7fdb admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:08.701638 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1368/2747] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:08.705761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f916d5a-67bc-4b83-a620-8aa52e970cbe admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:08.715563 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f916d5a-67bc-4b83-a620-8aa52e970cbe admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:08.720312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f0b47-6afb-424c-8dd6-01b9b92df23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:08.721190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f0b47-6afb-424c-8dd6-01b9b92df23b admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:08.721499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f0b47-6afb-424c-8dd6-01b9b92df23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:08.721790 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f0b47-6afb-424c-8dd6-01b9b92df23b admin admin] PATH_INFO: `/v3/projects/54b67fc9ee754144b24847c610101d61/users/f6aea283a57641ba8566a5cb3d3425ed/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.736121 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f0b47-6afb-424c-8dd6-01b9b92df23b admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b67fc9ee754144b24847c610101d61, user_id=f6aea283a57641ba8566a5cb3d3425ed, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:08.738846 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f0b47-6afb-424c-8dd6-01b9b92df23b admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:08.752664 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1380/2748] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:51:08 2022] PUT /identity/v3/projects/54b67fc9ee754144b24847c610101d61/users/f6aea283a57641ba8566a5cb3d3425ed/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:08.756574 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8d40f-6f9f-4d74-9056-5295a54d7fdb admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:08.767375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8d40f-6f9f-4d74-9056-5295a54d7fdb admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:08.826257 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d408e0-f0be-4cf1-a95c-e85640594820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:08.826956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d408e0-f0be-4cf1-a95c-e85640594820 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:08.827239 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d408e0-f0be-4cf1-a95c-e85640594820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:08.827516 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d408e0-f0be-4cf1-a95c-e85640594820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.828235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d408e0-f0be-4cf1-a95c-e85640594820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:08.829823 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d408e0-f0be-4cf1-a95c-e85640594820 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:08.840835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1369/2749] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:08.845143 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f0b47-6afb-424c-8dd6-01b9b92df23b admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:08.856146 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f0b47-6afb-424c-8dd6-01b9b92df23b admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:08.861299 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ef6e1-323b-4e59-a992-3a33b9749559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:08.862261 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ef6e1-323b-4e59-a992-3a33b9749559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:08.862529 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ef6e1-323b-4e59-a992-3a33b9749559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:08.863006 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ef6e1-323b-4e59-a992-3a33b9749559 admin admin] PATH_INFO: `/v3/projects/54b67fc9ee754144b24847c610101d61/users/f6aea283a57641ba8566a5cb3d3425ed/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.865208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ef6e1-323b-4e59-a992-3a33b9749559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b67fc9ee754144b24847c610101d61, user_id=f6aea283a57641ba8566a5cb3d3425ed, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:08.868180 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ef6e1-323b-4e59-a992-3a33b9749559 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:08.881274 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1381/2750] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:51:08 2022] PUT /identity/v3/projects/54b67fc9ee754144b24847c610101d61/users/f6aea283a57641ba8566a5cb3d3425ed/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:51:08.892255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45131cae-f017-4211-807e-a5d489129d79 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:08.892533 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45131cae-f017-4211-807e-a5d489129d79 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:08.892809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45131cae-f017-4211-807e-a5d489129d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:08.919849 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-45131cae-f017-4211-807e-a5d489129d79 None None] MFA Rules not processed for user `f6aea283a57641ba8566a5cb3d3425ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:08.921060 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-45131cae-f017-4211-807e-a5d489129d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:08.986622 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1370/2751] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:08.998140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ef6e1-323b-4e59-a992-3a33b9749559 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:08.999895 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ab8ef6e1-323b-4e59-a992-3a33b9749559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:09.055615 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ef6e1-323b-4e59-a992-3a33b9749559 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:09.059807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34fd5c-b601-4b28-9227-515ddbafb549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:09.060439 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34fd5c-b601-4b28-9227-515ddbafb549 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:09.060720 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34fd5c-b601-4b28-9227-515ddbafb549 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:09.060994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34fd5c-b601-4b28-9227-515ddbafb549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:09.114503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34fd5c-b601-4b28-9227-515ddbafb549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:09.115960 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34fd5c-b601-4b28-9227-515ddbafb549 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:09.125570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1382/2752] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:13.323726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45131cae-f017-4211-807e-a5d489129d79 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:13.333177 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45131cae-f017-4211-807e-a5d489129d79 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:13.336927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0c4a1-e12d-4827-a27c-75b656e410d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:13.337574 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0c4a1-e12d-4827-a27c-75b656e410d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:13.337858 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0c4a1-e12d-4827-a27c-75b656e410d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:13.338135 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0c4a1-e12d-4827-a27c-75b656e410d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:13.347988 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0c4a1-e12d-4827-a27c-75b656e410d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:13.349503 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0c4a1-e12d-4827-a27c-75b656e410d8 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:13.359489 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1371/2753] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:16.765452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f9f83-b502-4ed6-807b-30f66745a757 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:16.765944 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f9f83-b502-4ed6-807b-30f66745a757 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:16.766054 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f9f83-b502-4ed6-807b-30f66745a757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:16.783680 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-bb4f9f83-b502-4ed6-807b-30f66745a757 None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:16.784856 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-bb4f9f83-b502-4ed6-807b-30f66745a757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:16.838841 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1383/2754] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:51:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:16.885217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0c4a1-e12d-4827-a27c-75b656e410d8 service cinder] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:16.886656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-4fb0c4a1-e12d-4827-a27c-75b656e410d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:16.953493 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0c4a1-e12d-4827-a27c-75b656e410d8 service cinder] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:16.958498 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f48ba-b0cf-4757-af46-1d686ce24a4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:16.959164 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f48ba-b0cf-4757-af46-1d686ce24a4e service swift] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:16.959448 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f48ba-b0cf-4757-af46-1d686ce24a4e service swift] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:16.959722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f48ba-b0cf-4757-af46-1d686ce24a4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:16.967992 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f48ba-b0cf-4757-af46-1d686ce24a4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:16.969619 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f48ba-b0cf-4757-af46-1d686ce24a4e service swift] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:16.977529 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1372/2755] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:51:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:51:17.492929 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb8eb6-e9d7-4504-b185-6fa3a4902e52 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:17.493223 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb8eb6-e9d7-4504-b185-6fa3a4902e52 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:17.493502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb8eb6-e9d7-4504-b185-6fa3a4902e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:17.514287 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-1edb8eb6-e9d7-4504-b185-6fa3a4902e52 None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:17.515587 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-1edb8eb6-e9d7-4504-b185-6fa3a4902e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:17.522994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1384/2756] 10.222.0.76 () {58 vars in 967 bytes} [Thu May 12 17:51:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:17.536651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f48ba-b0cf-4757-af46-1d686ce24a4e service swift] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:17.547820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f48ba-b0cf-4757-af46-1d686ce24a4e service swift] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:17.553556 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253c14e-8ac6-4715-abed-bd2de3efb1e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:17.554197 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253c14e-8ac6-4715-abed-bd2de3efb1e9 service swift] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:17.554479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253c14e-8ac6-4715-abed-bd2de3efb1e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:17.554801 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253c14e-8ac6-4715-abed-bd2de3efb1e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:17.563910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253c14e-8ac6-4715-abed-bd2de3efb1e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:17.565801 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253c14e-8ac6-4715-abed-bd2de3efb1e9 service swift] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:17.575536 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1373/2757] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:51:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:51:17.767930 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129db13-ba32-4e6e-a929-3644aa8f6c41 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:17.768428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129db13-ba32-4e6e-a929-3644aa8f6c41 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:17.768531 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129db13-ba32-4e6e-a929-3644aa8f6c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:17.786119 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-9129db13-ba32-4e6e-a929-3644aa8f6c41 None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:17.787327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9129db13-ba32-4e6e-a929-3644aa8f6c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:17.794501 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1385/2758] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:51:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:17.808003 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253c14e-8ac6-4715-abed-bd2de3efb1e9 service swift] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:17.819374 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253c14e-8ac6-4715-abed-bd2de3efb1e9 service swift] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:17.824191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79ccfd-6524-4a5e-a1bb-2df0f9b3620a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:17.825867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79ccfd-6524-4a5e-a1bb-2df0f9b3620a service swift] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:17.826147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79ccfd-6524-4a5e-a1bb-2df0f9b3620a service swift] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:17.826421 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79ccfd-6524-4a5e-a1bb-2df0f9b3620a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:17.834177 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79ccfd-6524-4a5e-a1bb-2df0f9b3620a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:17.835763 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79ccfd-6524-4a5e-a1bb-2df0f9b3620a service swift] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:17.843635 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1374/2759] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:51:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:51:18.153300 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a268c1-b5f2-44a4-ad72-a39fa95dd1c9 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:18.153841 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a268c1-b5f2-44a4-ad72-a39fa95dd1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:18.153959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a268c1-b5f2-44a4-ad72-a39fa95dd1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:18.172666 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-07a268c1-b5f2-44a4-ad72-a39fa95dd1c9 None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:18.173890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-07a268c1-b5f2-44a4-ad72-a39fa95dd1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:18.181023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1386/2760] 10.222.0.76 () {58 vars in 967 bytes} [Thu May 12 17:51:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:18.193160 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79ccfd-6524-4a5e-a1bb-2df0f9b3620a service swift] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:18.209944 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79ccfd-6524-4a5e-a1bb-2df0f9b3620a service swift] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:18.213979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a268c1-b5f2-44a4-ad72-a39fa95dd1c9 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:18.217629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec690d-4d92-4c6b-8540-8f40a1f38c62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:18.218282 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec690d-4d92-4c6b-8540-8f40a1f38c62 service swift] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:18.218572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec690d-4d92-4c6b-8540-8f40a1f38c62 service swift] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:18.218880 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec690d-4d92-4c6b-8540-8f40a1f38c62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:18.227434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec690d-4d92-4c6b-8540-8f40a1f38c62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:18.229015 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec690d-4d92-4c6b-8540-8f40a1f38c62 service swift] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:18.237812 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1375/2761] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:51:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:51:18.299517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a268c1-b5f2-44a4-ad72-a39fa95dd1c9 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:18.304965 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6787d-8c21-40a6-bc2c-3907769e294b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:18.306195 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6787d-8c21-40a6-bc2c-3907769e294b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:18.306623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6787d-8c21-40a6-bc2c-3907769e294b admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:18.307072 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6787d-8c21-40a6-bc2c-3907769e294b admin admin] PATH_INFO: `/v3/users/0c4470c38b254afdbd841c1b2b32c8fe` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:18.308579 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6787d-8c21-40a6-bc2c-3907769e294b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4470c38b254afdbd841c1b2b32c8fe)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:18.312163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6787d-8c21-40a6-bc2c-3907769e294b admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:18.375863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7cf6787d-8c21-40a6-bc2c-3907769e294b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4470c38b254afdbd841c1b2b32c8fe'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:18.376847 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7cf6787d-8c21-40a6-bc2c-3907769e294b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4470c38b254afdbd841c1b2b32c8fe'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:18.399972 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7cf6787d-8c21-40a6-bc2c-3907769e294b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4470c38b254afdbd841c1b2b32c8fe'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:18.403087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7cf6787d-8c21-40a6-bc2c-3907769e294b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4470c38b254afdbd841c1b2b32c8fe'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:18.412844 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-7cf6787d-8c21-40a6-bc2c-3907769e294b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4470c38b254afdbd841c1b2b32c8fe'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:18.426591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1387/2762] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:51:18 2022] DELETE /identity/v3/users/0c4470c38b254afdbd841c1b2b32c8fe => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:51:18.431213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96865f9-f963-4d56-88b2-77eb2be8762b None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:18.431451 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96865f9-f963-4d56-88b2-77eb2be8762b None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:18.431730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96865f9-f963-4d56-88b2-77eb2be8762b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:18.452629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c96865f9-f963-4d56-88b2-77eb2be8762b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:18.453850 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c96865f9-f963-4d56-88b2-77eb2be8762b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:18.526858 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1376/2763] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:51:18.539000 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6787d-8c21-40a6-bc2c-3907769e294b admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:18.540513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-7cf6787d-8c21-40a6-bc2c-3907769e294b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:18.608031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6787d-8c21-40a6-bc2c-3907769e294b admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:18.612078 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593da3-1219-4181-800a-381bbc56f06e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:18.612724 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593da3-1219-4181-800a-381bbc56f06e service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:18.613016 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593da3-1219-4181-800a-381bbc56f06e service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:18.613271 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593da3-1219-4181-800a-381bbc56f06e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:18.622924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec593da3-1219-4181-800a-381bbc56f06e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:18.624801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec593da3-1219-4181-800a-381bbc56f06e service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:18.635491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1388/2764] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:18.956490 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96865f9-f963-4d56-88b2-77eb2be8762b None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:18.957949 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c96865f9-f963-4d56-88b2-77eb2be8762b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:18.972644 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96865f9-f963-4d56-88b2-77eb2be8762b None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:18.977811 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:18.980432 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:18.981925 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:18.982413 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] PATH_INFO: `/v3/projects/fa14d2e1e2274c178fa595b0d36a610f` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:18.983769 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa14d2e1e2274c178fa595b0d36a610f)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:18.985697 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:19.039764 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa14d2e1e2274c178fa595b0d36a610f', 'request_id': 'req-521709a1-2a62-485a-a3df-09428c0b564f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.048012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa14d2e1e2274c178fa595b0d36a610f', 'request_id': 'req-521709a1-2a62-485a-a3df-09428c0b564f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.054006 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa14d2e1e2274c178fa595b0d36a610f', 'request_id': 'req-521709a1-2a62-485a-a3df-09428c0b564f'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.066030 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] The token cache is being invalidate because project fa14d2e1e2274c178fa595b0d36a610f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:51:19.066194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.066894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.068443 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1377/2765] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:51:18 2022] DELETE /identity/v3/projects/fa14d2e1e2274c178fa595b0d36a610f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:19.072508 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593da3-1219-4181-800a-381bbc56f06e service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:19.086481 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593da3-1219-4181-800a-381bbc56f06e service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:19.149799 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21265eb3-fdf9-40a3-8425-012b869979ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:19.150698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21265eb3-fdf9-40a3-8425-012b869979ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:19.150983 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21265eb3-fdf9-40a3-8425-012b869979ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:19.151252 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21265eb3-fdf9-40a3-8425-012b869979ab admin admin] PATH_INFO: `/v3/users/f6aea283a57641ba8566a5cb3d3425ed` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:19.152425 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21265eb3-fdf9-40a3-8425-012b869979ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6aea283a57641ba8566a5cb3d3425ed)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:19.155209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21265eb3-fdf9-40a3-8425-012b869979ab admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:19.204194 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-21265eb3-fdf9-40a3-8425-012b869979ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6aea283a57641ba8566a5cb3d3425ed'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.204861 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-21265eb3-fdf9-40a3-8425-012b869979ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6aea283a57641ba8566a5cb3d3425ed'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.219522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-21265eb3-fdf9-40a3-8425-012b869979ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6aea283a57641ba8566a5cb3d3425ed'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.219522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-21265eb3-fdf9-40a3-8425-012b869979ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6aea283a57641ba8566a5cb3d3425ed'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.224901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-21265eb3-fdf9-40a3-8425-012b869979ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6aea283a57641ba8566a5cb3d3425ed'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.239178 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1389/2766] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:51:19 2022] DELETE /identity/v3/users/f6aea283a57641ba8566a5cb3d3425ed => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:19.515000 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:19.516454 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:19.532840 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521709a1-2a62-485a-a3df-09428c0b564f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:19.591838 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8a43e-7f83-4823-92b0-09497c8f98c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:19.592693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8a43e-7f83-4823-92b0-09497c8f98c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:19.592975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8a43e-7f83-4823-92b0-09497c8f98c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:19.593247 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8a43e-7f83-4823-92b0-09497c8f98c8 admin admin] PATH_INFO: `/v3/projects/54b67fc9ee754144b24847c610101d61` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:19.594513 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8a43e-7f83-4823-92b0-09497c8f98c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b67fc9ee754144b24847c610101d61)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:19.596597 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8a43e-7f83-4823-92b0-09497c8f98c8 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:19.640973 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-6fc8a43e-7f83-4823-92b0-09497c8f98c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b67fc9ee754144b24847c610101d61', 'request_id': 'req-6fc8a43e-7f83-4823-92b0-09497c8f98c8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.648011 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-6fc8a43e-7f83-4823-92b0-09497c8f98c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b67fc9ee754144b24847c610101d61', 'request_id': 'req-6fc8a43e-7f83-4823-92b0-09497c8f98c8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.654244 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-6fc8a43e-7f83-4823-92b0-09497c8f98c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b67fc9ee754144b24847c610101d61', 'request_id': 'req-6fc8a43e-7f83-4823-92b0-09497c8f98c8'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.665187 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-6fc8a43e-7f83-4823-92b0-09497c8f98c8 admin admin] The token cache is being invalidate because project 54b67fc9ee754144b24847c610101d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:51:19.665472 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-6fc8a43e-7f83-4823-92b0-09497c8f98c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.666102 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-6fc8a43e-7f83-4823-92b0-09497c8f98c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:19.667663 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1378/2767] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:51:19 2022] DELETE /identity/v3/projects/54b67fc9ee754144b24847c610101d61 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:19.673637 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335a9ce-f80f-4aac-b069-2b6f7c1ec2bb None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:19.673922 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335a9ce-f80f-4aac-b069-2b6f7c1ec2bb None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:19.674226 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335a9ce-f80f-4aac-b069-2b6f7c1ec2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:19.692160 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-a335a9ce-f80f-4aac-b069-2b6f7c1ec2bb None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:19.693341 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a335a9ce-f80f-4aac-b069-2b6f7c1ec2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:19.750998 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1390/2768] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:51:19.760115 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01b04a-9814-44ad-a722-ac7488f59e89 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:19.760510 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01b04a-9814-44ad-a722-ac7488f59e89 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:19.760792 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01b04a-9814-44ad-a722-ac7488f59e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:19.779652 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-ac01b04a-9814-44ad-a722-ac7488f59e89 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:19.780841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ac01b04a-9814-44ad-a722-ac7488f59e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:19.788650 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1379/2769] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:19.792753 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335a9ce-f80f-4aac-b069-2b6f7c1ec2bb None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:19.802374 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335a9ce-f80f-4aac-b069-2b6f7c1ec2bb None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:19.808034 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d02d7-9f0f-4343-939a-ee8a677346c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:19.809184 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d02d7-9f0f-4343-939a-ee8a677346c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:19.809570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d02d7-9f0f-4343-939a-ee8a677346c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:19.810094 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d02d7-9f0f-4343-939a-ee8a677346c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:19.810491 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d02d7-9f0f-4343-939a-ee8a677346c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:51:19.810833 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d02d7-9f0f-4343-939a-ee8a677346c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:19.812428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d02d7-9f0f-4343-939a-ee8a677346c9 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:19.825433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1391/2770] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:51:19.830025 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01b04a-9814-44ad-a722-ac7488f59e89 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:19.841841 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01b04a-9814-44ad-a722-ac7488f59e89 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:19.846980 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ceb2e-a3e1-4ea7-b3bf-a563b4dc5eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:19.847782 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ceb2e-a3e1-4ea7-b3bf-a563b4dc5eab admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:19.848199 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ceb2e-a3e1-4ea7-b3bf-a563b4dc5eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:19.848551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ceb2e-a3e1-4ea7-b3bf-a563b4dc5eab admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:19.849312 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ceb2e-a3e1-4ea7-b3bf-a563b4dc5eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:19.851318 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ceb2e-a3e1-4ea7-b3bf-a563b4dc5eab admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:19.879191 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1380/2771] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:51:19 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:51:19.883526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d02d7-9f0f-4343-939a-ee8a677346c9 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:19.893729 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d02d7-9f0f-4343-939a-ee8a677346c9 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:19.953971 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196655c2-31a4-45f2-850b-4e5e039d0627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:19.954639 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196655c2-31a4-45f2-850b-4e5e039d0627 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:19.954962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196655c2-31a4-45f2-850b-4e5e039d0627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:19.955238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196655c2-31a4-45f2-850b-4e5e039d0627 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:19.955928 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196655c2-31a4-45f2-850b-4e5e039d0627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:19.957830 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196655c2-31a4-45f2-850b-4e5e039d0627 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:19.981006 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1392/2772] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:51:19 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:51:19.984915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ceb2e-a3e1-4ea7-b3bf-a563b4dc5eab admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:19.995502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ceb2e-a3e1-4ea7-b3bf-a563b4dc5eab admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:20.001201 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7532a12-69f1-4325-ab58-08a45d4fe385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:20.001816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7532a12-69f1-4325-ab58-08a45d4fe385 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:20.002087 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7532a12-69f1-4325-ab58-08a45d4fe385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:20.002358 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7532a12-69f1-4325-ab58-08a45d4fe385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:20.003173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7532a12-69f1-4325-ab58-08a45d4fe385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:20.004931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7532a12-69f1-4325-ab58-08a45d4fe385 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:20.019397 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1381/2773] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:20.020954 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196655c2-31a4-45f2-850b-4e5e039d0627 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:20.031845 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196655c2-31a4-45f2-850b-4e5e039d0627 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:20.036443 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a71d93-1e22-4667-9a38-3a4e3f66debd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:20.037094 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a71d93-1e22-4667-9a38-3a4e3f66debd admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:20.037375 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a71d93-1e22-4667-9a38-3a4e3f66debd admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:20.037649 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a71d93-1e22-4667-9a38-3a4e3f66debd admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:20.038373 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a71d93-1e22-4667-9a38-3a4e3f66debd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:20.039988 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a71d93-1e22-4667-9a38-3a4e3f66debd admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:20.051124 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1393/2774] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:51:20.055362 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7532a12-69f1-4325-ab58-08a45d4fe385 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:20.065731 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7532a12-69f1-4325-ab58-08a45d4fe385 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:20.070633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cbfee-fb20-4206-b1bf-00bd0c533b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:20.071700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cbfee-fb20-4206-b1bf-00bd0c533b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:20.071985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cbfee-fb20-4206-b1bf-00bd0c533b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:20.072260 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cbfee-fb20-4206-b1bf-00bd0c533b3f admin admin] PATH_INFO: `/v3/projects/86c467b381214ded8731368e747e63e6/users/8c3ee4495925428b8c4f2cee60b93fb6/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:20.087029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cbfee-fb20-4206-b1bf-00bd0c533b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c467b381214ded8731368e747e63e6, user_id=8c3ee4495925428b8c4f2cee60b93fb6, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:20.089651 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cbfee-fb20-4206-b1bf-00bd0c533b3f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:20.102609 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1382/2775] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:51:20 2022] PUT /identity/v3/projects/86c467b381214ded8731368e747e63e6/users/8c3ee4495925428b8c4f2cee60b93fb6/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:20.116474 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5d51f-3d26-42a6-b769-e9e4a4c14238 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:20.117031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5d51f-3d26-42a6-b769-e9e4a4c14238 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:20.117031 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5d51f-3d26-42a6-b769-e9e4a4c14238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:20.144283 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-77f5d51f-3d26-42a6-b769-e9e4a4c14238 None None] MFA Rules not processed for user `8c3ee4495925428b8c4f2cee60b93fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:20.145485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-77f5d51f-3d26-42a6-b769-e9e4a4c14238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:20.211804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1394/2776] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:20.224355 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cbfee-fb20-4206-b1bf-00bd0c533b3f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:20.226048 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-e77cbfee-fb20-4206-b1bf-00bd0c533b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:20.282795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cbfee-fb20-4206-b1bf-00bd0c533b3f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:20.286375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da924f86-d1b0-4338-aa5a-55b883e04d73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:20.287059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da924f86-d1b0-4338-aa5a-55b883e04d73 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:20.287346 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da924f86-d1b0-4338-aa5a-55b883e04d73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:20.287622 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da924f86-d1b0-4338-aa5a-55b883e04d73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:20.296443 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da924f86-d1b0-4338-aa5a-55b883e04d73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:20.297883 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da924f86-d1b0-4338-aa5a-55b883e04d73 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:20.306813 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1383/2777] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:20.371335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5d51f-3d26-42a6-b769-e9e4a4c14238 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:20.373114 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-77f5d51f-3d26-42a6-b769-e9e4a4c14238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:20.444824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5d51f-3d26-42a6-b769-e9e4a4c14238 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:20.450601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9730a5-cbc3-4cbf-97b8-1dc8406a6322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:20.451687 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9730a5-cbc3-4cbf-97b8-1dc8406a6322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:20.451981 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9730a5-cbc3-4cbf-97b8-1dc8406a6322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:20.452240 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9730a5-cbc3-4cbf-97b8-1dc8406a6322 admin admin] PATH_INFO: `/v3/users/d14a81fc4dda425ebf8d48fdbf174839` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:20.453590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9730a5-cbc3-4cbf-97b8-1dc8406a6322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14a81fc4dda425ebf8d48fdbf174839)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:20.455810 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9730a5-cbc3-4cbf-97b8-1dc8406a6322 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:20.502882 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-be9730a5-cbc3-4cbf-97b8-1dc8406a6322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14a81fc4dda425ebf8d48fdbf174839'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:20.503562 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-be9730a5-cbc3-4cbf-97b8-1dc8406a6322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14a81fc4dda425ebf8d48fdbf174839'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:20.517176 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-be9730a5-cbc3-4cbf-97b8-1dc8406a6322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14a81fc4dda425ebf8d48fdbf174839'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:20.518012 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-be9730a5-cbc3-4cbf-97b8-1dc8406a6322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14a81fc4dda425ebf8d48fdbf174839'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:20.525210 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-be9730a5-cbc3-4cbf-97b8-1dc8406a6322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14a81fc4dda425ebf8d48fdbf174839'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:20.538256 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1395/2778] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:51:20 2022] DELETE /identity/v3/users/d14a81fc4dda425ebf8d48fdbf174839 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:20.542960 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998094f-b8b6-4214-be8a-825c5a31c558 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:20.543484 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998094f-b8b6-4214-be8a-825c5a31c558 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:20.543713 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998094f-b8b6-4214-be8a-825c5a31c558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:20.571938 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-b998094f-b8b6-4214-be8a-825c5a31c558 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:20.574399 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b998094f-b8b6-4214-be8a-825c5a31c558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:20.639725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1384/2779] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:20.650193 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9730a5-cbc3-4cbf-97b8-1dc8406a6322 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:20.651708 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-be9730a5-cbc3-4cbf-97b8-1dc8406a6322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:20.709126 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9730a5-cbc3-4cbf-97b8-1dc8406a6322 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:20.712807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be0f7b-90ae-41d9-9026-d150e2f13ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:20.713500 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be0f7b-90ae-41d9-9026-d150e2f13ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:20.713820 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be0f7b-90ae-41d9-9026-d150e2f13ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:20.714139 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be0f7b-90ae-41d9-9026-d150e2f13ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:20.723085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be0f7b-90ae-41d9-9026-d150e2f13ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:20.724510 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be0f7b-90ae-41d9-9026-d150e2f13ab0 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:20.733808 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1396/2780] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:20.900553 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998094f-b8b6-4214-be8a-825c5a31c558 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:20.902128 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b998094f-b8b6-4214-be8a-825c5a31c558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:20.922894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998094f-b8b6-4214-be8a-825c5a31c558 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:20.928237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:20.929070 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:20.929410 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:20.929689 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa admin admin] PATH_INFO: `/v3/projects/33191abe2493419b91a6c40da029f81e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:20.930918 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=33191abe2493419b91a6c40da029f81e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:20.932871 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:20.979294 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33191abe2493419b91a6c40da029f81e', 'request_id': 'req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:20.986966 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33191abe2493419b91a6c40da029f81e', 'request_id': 'req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:20.992363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33191abe2493419b91a6c40da029f81e', 'request_id': 'req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:21.003836 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa admin admin] The token cache is being invalidate because project 33191abe2493419b91a6c40da029f81e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:51:21.004120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:21.004784 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-bc6628c9-8ed9-4014-a2e4-bab9ae2fa7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:21.006322 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1385/2781] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:51:20 2022] DELETE /identity/v3/projects/33191abe2493419b91a6c40da029f81e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:21.011206 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb4d90-34e8-4fca-b272-e1047d1f23bc None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:21.011499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb4d90-34e8-4fca-b272-e1047d1f23bc None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:21.011777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb4d90-34e8-4fca-b272-e1047d1f23bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:21.028979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-12cb4d90-34e8-4fca-b272-e1047d1f23bc None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:21.030173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-12cb4d90-34e8-4fca-b272-e1047d1f23bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:21.095989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1397/2782] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:21.107500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb183d0f-ba14-4288-b9fe-a61b15c02ca5 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:21.107500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb183d0f-ba14-4288-b9fe-a61b15c02ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:21.107500 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb183d0f-ba14-4288-b9fe-a61b15c02ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:21.125217 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-cb183d0f-ba14-4288-b9fe-a61b15c02ca5 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:21.126443 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-cb183d0f-ba14-4288-b9fe-a61b15c02ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:21.135095 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1386/2783] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:21.139399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb4d90-34e8-4fca-b272-e1047d1f23bc None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:21.149605 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb4d90-34e8-4fca-b272-e1047d1f23bc None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:21.154345 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2232570-37c6-49fd-beb1-e13016116ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:21.155048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2232570-37c6-49fd-beb1-e13016116ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:21.155332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2232570-37c6-49fd-beb1-e13016116ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:21.155608 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2232570-37c6-49fd-beb1-e13016116ba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:21.156333 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2232570-37c6-49fd-beb1-e13016116ba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:51:21.156636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2232570-37c6-49fd-beb1-e13016116ba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:21.158214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2232570-37c6-49fd-beb1-e13016116ba9 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:21.170095 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1398/2784] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:51:21.174369 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb183d0f-ba14-4288-b9fe-a61b15c02ca5 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:21.183407 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb183d0f-ba14-4288-b9fe-a61b15c02ca5 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:21.188579 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a6cde-889b-4a55-9a5e-8bb6c73b6a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:21.189219 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6cde-889b-4a55-9a5e-8bb6c73b6a4f admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:21.189502 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6cde-889b-4a55-9a5e-8bb6c73b6a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:21.189777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6cde-889b-4a55-9a5e-8bb6c73b6a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:21.190474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a6cde-889b-4a55-9a5e-8bb6c73b6a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:21.192406 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a6cde-889b-4a55-9a5e-8bb6c73b6a4f admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:21.216939 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1387/2785] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:51:21 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:51:21.221104 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2232570-37c6-49fd-beb1-e13016116ba9 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:21.231616 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2232570-37c6-49fd-beb1-e13016116ba9 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:21.291353 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724ab7c-d9ba-41fe-989c-01ef076a973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:21.292021 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724ab7c-d9ba-41fe-989c-01ef076a973d admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:21.292301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724ab7c-d9ba-41fe-989c-01ef076a973d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:21.292577 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724ab7c-d9ba-41fe-989c-01ef076a973d admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:21.293266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724ab7c-d9ba-41fe-989c-01ef076a973d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:21.295822 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724ab7c-d9ba-41fe-989c-01ef076a973d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:21.315247 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1399/2786] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:51:21 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:51:21.319827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a6cde-889b-4a55-9a5e-8bb6c73b6a4f admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:21.331284 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a6cde-889b-4a55-9a5e-8bb6c73b6a4f admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:21.336238 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e7ec3-3b05-4d5a-afa3-7946fd68e9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:21.336948 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e7ec3-3b05-4d5a-afa3-7946fd68e9da admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:21.337232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e7ec3-3b05-4d5a-afa3-7946fd68e9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:21.337509 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e7ec3-3b05-4d5a-afa3-7946fd68e9da admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:21.338238 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e7ec3-3b05-4d5a-afa3-7946fd68e9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:21.339869 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e7ec3-3b05-4d5a-afa3-7946fd68e9da admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:21.351604 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1388/2787] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:21.355723 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724ab7c-d9ba-41fe-989c-01ef076a973d admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:21.366513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724ab7c-d9ba-41fe-989c-01ef076a973d admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:21.371188 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02d859-3d80-4476-b27a-7a63f5bbb930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:21.371866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02d859-3d80-4476-b27a-7a63f5bbb930 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:21.372291 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02d859-3d80-4476-b27a-7a63f5bbb930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:21.372570 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02d859-3d80-4476-b27a-7a63f5bbb930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:21.373288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02d859-3d80-4476-b27a-7a63f5bbb930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:21.374901 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02d859-3d80-4476-b27a-7a63f5bbb930 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:21.384688 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1400/2788] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:21.389340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e7ec3-3b05-4d5a-afa3-7946fd68e9da admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:21.399399 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e7ec3-3b05-4d5a-afa3-7946fd68e9da admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:21.404633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f04ec-fe21-47bc-acb7-e600931199d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:21.405498 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f04ec-fe21-47bc-acb7-e600931199d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:21.405780 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f04ec-fe21-47bc-acb7-e600931199d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:21.406055 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f04ec-fe21-47bc-acb7-e600931199d0 admin admin] PATH_INFO: `/v3/projects/c3403873c6404cd1a227b411c653126f/users/6ebf6077df894158babed9db4682d730/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:21.420826 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f04ec-fe21-47bc-acb7-e600931199d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3403873c6404cd1a227b411c653126f, user_id=6ebf6077df894158babed9db4682d730, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:21.423551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f04ec-fe21-47bc-acb7-e600931199d0 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:21.436425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1389/2789] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:51:21 2022] PUT /identity/v3/projects/c3403873c6404cd1a227b411c653126f/users/6ebf6077df894158babed9db4682d730/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:51:21.441513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439204c-b06e-46f3-9c0f-1b9874a60c2f None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:21.441796 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439204c-b06e-46f3-9c0f-1b9874a60c2f None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:21.442073 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439204c-b06e-46f3-9c0f-1b9874a60c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:21.459802 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-7439204c-b06e-46f3-9c0f-1b9874a60c2f None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:21.460986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-7439204c-b06e-46f3-9c0f-1b9874a60c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:21.518171 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1401/2790] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:21.528833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f04ec-fe21-47bc-acb7-e600931199d0 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:21.530629 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-730f04ec-fe21-47bc-acb7-e600931199d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:21.586110 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f04ec-fe21-47bc-acb7-e600931199d0 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:21.589595 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c850f04-6244-4bad-8cea-aca0efdbb7e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:21.590766 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850f04-6244-4bad-8cea-aca0efdbb7e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:21.591082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850f04-6244-4bad-8cea-aca0efdbb7e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:21.591391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850f04-6244-4bad-8cea-aca0efdbb7e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:21.600096 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c850f04-6244-4bad-8cea-aca0efdbb7e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:21.601524 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c850f04-6244-4bad-8cea-aca0efdbb7e1 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:21.611976 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1390/2791] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:25.454456 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439204c-b06e-46f3-9c0f-1b9874a60c2f None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:25.455940 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-7439204c-b06e-46f3-9c0f-1b9874a60c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:25.469515 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439204c-b06e-46f3-9c0f-1b9874a60c2f None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:25.485977 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3475595-dfaf-4afe-9144-c52a2702bf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:25.487013 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3475595-dfaf-4afe-9144-c52a2702bf6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:25.487290 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3475595-dfaf-4afe-9144-c52a2702bf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:25.487678 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3475595-dfaf-4afe-9144-c52a2702bf6a admin admin] PATH_INFO: `/v3/users/0e8d0b42d8f049478af5983e4ba6f21c` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:25.488974 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3475595-dfaf-4afe-9144-c52a2702bf6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8d0b42d8f049478af5983e4ba6f21c)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:25.491211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3475595-dfaf-4afe-9144-c52a2702bf6a admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:25.557591 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a3475595-dfaf-4afe-9144-c52a2702bf6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8d0b42d8f049478af5983e4ba6f21c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:25.558320 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a3475595-dfaf-4afe-9144-c52a2702bf6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8d0b42d8f049478af5983e4ba6f21c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:25.572522 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a3475595-dfaf-4afe-9144-c52a2702bf6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8d0b42d8f049478af5983e4ba6f21c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:25.573737 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a3475595-dfaf-4afe-9144-c52a2702bf6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8d0b42d8f049478af5983e4ba6f21c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:25.583038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-a3475595-dfaf-4afe-9144-c52a2702bf6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8d0b42d8f049478af5983e4ba6f21c'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:25.609503 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1402/2792] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:51:25 2022] DELETE /identity/v3/users/0e8d0b42d8f049478af5983e4ba6f21c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:25.611200 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d875b8-022f-4ca4-9d87-9b5c0ce4ef47 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:25.611677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d875b8-022f-4ca4-9d87-9b5c0ce4ef47 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:25.611763 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d875b8-022f-4ca4-9d87-9b5c0ce4ef47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:25.635498 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-b7d875b8-022f-4ca4-9d87-9b5c0ce4ef47 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:25.638249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b7d875b8-022f-4ca4-9d87-9b5c0ce4ef47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:25.667190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84f4b2-836e-41e1-a913-ae05eb2e44cf None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:25.668053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84f4b2-836e-41e1-a913-ae05eb2e44cf None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:25.668994 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84f4b2-836e-41e1-a913-ae05eb2e44cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:25.714927 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-0f84f4b2-836e-41e1-a913-ae05eb2e44cf None None] MFA Rules not processed for user `6ebf6077df894158babed9db4682d730`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:25.716713 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-0f84f4b2-836e-41e1-a913-ae05eb2e44cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:25.728757 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1391/2793] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:25.735463 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d875b8-022f-4ca4-9d87-9b5c0ce4ef47 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:25.737300 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b7d875b8-022f-4ca4-9d87-9b5c0ce4ef47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:25.801203 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d875b8-022f-4ca4-9d87-9b5c0ce4ef47 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:25.806794 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e230d3d-9a55-43ae-9940-00d1dd1806e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:25.807981 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e230d3d-9a55-43ae-9940-00d1dd1806e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:25.808439 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e230d3d-9a55-43ae-9940-00d1dd1806e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:25.809425 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e230d3d-9a55-43ae-9940-00d1dd1806e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:25.810779 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1403/2794] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:51:25.815197 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84f4b2-836e-41e1-a913-ae05eb2e44cf None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:25.816979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-0f84f4b2-836e-41e1-a913-ae05eb2e44cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:25.823273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e230d3d-9a55-43ae-9940-00d1dd1806e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:25.825376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e230d3d-9a55-43ae-9940-00d1dd1806e5 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:25.833502 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84f4b2-836e-41e1-a913-ae05eb2e44cf None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:25.838164 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4f505-bfac-409c-aee5-b7bae689474d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:25.838543 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1392/2795] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:51:25.838863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4f505-bfac-409c-aee5-b7bae689474d admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:25.839142 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4f505-bfac-409c-aee5-b7bae689474d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:25.839413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4f505-bfac-409c-aee5-b7bae689474d admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:25.840843 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4f505-bfac-409c-aee5-b7bae689474d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:25.844141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4f505-bfac-409c-aee5-b7bae689474d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:25.879201 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1404/2796] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:51:25 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:51:25.883049 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e230d3d-9a55-43ae-9940-00d1dd1806e5 service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:25.895803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e230d3d-9a55-43ae-9940-00d1dd1806e5 service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:26.017554 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ced246-1518-4cbe-aa9f-061eef03d958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:26.022969 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ced246-1518-4cbe-aa9f-061eef03d958 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:26.023997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ced246-1518-4cbe-aa9f-061eef03d958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:26.024291 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ced246-1518-4cbe-aa9f-061eef03d958 admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:26.025418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ced246-1518-4cbe-aa9f-061eef03d958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:26.029637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ced246-1518-4cbe-aa9f-061eef03d958 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:26.079742 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1393/2797] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:51:25 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:51:26.081053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4f505-bfac-409c-aee5-b7bae689474d admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:26.098513 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4f505-bfac-409c-aee5-b7bae689474d admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:26.104463 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811fe5f-eb17-4c3e-b257-610a9e7246ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:26.105530 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811fe5f-eb17-4c3e-b257-610a9e7246ca admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:26.106684 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811fe5f-eb17-4c3e-b257-610a9e7246ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:26.107067 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811fe5f-eb17-4c3e-b257-610a9e7246ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:26.107953 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811fe5f-eb17-4c3e-b257-610a9e7246ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:26.109635 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811fe5f-eb17-4c3e-b257-610a9e7246ca admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:26.125954 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1405/2798] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:26.130540 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ced246-1518-4cbe-aa9f-061eef03d958 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:26.144360 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ced246-1518-4cbe-aa9f-061eef03d958 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:26.150379 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431da13c-5008-470d-9c42-daf50fdd5d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:26.151694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431da13c-5008-470d-9c42-daf50fdd5d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:26.152218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431da13c-5008-470d-9c42-daf50fdd5d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:26.153434 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431da13c-5008-470d-9c42-daf50fdd5d28 admin admin] PATH_INFO: `/v3/projects/6e1b536bd26f4425b004bc7cab993e70/users/72ba8ca07ba54553ab8265b9b336b612/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:26.177769 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431da13c-5008-470d-9c42-daf50fdd5d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1b536bd26f4425b004bc7cab993e70, user_id=72ba8ca07ba54553ab8265b9b336b612, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:26.181474 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431da13c-5008-470d-9c42-daf50fdd5d28 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:26.204699 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1394/2799] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:51:26 2022] PUT /identity/v3/projects/6e1b536bd26f4425b004bc7cab993e70/users/72ba8ca07ba54553ab8265b9b336b612/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:26.209489 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811fe5f-eb17-4c3e-b257-610a9e7246ca admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:26.226000 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811fe5f-eb17-4c3e-b257-610a9e7246ca admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:26.280627 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431da13c-5008-470d-9c42-daf50fdd5d28 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:26.282630 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-431da13c-5008-470d-9c42-daf50fdd5d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:26.313208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410f68-83b8-404e-94bf-1de9256fc17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:26.314651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410f68-83b8-404e-94bf-1de9256fc17e admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:26.314970 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410f68-83b8-404e-94bf-1de9256fc17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:26.315248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410f68-83b8-404e-94bf-1de9256fc17e admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:26.315988 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83410f68-83b8-404e-94bf-1de9256fc17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:26.317735 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83410f68-83b8-404e-94bf-1de9256fc17e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:26.329601 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1406/2800] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:26.335669 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410f68-83b8-404e-94bf-1de9256fc17e admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:26.348788 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410f68-83b8-404e-94bf-1de9256fc17e admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:26.353924 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbf753-a7a4-458f-82fe-967223beeaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:26.354866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf753-a7a4-458f-82fe-967223beeaf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:26.355147 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf753-a7a4-458f-82fe-967223beeaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:26.355416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf753-a7a4-458f-82fe-967223beeaf2 admin admin] PATH_INFO: `/v3/projects/6e1b536bd26f4425b004bc7cab993e70/users/72ba8ca07ba54553ab8265b9b336b612/roles/771b8ab3c82647f1a1639fe61486fbe0` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:26.359612 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbf753-a7a4-458f-82fe-967223beeaf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1b536bd26f4425b004bc7cab993e70, user_id=72ba8ca07ba54553ab8265b9b336b612, role_id=771b8ab3c82647f1a1639fe61486fbe0)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:26.362082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431da13c-5008-470d-9c42-daf50fdd5d28 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:26.362326 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbf753-a7a4-458f-82fe-967223beeaf2 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:26.368953 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302f9ee-6ddc-4066-84ed-859277224483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:26.370585 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302f9ee-6ddc-4066-84ed-859277224483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:26.371423 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302f9ee-6ddc-4066-84ed-859277224483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:26.371914 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302f9ee-6ddc-4066-84ed-859277224483 admin admin] PATH_INFO: `/v3/projects/e2cacca967694ec3ade4594dd70ffb18` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:26.373416 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302f9ee-6ddc-4066-84ed-859277224483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2cacca967694ec3ade4594dd70ffb18)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:26.378866 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1407/2801] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:51:26 2022] PUT /identity/v3/projects/6e1b536bd26f4425b004bc7cab993e70/users/72ba8ca07ba54553ab8265b9b336b612/roles/771b8ab3c82647f1a1639fe61486fbe0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:26.379068 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302f9ee-6ddc-4066-84ed-859277224483 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:26.452892 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3302f9ee-6ddc-4066-84ed-859277224483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2cacca967694ec3ade4594dd70ffb18', 'request_id': 'req-3302f9ee-6ddc-4066-84ed-859277224483'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:26.464172 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3302f9ee-6ddc-4066-84ed-859277224483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2cacca967694ec3ade4594dd70ffb18', 'request_id': 'req-3302f9ee-6ddc-4066-84ed-859277224483'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:26.473335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3302f9ee-6ddc-4066-84ed-859277224483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2cacca967694ec3ade4594dd70ffb18', 'request_id': 'req-3302f9ee-6ddc-4066-84ed-859277224483'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:26.491301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3302f9ee-6ddc-4066-84ed-859277224483 admin admin] The token cache is being invalidate because project e2cacca967694ec3ade4594dd70ffb18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:51:26.491693 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3302f9ee-6ddc-4066-84ed-859277224483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:26.492838 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-3302f9ee-6ddc-4066-84ed-859277224483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:26.495307 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1395/2802] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:51:26 2022] DELETE /identity/v3/projects/e2cacca967694ec3ade4594dd70ffb18 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:26.501565 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55cd5d-3da8-45d3-8b1c-55e8521f65e4 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:26.502151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55cd5d-3da8-45d3-8b1c-55e8521f65e4 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:26.502310 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55cd5d-3da8-45d3-8b1c-55e8521f65e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:26.525526 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-4b55cd5d-3da8-45d3-8b1c-55e8521f65e4 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:26.526852 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4b55cd5d-3da8-45d3-8b1c-55e8521f65e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:26.644596 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1408/2803] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:51:26.654196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58f56f-95bc-4ab8-96d3-7a8fdb553c5a None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:26.654820 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58f56f-95bc-4ab8-96d3-7a8fdb553c5a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:26.654921 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58f56f-95bc-4ab8-96d3-7a8fdb553c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:26.681975 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-cb58f56f-95bc-4ab8-96d3-7a8fdb553c5a None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:26.683463 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-cb58f56f-95bc-4ab8-96d3-7a8fdb553c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:26.695232 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1396/2804] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:26.699882 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55cd5d-3da8-45d3-8b1c-55e8521f65e4 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:26.711585 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55cd5d-3da8-45d3-8b1c-55e8521f65e4 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:26.719559 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda8dde-866e-41bf-8a4b-0a997a9ede07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:26.735335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda8dde-866e-41bf-8a4b-0a997a9ede07 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:26.735676 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda8dde-866e-41bf-8a4b-0a997a9ede07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:26.735964 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda8dde-866e-41bf-8a4b-0a997a9ede07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:26.736863 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda8dde-866e-41bf-8a4b-0a997a9ede07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:51:26.737173 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda8dde-866e-41bf-8a4b-0a997a9ede07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:26.739020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda8dde-866e-41bf-8a4b-0a997a9ede07 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:26.756107 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1409/2805] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:51:26.759721 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58f56f-95bc-4ab8-96d3-7a8fdb553c5a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:26.777224 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58f56f-95bc-4ab8-96d3-7a8fdb553c5a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:26.786813 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec2510-5998-4c6e-8491-242d31487b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:26.787835 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec2510-5998-4c6e-8491-242d31487b65 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:26.788427 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec2510-5998-4c6e-8491-242d31487b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:26.788935 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec2510-5998-4c6e-8491-242d31487b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:26.790854 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec2510-5998-4c6e-8491-242d31487b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:26.795155 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec2510-5998-4c6e-8491-242d31487b65 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:26.838173 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1397/2806] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:51:26 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:51:26.840499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda8dde-866e-41bf-8a4b-0a997a9ede07 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:26.853123 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda8dde-866e-41bf-8a4b-0a997a9ede07 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:26.923225 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3e114-0aa9-468b-9200-9682fa4d1a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:26.924063 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e114-0aa9-468b-9200-9682fa4d1a33 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:26.924351 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e114-0aa9-468b-9200-9682fa4d1a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:26.924627 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e114-0aa9-468b-9200-9682fa4d1a33 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:26.925438 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3e114-0aa9-468b-9200-9682fa4d1a33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:26.927420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3e114-0aa9-468b-9200-9682fa4d1a33 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:26.951581 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1410/2807] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:51:26 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:51:26.955589 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec2510-5998-4c6e-8491-242d31487b65 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:26.967080 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec2510-5998-4c6e-8491-242d31487b65 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:26.972987 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b69c74-07b6-4180-b47b-37378f586fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:26.973677 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b69c74-07b6-4180-b47b-37378f586fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:26.973961 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b69c74-07b6-4180-b47b-37378f586fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:26.974241 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b69c74-07b6-4180-b47b-37378f586fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:26.975020 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b69c74-07b6-4180-b47b-37378f586fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:26.976681 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b69c74-07b6-4180-b47b-37378f586fa4 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:26.989703 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1398/2808] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:51:26.993714 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3e114-0aa9-468b-9200-9682fa4d1a33 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:27.004872 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3e114-0aa9-468b-9200-9682fa4d1a33 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:27.013226 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db718e0d-2348-4c8d-aeba-2dd699314722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:27.014019 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db718e0d-2348-4c8d-aeba-2dd699314722 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:27.014916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db718e0d-2348-4c8d-aeba-2dd699314722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:27.014916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db718e0d-2348-4c8d-aeba-2dd699314722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:27.015524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db718e0d-2348-4c8d-aeba-2dd699314722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:27.017209 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db718e0d-2348-4c8d-aeba-2dd699314722 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:27.029628 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1411/2809] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:27.033873 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b69c74-07b6-4180-b47b-37378f586fa4 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:27.047833 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b69c74-07b6-4180-b47b-37378f586fa4 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:27.053579 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29007f7-470d-4022-a1aa-2c8d063d99e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:27.054481 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29007f7-470d-4022-a1aa-2c8d063d99e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:27.054919 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29007f7-470d-4022-a1aa-2c8d063d99e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:27.055131 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29007f7-470d-4022-a1aa-2c8d063d99e2 admin admin] PATH_INFO: `/v3/projects/f5b53c99a9c6413f99c35e6741b97846/users/7ea66631bc174806a9d43955591674ff/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:27.087968 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29007f7-470d-4022-a1aa-2c8d063d99e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b53c99a9c6413f99c35e6741b97846, user_id=7ea66631bc174806a9d43955591674ff, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:27.091640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29007f7-470d-4022-a1aa-2c8d063d99e2 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:27.120204 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1399/2810] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:51:27 2022] PUT /identity/v3/projects/f5b53c99a9c6413f99c35e6741b97846/users/7ea66631bc174806a9d43955591674ff/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:51:27.122707 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f90b0-3a40-4c24-b118-123497ef58a3 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:27.122999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f90b0-3a40-4c24-b118-123497ef58a3 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:27.123275 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f90b0-3a40-4c24-b118-123497ef58a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:27.171190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-577f90b0-3a40-4c24-b118-123497ef58a3 None None] MFA Rules not processed for user `7ea66631bc174806a9d43955591674ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:27.173289 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-577f90b0-3a40-4c24-b118-123497ef58a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:27.286295 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1412/2811] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:27.294058 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29007f7-470d-4022-a1aa-2c8d063d99e2 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:27.296004 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-d29007f7-470d-4022-a1aa-2c8d063d99e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:27.371059 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29007f7-470d-4022-a1aa-2c8d063d99e2 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:27.376620 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c1669-a051-4120-9573-7d4ebaca228d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:27.377286 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c1669-a051-4120-9573-7d4ebaca228d service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:27.377705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c1669-a051-4120-9573-7d4ebaca228d service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:27.377890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c1669-a051-4120-9573-7d4ebaca228d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:27.390542 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c1669-a051-4120-9573-7d4ebaca228d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:27.392178 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c1669-a051-4120-9573-7d4ebaca228d service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:27.402961 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1400/2812] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:27.432177 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f90b0-3a40-4c24-b118-123497ef58a3 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:27.524456 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f90b0-3a40-4c24-b118-123497ef58a3 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:27.534009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34251bdd-5153-4d5a-80b5-9d1149330f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:27.536387 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34251bdd-5153-4d5a-80b5-9d1149330f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:27.536785 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34251bdd-5153-4d5a-80b5-9d1149330f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:27.537961 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34251bdd-5153-4d5a-80b5-9d1149330f70 admin admin] PATH_INFO: `/v3/users/7ea66631bc174806a9d43955591674ff` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:27.541007 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34251bdd-5153-4d5a-80b5-9d1149330f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea66631bc174806a9d43955591674ff)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:27.543804 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34251bdd-5153-4d5a-80b5-9d1149330f70 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:27.609158 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-34251bdd-5153-4d5a-80b5-9d1149330f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea66631bc174806a9d43955591674ff'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:27.610030 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-34251bdd-5153-4d5a-80b5-9d1149330f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea66631bc174806a9d43955591674ff'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:27.629787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-34251bdd-5153-4d5a-80b5-9d1149330f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea66631bc174806a9d43955591674ff'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:27.630540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-34251bdd-5153-4d5a-80b5-9d1149330f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea66631bc174806a9d43955591674ff'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:27.638462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-34251bdd-5153-4d5a-80b5-9d1149330f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea66631bc174806a9d43955591674ff'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:27.656705 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1413/2813] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:51:27 2022] DELETE /identity/v3/users/7ea66631bc174806a9d43955591674ff => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:27.658596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b778a4-c0cc-4eb1-b57e-9f839aa078b7 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:27.659465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b778a4-c0cc-4eb1-b57e-9f839aa078b7 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:27.659916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b778a4-c0cc-4eb1-b57e-9f839aa078b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:27.680247 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-f8b778a4-c0cc-4eb1-b57e-9f839aa078b7 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:27.681591 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f8b778a4-c0cc-4eb1-b57e-9f839aa078b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:27.780375 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1401/2814] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:27.790460 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34251bdd-5153-4d5a-80b5-9d1149330f70 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:27.792155 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-34251bdd-5153-4d5a-80b5-9d1149330f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:27.860517 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34251bdd-5153-4d5a-80b5-9d1149330f70 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:27.864523 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae006d-b3e4-47d8-add0-cec97a5ced83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:27.865278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae006d-b3e4-47d8-add0-cec97a5ced83 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:27.865640 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae006d-b3e4-47d8-add0-cec97a5ced83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:27.865971 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae006d-b3e4-47d8-add0-cec97a5ced83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:27.877098 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae006d-b3e4-47d8-add0-cec97a5ced83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:27.878535 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae006d-b3e4-47d8-add0-cec97a5ced83 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:27.901017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1414/2815] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:28.291704 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b778a4-c0cc-4eb1-b57e-9f839aa078b7 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:28.293581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-f8b778a4-c0cc-4eb1-b57e-9f839aa078b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:28.313339 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b778a4-c0cc-4eb1-b57e-9f839aa078b7 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:28.333122 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:28.334010 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:28.334301 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:28.334578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] PATH_INFO: `/v3/projects/f5b53c99a9c6413f99c35e6741b97846` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:28.336927 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b53c99a9c6413f99c35e6741b97846)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:28.338971 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:28.413247 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b53c99a9c6413f99c35e6741b97846', 'request_id': 'req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:28.425054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b53c99a9c6413f99c35e6741b97846', 'request_id': 'req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:28.431343 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b53c99a9c6413f99c35e6741b97846', 'request_id': 'req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:28.446090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] The token cache is being invalidate because project f5b53c99a9c6413f99c35e6741b97846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:51:28.446090 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:28.447363 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:28.449816 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1402/2816] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:51:28 2022] DELETE /identity/v3/projects/f5b53c99a9c6413f99c35e6741b97846 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:31.435463 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944de08-d510-477c-b44e-7bcdeb2149ab None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:31.435938 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944de08-d510-477c-b44e-7bcdeb2149ab None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:31.436037 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944de08-d510-477c-b44e-7bcdeb2149ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:31.464572 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-a944de08-d510-477c-b44e-7bcdeb2149ab None None] MFA Rules not processed for user `72ba8ca07ba54553ab8265b9b336b612`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:31.466509 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a944de08-d510-477c-b44e-7bcdeb2149ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:31.535884 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1415/2817] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:51:31.548986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:31.550422 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:31.616408 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d6ee3-a136-4905-9ca0-ee06fdd65deb admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:31.620117 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a3ca0-7e85-4dee-833b-d06514a89f4d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a003b6145fb4c5c8919020d9208afa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:31.620770 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a3ca0-7e85-4dee-833b-d06514a89f4d service glance] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:31.621056 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a3ca0-7e85-4dee-833b-d06514a89f4d service glance] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:31.621381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a3ca0-7e85-4dee-833b-d06514a89f4d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:31.623243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-8f4a3ca0-7e85-4dee-833b-d06514a89f4d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:31.695218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a3ca0-7e85-4dee-833b-d06514a89f4d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:31.696718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a3ca0-7e85-4dee-833b-d06514a89f4d service glance] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:31.707382 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1403/2818] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:31.832536 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab5e9c-99ce-4a68-8b35-9a4503670a15 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:31.832824 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab5e9c-99ce-4a68-8b35-9a4503670a15 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:31.833311 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab5e9c-99ce-4a68-8b35-9a4503670a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:31.858260 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-c4ab5e9c-99ce-4a68-8b35-9a4503670a15 None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:31.859590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c4ab5e9c-99ce-4a68-8b35-9a4503670a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:31.926851 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1416/2819] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:51:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:31.935571 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a3ca0-7e85-4dee-833b-d06514a89f4d service glance] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:31.937100 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-8f4a3ca0-7e85-4dee-833b-d06514a89f4d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:32.016315 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a3ca0-7e85-4dee-833b-d06514a89f4d service glance] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:32.021477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87099777-cb71-42fd-926b-f4938c7c1398 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:32.022139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87099777-cb71-42fd-926b-f4938c7c1398 service swift] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:32.022418 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87099777-cb71-42fd-926b-f4938c7c1398 service swift] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:32.022724 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87099777-cb71-42fd-926b-f4938c7c1398 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:32.035799 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87099777-cb71-42fd-926b-f4938c7c1398 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:32.037435 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87099777-cb71-42fd-926b-f4938c7c1398 service swift] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:32.048696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1404/2820] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:51:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:51:38.451446 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab5e9c-99ce-4a68-8b35-9a4503670a15 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:38.452973 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c4ab5e9c-99ce-4a68-8b35-9a4503670a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:38.528796 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab5e9c-99ce-4a68-8b35-9a4503670a15 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:38.533097 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a99e9-6789-407a-9e3e-64094780c954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:38.533962 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a99e9-6789-407a-9e3e-64094780c954 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:38.534590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a99e9-6789-407a-9e3e-64094780c954 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:38.535113 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a99e9-6789-407a-9e3e-64094780c954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:38.537335 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b08a99e9-6789-407a-9e3e-64094780c954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:38.633115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a99e9-6789-407a-9e3e-64094780c954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:38.634777 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a99e9-6789-407a-9e3e-64094780c954 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:38.651821 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1417/2821] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:39.889526 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87099777-cb71-42fd-926b-f4938c7c1398 service swift] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:39.892120 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-87099777-cb71-42fd-926b-f4938c7c1398 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:39.999862 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87099777-cb71-42fd-926b-f4938c7c1398 service swift] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:40.004808 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18ade5-3041-48ce-9158-ab1d6db90510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:40.006250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ade5-3041-48ce-9158-ab1d6db90510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:40.006781 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ade5-3041-48ce-9158-ab1d6db90510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:40.007895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18ade5-3041-48ce-9158-ab1d6db90510 admin admin] PATH_INFO: `/v3/users/8c3ee4495925428b8c4f2cee60b93fb6` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:40.009395 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18ade5-3041-48ce-9158-ab1d6db90510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3ee4495925428b8c4f2cee60b93fb6)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:40.011848 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18ade5-3041-48ce-9158-ab1d6db90510 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:40.098292 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fa18ade5-3041-48ce-9158-ab1d6db90510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3ee4495925428b8c4f2cee60b93fb6'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:40.099290 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fa18ade5-3041-48ce-9158-ab1d6db90510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3ee4495925428b8c4f2cee60b93fb6'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:40.100096 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fa18ade5-3041-48ce-9158-ab1d6db90510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3ee4495925428b8c4f2cee60b93fb6'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:40.131250 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fa18ade5-3041-48ce-9158-ab1d6db90510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3ee4495925428b8c4f2cee60b93fb6'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:40.142121 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-fa18ade5-3041-48ce-9158-ab1d6db90510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3ee4495925428b8c4f2cee60b93fb6'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:40.174354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1405/2822] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:51:39 2022] DELETE /identity/v3/users/8c3ee4495925428b8c4f2cee60b93fb6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:40.180067 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da97b5-e07e-4dc1-b26e-3b6434ecc15b None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:40.180690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da97b5-e07e-4dc1-b26e-3b6434ecc15b None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:40.180932 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da97b5-e07e-4dc1-b26e-3b6434ecc15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:40.233404 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-c8da97b5-e07e-4dc1-b26e-3b6434ecc15b None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:40.234999 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c8da97b5-e07e-4dc1-b26e-3b6434ecc15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:40.420266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1418/2823] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:40.429129 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18ade5-3041-48ce-9158-ab1d6db90510 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:40.431422 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-fa18ade5-3041-48ce-9158-ab1d6db90510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:40.529445 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18ade5-3041-48ce-9158-ab1d6db90510 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:40.533067 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb52c0e-14c7-4909-b00d-e24b6a7460ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:40.533715 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52c0e-14c7-4909-b00d-e24b6a7460ba service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:40.533994 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52c0e-14c7-4909-b00d-e24b6a7460ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:40.534456 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52c0e-14c7-4909-b00d-e24b6a7460ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:40.548291 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb52c0e-14c7-4909-b00d-e24b6a7460ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:40.549837 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb52c0e-14c7-4909-b00d-e24b6a7460ba service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:40.564581 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1406/2824] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:40.951489 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da97b5-e07e-4dc1-b26e-3b6434ecc15b None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:40.953527 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-c8da97b5-e07e-4dc1-b26e-3b6434ecc15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:40.976248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da97b5-e07e-4dc1-b26e-3b6434ecc15b None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:40.988159 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:40.989236 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:40.989676 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:40.990127 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3 admin admin] PATH_INFO: `/v3/projects/86c467b381214ded8731368e747e63e6` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:40.991557 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86c467b381214ded8731368e747e63e6)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:40.994025 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:41.072162 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86c467b381214ded8731368e747e63e6', 'request_id': 'req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:41.090028 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86c467b381214ded8731368e747e63e6', 'request_id': 'req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:41.098569 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86c467b381214ded8731368e747e63e6', 'request_id': 'req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:41.116292 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3 admin admin] The token cache is being invalidate because project 86c467b381214ded8731368e747e63e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:51:41.116989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:41.117832 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f67f3b26-bc24-45e4-91a8-fab1b2ffefc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:41.119801 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1419/2825] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:51:40 2022] DELETE /identity/v3/projects/86c467b381214ded8731368e747e63e6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:41.126162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b71c28-b4d5-4602-bfb9-4d809754e366 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:41.126751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b71c28-b4d5-4602-bfb9-4d809754e366 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:41.126961 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b71c28-b4d5-4602-bfb9-4d809754e366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:41.150802 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-a4b71c28-b4d5-4602-bfb9-4d809754e366 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:41.150802 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-a4b71c28-b4d5-4602-bfb9-4d809754e366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:41.232749 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1407/2826] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:41.241071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71553-e60c-4b41-a2d2-b159ee2594e6 None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:41.241071 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71553-e60c-4b41-a2d2-b159ee2594e6 None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:41.241623 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71553-e60c-4b41-a2d2-b159ee2594e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:41.263383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-f2f71553-e60c-4b41-a2d2-b159ee2594e6 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:41.264691 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f2f71553-e60c-4b41-a2d2-b159ee2594e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:41.282914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1420/2827] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:41.290705 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b71c28-b4d5-4602-bfb9-4d809754e366 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:41.303248 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b71c28-b4d5-4602-bfb9-4d809754e366 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:41.308910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a427e02-8e5f-4cc1-a426-c2aa53a1f007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:41.309706 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a427e02-8e5f-4cc1-a426-c2aa53a1f007 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:41.310212 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a427e02-8e5f-4cc1-a426-c2aa53a1f007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:41.310795 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a427e02-8e5f-4cc1-a426-c2aa53a1f007 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:41.311656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a427e02-8e5f-4cc1-a426-c2aa53a1f007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:51:41.312073 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a427e02-8e5f-4cc1-a426-c2aa53a1f007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:41.313819 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a427e02-8e5f-4cc1-a426-c2aa53a1f007 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:41.329550 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1408/2828] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:51:41.333598 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71553-e60c-4b41-a2d2-b159ee2594e6 None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:41.344776 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71553-e60c-4b41-a2d2-b159ee2594e6 None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:41.350176 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d18b8-c5d7-4bb0-a8a8-a542c4ff75bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:41.351141 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d18b8-c5d7-4bb0-a8a8-a542c4ff75bd admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:41.351739 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d18b8-c5d7-4bb0-a8a8-a542c4ff75bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:41.352136 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d18b8-c5d7-4bb0-a8a8-a542c4ff75bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:41.355992 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d18b8-c5d7-4bb0-a8a8-a542c4ff75bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:41.358214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d18b8-c5d7-4bb0-a8a8-a542c4ff75bd admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:41.410718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1421/2829] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:51:41 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:51:41.414455 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a427e02-8e5f-4cc1-a426-c2aa53a1f007 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:41.429197 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a427e02-8e5f-4cc1-a426-c2aa53a1f007 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:41.514198 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711bbe2-11e8-4209-bd71-df3c6fe5797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:41.514827 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711bbe2-11e8-4209-bd71-df3c6fe5797b admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:41.515109 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711bbe2-11e8-4209-bd71-df3c6fe5797b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:41.515419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711bbe2-11e8-4209-bd71-df3c6fe5797b admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:41.516100 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711bbe2-11e8-4209-bd71-df3c6fe5797b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:41.519661 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711bbe2-11e8-4209-bd71-df3c6fe5797b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:41.589336 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1409/2830] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:51:41 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:51:41.593787 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d18b8-c5d7-4bb0-a8a8-a542c4ff75bd admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:41.609157 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d18b8-c5d7-4bb0-a8a8-a542c4ff75bd admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:41.624504 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e1b05-48bf-46cc-945b-4ea775138704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:41.625745 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e1b05-48bf-46cc-945b-4ea775138704 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:41.626327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e1b05-48bf-46cc-945b-4ea775138704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:41.626899 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e1b05-48bf-46cc-945b-4ea775138704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:41.628062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e1b05-48bf-46cc-945b-4ea775138704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:41.630416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e1b05-48bf-46cc-945b-4ea775138704 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:41.643237 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1422/2831] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:41.647300 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711bbe2-11e8-4209-bd71-df3c6fe5797b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:41.662349 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711bbe2-11e8-4209-bd71-df3c6fe5797b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:41.676451 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fe793-a963-4018-942c-b0dbaccd1e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:41.677022 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe793-a963-4018-942c-b0dbaccd1e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:41.677319 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe793-a963-4018-942c-b0dbaccd1e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:41.677605 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fe793-a963-4018-942c-b0dbaccd1e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:41.678386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fe793-a963-4018-942c-b0dbaccd1e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:41.680210 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fe793-a963-4018-942c-b0dbaccd1e62 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:41.711045 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1410/2832] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:51:41.714945 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e1b05-48bf-46cc-945b-4ea775138704 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:41.729099 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e1b05-48bf-46cc-945b-4ea775138704 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:41.743854 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987407f2-dac6-4c55-ba74-abb73636b27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:41.745268 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987407f2-dac6-4c55-ba74-abb73636b27d admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:41.746616 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987407f2-dac6-4c55-ba74-abb73636b27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:41.747140 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987407f2-dac6-4c55-ba74-abb73636b27d admin admin] PATH_INFO: `/v3/projects/aff764cbe6c94d11bfbb9205ad0face4/users/0cadfb641e8f4c47b9915e02bc2cb0c5/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:41.772382 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987407f2-dac6-4c55-ba74-abb73636b27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff764cbe6c94d11bfbb9205ad0face4, user_id=0cadfb641e8f4c47b9915e02bc2cb0c5, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:41.776407 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987407f2-dac6-4c55-ba74-abb73636b27d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:41.813761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1423/2833] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:51:41 2022] PUT /identity/v3/projects/aff764cbe6c94d11bfbb9205ad0face4/users/0cadfb641e8f4c47b9915e02bc2cb0c5/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:41.818017 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e49b67-a100-409e-8dbb-d0fa4a0cbe30 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:41.818408 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e49b67-a100-409e-8dbb-d0fa4a0cbe30 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:41.819105 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e49b67-a100-409e-8dbb-d0fa4a0cbe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:41.864176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-32e49b67-a100-409e-8dbb-d0fa4a0cbe30 None None] MFA Rules not processed for user `0cadfb641e8f4c47b9915e02bc2cb0c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:41.868931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-32e49b67-a100-409e-8dbb-d0fa4a0cbe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:41.961423 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1411/2834] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:41.973667 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987407f2-dac6-4c55-ba74-abb73636b27d admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:41.976190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-987407f2-dac6-4c55-ba74-abb73636b27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:42.046077 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987407f2-dac6-4c55-ba74-abb73636b27d admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:42.050318 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06fdb8-84df-46cd-83a1-7b9e1ae96086 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a003b6145fb4c5c8919020d9208afa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:42.051024 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06fdb8-84df-46cd-83a1-7b9e1ae96086 service glance] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:42.051306 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06fdb8-84df-46cd-83a1-7b9e1ae96086 service glance] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:42.051582 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06fdb8-84df-46cd-83a1-7b9e1ae96086 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:42.062157 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06fdb8-84df-46cd-83a1-7b9e1ae96086 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:42.068599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06fdb8-84df-46cd-83a1-7b9e1ae96086 service glance] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:42.081789 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1424/2835] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:42.102036 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d83930-78aa-40d6-b534-d7ab811369f2 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:42.102337 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d83930-78aa-40d6-b534-d7ab811369f2 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:42.102642 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d83930-78aa-40d6-b534-d7ab811369f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:42.132226 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-38d83930-78aa-40d6-b534-d7ab811369f2 None None] MFA Rules not processed for user `6ebf6077df894158babed9db4682d730`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:42.139018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-38d83930-78aa-40d6-b534-d7ab811369f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:42.206227 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1412/2836] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:51:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:51:44.430698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06fdb8-84df-46cd-83a1-7b9e1ae96086 service glance] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:44.432166 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ae06fdb8-84df-46cd-83a1-7b9e1ae96086 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:44.490268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d419b6-03d3-467e-918d-97f48a48be0e None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:44.490867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d419b6-03d3-467e-918d-97f48a48be0e None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:44.491006 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d419b6-03d3-467e-918d-97f48a48be0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:44.505115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06fdb8-84df-46cd-83a1-7b9e1ae96086 service glance] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:44.509487 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7cd75-6da4-4907-bf8a-11f500b62bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:44.510384 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7cd75-6da4-4907-bf8a-11f500b62bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:44.510957 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7cd75-6da4-4907-bf8a-11f500b62bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:44.511532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-c2d419b6-03d3-467e-918d-97f48a48be0e None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:51:44.511690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7cd75-6da4-4907-bf8a-11f500b62bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:44.512842 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c2d419b6-03d3-467e-918d-97f48a48be0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:44.513746 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-00d7cd75-6da4-4907-bf8a-11f500b62bb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:44.582190 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1413/2837] 10.222.0.76 () {58 vars in 1009 bytes} [Thu May 12 17:51:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:51:44.596947 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7cd75-6da4-4907-bf8a-11f500b62bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:44.598322 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7cd75-6da4-4907-bf8a-11f500b62bb9 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:44.600236 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d419b6-03d3-467e-918d-97f48a48be0e None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:44.601634 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c2d419b6-03d3-467e-918d-97f48a48be0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:44.614085 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1425/2838] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:51:44.682743 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d419b6-03d3-467e-918d-97f48a48be0e None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:44.689551 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225276-b4ce-443f-82d7-c53ff259704d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:44.690107 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225276-b4ce-443f-82d7-c53ff259704d service swift] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:44.690393 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225276-b4ce-443f-82d7-c53ff259704d service swift] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:44.690692 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225276-b4ce-443f-82d7-c53ff259704d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:44.700572 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12225276-b4ce-443f-82d7-c53ff259704d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:44.706453 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12225276-b4ce-443f-82d7-c53ff259704d service swift] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:44.715910 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1414/2839] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:51:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 17:51:53.327524 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7cd75-6da4-4907-bf8a-11f500b62bb9 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:53.329997 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-00d7cd75-6da4-4907-bf8a-11f500b62bb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:53.345905 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7cd75-6da4-4907-bf8a-11f500b62bb9 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:53.350745 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078b7b3-7879-41a8-a505-e55a72726528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:53.351632 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078b7b3-7879-41a8-a505-e55a72726528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:53.351907 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078b7b3-7879-41a8-a505-e55a72726528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:53.352181 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078b7b3-7879-41a8-a505-e55a72726528 admin admin] PATH_INFO: `/v3/users/2afcd57a10c14963acd187bd2aabb229` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:53.353364 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078b7b3-7879-41a8-a505-e55a72726528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2afcd57a10c14963acd187bd2aabb229)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:53.355465 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078b7b3-7879-41a8-a505-e55a72726528 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:53.411746 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f078b7b3-7879-41a8-a505-e55a72726528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2afcd57a10c14963acd187bd2aabb229'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:53.412515 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f078b7b3-7879-41a8-a505-e55a72726528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2afcd57a10c14963acd187bd2aabb229'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:53.427043 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f078b7b3-7879-41a8-a505-e55a72726528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2afcd57a10c14963acd187bd2aabb229'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:53.427850 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f078b7b3-7879-41a8-a505-e55a72726528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2afcd57a10c14963acd187bd2aabb229'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:53.436881 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f078b7b3-7879-41a8-a505-e55a72726528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2afcd57a10c14963acd187bd2aabb229'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:53.451520 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1426/2840] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:51:53 2022] DELETE /identity/v3/users/2afcd57a10c14963acd187bd2aabb229 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:53.703725 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225276-b4ce-443f-82d7-c53ff259704d service swift] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:53.719235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225276-b4ce-443f-82d7-c53ff259704d service swift] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:53.777588 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:53.778462 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:53.778788 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:53.779054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] PATH_INFO: `/v3/projects/667ee24fd13d4432a040a745bf2a0d0e` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:53.780251 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=667ee24fd13d4432a040a745bf2a0d0e)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:53.782158 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:53.828308 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667ee24fd13d4432a040a745bf2a0d0e', 'request_id': 'req-c11f3384-a06f-425d-b51c-0a02120f0160'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:53.835107 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667ee24fd13d4432a040a745bf2a0d0e', 'request_id': 'req-c11f3384-a06f-425d-b51c-0a02120f0160'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:53.840498 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667ee24fd13d4432a040a745bf2a0d0e', 'request_id': 'req-c11f3384-a06f-425d-b51c-0a02120f0160'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:53.851280 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] The token cache is being invalidate because project 667ee24fd13d4432a040a745bf2a0d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:51:53.851567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:53.852196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:53.853730 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1415/2841] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:51:53 2022] DELETE /identity/v3/projects/667ee24fd13d4432a040a745bf2a0d0e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:53.858214 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078b7b3-7879-41a8-a505-e55a72726528 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:53.859684 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f078b7b3-7879-41a8-a505-e55a72726528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:53.873468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078b7b3-7879-41a8-a505-e55a72726528 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:53.928671 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f896b-11a1-4e44-b3fa-2f18255238ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:53.929458 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f896b-11a1-4e44-b3fa-2f18255238ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:53.929736 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f896b-11a1-4e44-b3fa-2f18255238ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:53.930093 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f896b-11a1-4e44-b3fa-2f18255238ed admin admin] PATH_INFO: `/v3/users/9787d26723ea428d80ce740584600fd9` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:53.931304 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f896b-11a1-4e44-b3fa-2f18255238ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=9787d26723ea428d80ce740584600fd9)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:53.933964 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f896b-11a1-4e44-b3fa-2f18255238ed admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:53.978017 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f62f896b-11a1-4e44-b3fa-2f18255238ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9787d26723ea428d80ce740584600fd9'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:53.978664 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f62f896b-11a1-4e44-b3fa-2f18255238ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9787d26723ea428d80ce740584600fd9'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:53.990613 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f62f896b-11a1-4e44-b3fa-2f18255238ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9787d26723ea428d80ce740584600fd9'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:53.991292 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f62f896b-11a1-4e44-b3fa-2f18255238ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9787d26723ea428d80ce740584600fd9'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:53.998009 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f62f896b-11a1-4e44-b3fa-2f18255238ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9787d26723ea428d80ce740584600fd9'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:54.010195 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1427/2842] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:51:53 2022] DELETE /identity/v3/users/9787d26723ea428d80ce740584600fd9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:51:54.232117 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:51:54.233973 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:51:54.250814 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f3384-a06f-425d-b51c-0a02120f0160 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:51:54.318054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78ce87-b749-4aa6-8b37-a899a2212d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:51:54.318943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78ce87-b749-4aa6-8b37-a899a2212d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:51:54.319231 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78ce87-b749-4aa6-8b37-a899a2212d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:51:54.319511 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78ce87-b749-4aa6-8b37-a899a2212d30 admin admin] PATH_INFO: `/v3/projects/a713f90ee77741869a29b5d07e572178` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:51:54.320746 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78ce87-b749-4aa6-8b37-a899a2212d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a713f90ee77741869a29b5d07e572178)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:51:54.322700 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78ce87-b749-4aa6-8b37-a899a2212d30 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:51:54.375205 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cb78ce87-b749-4aa6-8b37-a899a2212d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a713f90ee77741869a29b5d07e572178', 'request_id': 'req-cb78ce87-b749-4aa6-8b37-a899a2212d30'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:54.386621 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cb78ce87-b749-4aa6-8b37-a899a2212d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a713f90ee77741869a29b5d07e572178', 'request_id': 'req-cb78ce87-b749-4aa6-8b37-a899a2212d30'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:54.395622 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cb78ce87-b749-4aa6-8b37-a899a2212d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a713f90ee77741869a29b5d07e572178', 'request_id': 'req-cb78ce87-b749-4aa6-8b37-a899a2212d30'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:54.412195 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cb78ce87-b749-4aa6-8b37-a899a2212d30 admin admin] The token cache is being invalidate because project a713f90ee77741869a29b5d07e572178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:51:54.412698 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cb78ce87-b749-4aa6-8b37-a899a2212d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:54.413525 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-cb78ce87-b749-4aa6-8b37-a899a2212d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:51:54.415218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1416/2843] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:51:54 2022] DELETE /identity/v3/projects/a713f90ee77741869a29b5d07e572178 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:52:13.505421 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f896b-11a1-4e44-b3fa-2f18255238ed admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:13.506841 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f62f896b-11a1-4e44-b3fa-2f18255238ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:13.519195 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f896b-11a1-4e44-b3fa-2f18255238ed admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:13.573453 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e055506-8645-4b33-b65d-2ff4f5d823bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:13.574316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e055506-8645-4b33-b65d-2ff4f5d823bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:13.574592 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e055506-8645-4b33-b65d-2ff4f5d823bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:13.574887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e055506-8645-4b33-b65d-2ff4f5d823bb admin admin] PATH_INFO: `/v3/users/0cadfb641e8f4c47b9915e02bc2cb0c5` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:13.576063 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e055506-8645-4b33-b65d-2ff4f5d823bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cadfb641e8f4c47b9915e02bc2cb0c5)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:13.578012 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e055506-8645-4b33-b65d-2ff4f5d823bb admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:13.623718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8e055506-8645-4b33-b65d-2ff4f5d823bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cadfb641e8f4c47b9915e02bc2cb0c5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:13.624364 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8e055506-8645-4b33-b65d-2ff4f5d823bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cadfb641e8f4c47b9915e02bc2cb0c5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:13.635764 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8e055506-8645-4b33-b65d-2ff4f5d823bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cadfb641e8f4c47b9915e02bc2cb0c5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:13.636395 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8e055506-8645-4b33-b65d-2ff4f5d823bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cadfb641e8f4c47b9915e02bc2cb0c5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:13.642903 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8e055506-8645-4b33-b65d-2ff4f5d823bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cadfb641e8f4c47b9915e02bc2cb0c5'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:13.656163 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1428/2844] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:52:13 2022] DELETE /identity/v3/users/0cadfb641e8f4c47b9915e02bc2cb0c5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:52:13.660682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58908ca-08e0-43e3-80da-f5861301ee83 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:13.661150 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58908ca-08e0-43e3-80da-f5861301ee83 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:13.661285 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58908ca-08e0-43e3-80da-f5861301ee83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:13.679235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-b58908ca-08e0-43e3-80da-f5861301ee83 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:52:13.680488 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b58908ca-08e0-43e3-80da-f5861301ee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:13.737154 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1417/2845] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:52:13.747767 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e055506-8645-4b33-b65d-2ff4f5d823bb admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:13.749168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8e055506-8645-4b33-b65d-2ff4f5d823bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:13.804353 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e055506-8645-4b33-b65d-2ff4f5d823bb admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:13.808726 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e736d-3ff7-4a99-8700-70b5780eb007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:13.809365 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e736d-3ff7-4a99-8700-70b5780eb007 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:13.809645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e736d-3ff7-4a99-8700-70b5780eb007 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:13.809920 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e736d-3ff7-4a99-8700-70b5780eb007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:13.819190 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e736d-3ff7-4a99-8700-70b5780eb007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:13.820651 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e736d-3ff7-4a99-8700-70b5780eb007 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:13.830288 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1429/2846] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:52:14.087005 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58908ca-08e0-43e3-80da-f5861301ee83 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:14.089376 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-b58908ca-08e0-43e3-80da-f5861301ee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:14.101866 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58908ca-08e0-43e3-80da-f5861301ee83 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:14.109029 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c66b4-11d1-4ab9-b975-6b170258f7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:14.109897 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c66b4-11d1-4ab9-b975-6b170258f7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:14.110176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c66b4-11d1-4ab9-b975-6b170258f7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:14.110461 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c66b4-11d1-4ab9-b975-6b170258f7bb admin admin] PATH_INFO: `/v3/projects/aff764cbe6c94d11bfbb9205ad0face4` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:14.111690 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c66b4-11d1-4ab9-b975-6b170258f7bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff764cbe6c94d11bfbb9205ad0face4)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:14.113633 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c66b4-11d1-4ab9-b975-6b170258f7bb admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:14.161729 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-279c66b4-11d1-4ab9-b975-6b170258f7bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff764cbe6c94d11bfbb9205ad0face4', 'request_id': 'req-279c66b4-11d1-4ab9-b975-6b170258f7bb'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:14.170997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-279c66b4-11d1-4ab9-b975-6b170258f7bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff764cbe6c94d11bfbb9205ad0face4', 'request_id': 'req-279c66b4-11d1-4ab9-b975-6b170258f7bb'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:14.176381 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-279c66b4-11d1-4ab9-b975-6b170258f7bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff764cbe6c94d11bfbb9205ad0face4', 'request_id': 'req-279c66b4-11d1-4ab9-b975-6b170258f7bb'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:14.187295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-279c66b4-11d1-4ab9-b975-6b170258f7bb admin admin] The token cache is being invalidate because project aff764cbe6c94d11bfbb9205ad0face4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:52:14.187578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-279c66b4-11d1-4ab9-b975-6b170258f7bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:14.188214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-279c66b4-11d1-4ab9-b975-6b170258f7bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:14.189779 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1418/2847] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:52:14 2022] DELETE /identity/v3/projects/aff764cbe6c94d11bfbb9205ad0face4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:52:14.195189 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ef25e-b4e1-4c66-b601-d55200d1328c None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:14.195548 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ef25e-b4e1-4c66-b601-d55200d1328c None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:14.195828 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ef25e-b4e1-4c66-b601-d55200d1328c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:14.214414 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-526ef25e-b4e1-4c66-b601-d55200d1328c None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:52:14.215653 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-526ef25e-b4e1-4c66-b601-d55200d1328c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:14.289295 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1430/2848] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:52:14.292906 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e1563-d788-47f2-960e-87912b7db586 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:14.293193 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e1563-d788-47f2-960e-87912b7db586 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:14.293476 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e1563-d788-47f2-960e-87912b7db586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:14.312980 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-648e1563-d788-47f2-960e-87912b7db586 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:52:14.314237 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-648e1563-d788-47f2-960e-87912b7db586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:14.322970 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1419/2849] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:52:14.327484 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ef25e-b4e1-4c66-b601-d55200d1328c None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:14.337674 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ef25e-b4e1-4c66-b601-d55200d1328c None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:14.343266 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694d55b-da55-49c5-a50c-b5eaee961e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:14.344060 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694d55b-da55-49c5-a50c-b5eaee961e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:14.344413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694d55b-da55-49c5-a50c-b5eaee961e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:14.344754 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694d55b-da55-49c5-a50c-b5eaee961e3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:14.345564 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694d55b-da55-49c5-a50c-b5eaee961e3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80138) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:52:14.345946 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694d55b-da55-49c5-a50c-b5eaee961e3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:14.347613 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694d55b-da55-49c5-a50c-b5eaee961e3d admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:14.360462 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1431/2850] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:52:14.364739 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e1563-d788-47f2-960e-87912b7db586 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:14.375359 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e1563-d788-47f2-960e-87912b7db586 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:14.380046 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419bdc3-ce45-41e8-b138-62a82207dd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:14.380781 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419bdc3-ce45-41e8-b138-62a82207dd11 admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:14.381127 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419bdc3-ce45-41e8-b138-62a82207dd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:14.381465 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419bdc3-ce45-41e8-b138-62a82207dd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:14.382235 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419bdc3-ce45-41e8-b138-62a82207dd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:14.384242 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419bdc3-ce45-41e8-b138-62a82207dd11 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:14.414722 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1420/2851] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:52:14 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:52:14.417758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694d55b-da55-49c5-a50c-b5eaee961e3d admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:14.427545 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694d55b-da55-49c5-a50c-b5eaee961e3d admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:14.482238 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbe2a8-6ef0-47b1-8d54-3be83bf124b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:14.482919 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbe2a8-6ef0-47b1-8d54-3be83bf124b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:14.483200 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbe2a8-6ef0-47b1-8d54-3be83bf124b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:14.483468 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbe2a8-6ef0-47b1-8d54-3be83bf124b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:14.484153 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbe2a8-6ef0-47b1-8d54-3be83bf124b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:14.486094 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbe2a8-6ef0-47b1-8d54-3be83bf124b2 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:14.504528 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1432/2852] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:52:14 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:52:14.508779 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419bdc3-ce45-41e8-b138-62a82207dd11 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:14.519504 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419bdc3-ce45-41e8-b138-62a82207dd11 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:14.524272 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d0ed6-7c5e-4200-b7e3-558d5611d016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:14.524923 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d0ed6-7c5e-4200-b7e3-558d5611d016 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:14.525214 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d0ed6-7c5e-4200-b7e3-558d5611d016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:14.526135 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d0ed6-7c5e-4200-b7e3-558d5611d016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:14.526890 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d0ed6-7c5e-4200-b7e3-558d5611d016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:14.528478 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d0ed6-7c5e-4200-b7e3-558d5611d016 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:14.539615 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1421/2853] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:52:14.543669 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbe2a8-6ef0-47b1-8d54-3be83bf124b2 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:14.553916 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbe2a8-6ef0-47b1-8d54-3be83bf124b2 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:14.558698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00249c9f-cb98-414c-b0cf-147b11bc37d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:14.559383 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00249c9f-cb98-414c-b0cf-147b11bc37d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:14.559665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00249c9f-cb98-414c-b0cf-147b11bc37d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:14.559943 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00249c9f-cb98-414c-b0cf-147b11bc37d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:14.560665 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00249c9f-cb98-414c-b0cf-147b11bc37d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:14.562280 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00249c9f-cb98-414c-b0cf-147b11bc37d3 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:14.572805 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1433/2854] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:52:14.576829 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d0ed6-7c5e-4200-b7e3-558d5611d016 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:14.586637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d0ed6-7c5e-4200-b7e3-558d5611d016 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:14.591342 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ff2b3-8b2d-41e9-8645-9f7f85814a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:14.592207 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ff2b3-8b2d-41e9-8645-9f7f85814a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:14.592485 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ff2b3-8b2d-41e9-8645-9f7f85814a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:14.592758 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ff2b3-8b2d-41e9-8645-9f7f85814a3e admin admin] PATH_INFO: `/v3/projects/e26e647ec73448299c0695d68b7de677/users/bee03d5265dc4386b3316a7a354902a6/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:14.607044 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ff2b3-8b2d-41e9-8645-9f7f85814a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26e647ec73448299c0695d68b7de677, user_id=bee03d5265dc4386b3316a7a354902a6, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:14.609682 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ff2b3-8b2d-41e9-8645-9f7f85814a3e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:14.623189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1422/2855] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:52:14 2022] PUT /identity/v3/projects/e26e647ec73448299c0695d68b7de677/users/bee03d5265dc4386b3316a7a354902a6/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:52:14.688423 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9261b0f-baa8-4d82-9f15-5237060725ed None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:14.688715 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9261b0f-baa8-4d82-9f15-5237060725ed None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:14.688995 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9261b0f-baa8-4d82-9f15-5237060725ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:14.715975 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-b9261b0f-baa8-4d82-9f15-5237060725ed None None] MFA Rules not processed for user `bee03d5265dc4386b3316a7a354902a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:52:14.717168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b9261b0f-baa8-4d82-9f15-5237060725ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:14.781279 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1434/2856] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:52:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:52:14.792679 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ff2b3-8b2d-41e9-8645-9f7f85814a3e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:14.794391 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-8d2ff2b3-8b2d-41e9-8645-9f7f85814a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:14.850974 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ff2b3-8b2d-41e9-8645-9f7f85814a3e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:14.855032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dedc2-e8b9-478f-a151-eba56c9fdea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:14.855665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dedc2-e8b9-478f-a151-eba56c9fdea0 service cinder] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:14.855945 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dedc2-e8b9-478f-a151-eba56c9fdea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:14.856218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dedc2-e8b9-478f-a151-eba56c9fdea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:14.864908 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dedc2-e8b9-478f-a151-eba56c9fdea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:14.866338 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dedc2-e8b9-478f-a151-eba56c9fdea0 service cinder] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:14.876168 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1423/2857] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:52:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:52:17.407332 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9261b0f-baa8-4d82-9f15-5237060725ed None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:17.470023 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9261b0f-baa8-4d82-9f15-5237060725ed None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:17.474590 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562561e-f1e2-4c0e-9bc8-08c60bc1a834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:17.475485 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562561e-f1e2-4c0e-9bc8-08c60bc1a834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:17.475768 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562561e-f1e2-4c0e-9bc8-08c60bc1a834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:17.476048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562561e-f1e2-4c0e-9bc8-08c60bc1a834 admin admin] PATH_INFO: `/v3/users/bee03d5265dc4386b3316a7a354902a6` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:17.477233 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562561e-f1e2-4c0e-9bc8-08c60bc1a834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee03d5265dc4386b3316a7a354902a6)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:17.479459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562561e-f1e2-4c0e-9bc8-08c60bc1a834 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:17.527540 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9562561e-f1e2-4c0e-9bc8-08c60bc1a834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee03d5265dc4386b3316a7a354902a6'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:17.528200 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9562561e-f1e2-4c0e-9bc8-08c60bc1a834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee03d5265dc4386b3316a7a354902a6'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:17.539954 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9562561e-f1e2-4c0e-9bc8-08c60bc1a834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee03d5265dc4386b3316a7a354902a6'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:17.541316 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9562561e-f1e2-4c0e-9bc8-08c60bc1a834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee03d5265dc4386b3316a7a354902a6'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:17.548457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-9562561e-f1e2-4c0e-9bc8-08c60bc1a834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee03d5265dc4386b3316a7a354902a6'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:17.562326 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1435/2858] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:52:17 2022] DELETE /identity/v3/users/bee03d5265dc4386b3316a7a354902a6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:52:17.566665 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c839e-eef5-4344-92d9-d14185492620 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:17.567213 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c839e-eef5-4344-92d9-d14185492620 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:17.567421 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c839e-eef5-4344-92d9-d14185492620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:17.584825 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-9f4c839e-eef5-4344-92d9-d14185492620 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:52:17.586218 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9f4c839e-eef5-4344-92d9-d14185492620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:17.648174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1424/2859] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:52:17.658543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562561e-f1e2-4c0e-9bc8-08c60bc1a834 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:17.660040 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-9562561e-f1e2-4c0e-9bc8-08c60bc1a834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:17.715197 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c839e-eef5-4344-92d9-d14185492620 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:17.720220 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562561e-f1e2-4c0e-9bc8-08c60bc1a834 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:17.723979 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8a723-2175-4101-af67-83bc62b6ce55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:17.724508 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c839e-eef5-4344-92d9-d14185492620 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:17.724645 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a723-2175-4101-af67-83bc62b6ce55 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:17.724890 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a723-2175-4101-af67-83bc62b6ce55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:17.725168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a723-2175-4101-af67-83bc62b6ce55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:17.728061 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046c559-b49e-4fe4-a0b2-4a694e6c3299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:17.729367 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c559-b49e-4fe4-a0b2-4a694e6c3299 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:17.729644 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c559-b49e-4fe4-a0b2-4a694e6c3299 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:17.729917 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c559-b49e-4fe4-a0b2-4a694e6c3299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:17.731720 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c046c559-b49e-4fe4-a0b2-4a694e6c3299 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:17.734889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8a723-2175-4101-af67-83bc62b6ce55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:17.736323 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8a723-2175-4101-af67-83bc62b6ce55 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:17.746208 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1436/2860] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:52:17.800372 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046c559-b49e-4fe4-a0b2-4a694e6c3299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:17.801943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046c559-b49e-4fe4-a0b2-4a694e6c3299 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:17.814517 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1425/2861] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:52:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:52:18.187989 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8a723-2175-4101-af67-83bc62b6ce55 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:18.189486 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-a4e8a723-2175-4101-af67-83bc62b6ce55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:18.202857 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8a723-2175-4101-af67-83bc62b6ce55 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:18.207469 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c3ccb-4f0d-4254-8b0d-91a4fed07223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:18.208321 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c3ccb-4f0d-4254-8b0d-91a4fed07223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:18.208604 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c3ccb-4f0d-4254-8b0d-91a4fed07223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:18.208882 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c3ccb-4f0d-4254-8b0d-91a4fed07223 admin admin] PATH_INFO: `/v3/projects/e26e647ec73448299c0695d68b7de677` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:18.210066 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c3ccb-4f0d-4254-8b0d-91a4fed07223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26e647ec73448299c0695d68b7de677)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:18.212068 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c3ccb-4f0d-4254-8b0d-91a4fed07223 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:18.261543 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-315c3ccb-4f0d-4254-8b0d-91a4fed07223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26e647ec73448299c0695d68b7de677', 'request_id': 'req-315c3ccb-4f0d-4254-8b0d-91a4fed07223'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:18.271406 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-315c3ccb-4f0d-4254-8b0d-91a4fed07223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26e647ec73448299c0695d68b7de677', 'request_id': 'req-315c3ccb-4f0d-4254-8b0d-91a4fed07223'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:18.279018 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-315c3ccb-4f0d-4254-8b0d-91a4fed07223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26e647ec73448299c0695d68b7de677', 'request_id': 'req-315c3ccb-4f0d-4254-8b0d-91a4fed07223'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:18.290499 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-315c3ccb-4f0d-4254-8b0d-91a4fed07223 admin admin] The token cache is being invalidate because project e26e647ec73448299c0695d68b7de677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:52:18.291045 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-315c3ccb-4f0d-4254-8b0d-91a4fed07223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:18.294300 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-315c3ccb-4f0d-4254-8b0d-91a4fed07223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:18.296296 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1437/2862] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:52:18 2022] DELETE /identity/v3/projects/e26e647ec73448299c0695d68b7de677 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:52:18.300934 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081112d-1e6e-4d5f-97b8-f30a158264d7 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:18.301227 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081112d-1e6e-4d5f-97b8-f30a158264d7 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:18.301514 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081112d-1e6e-4d5f-97b8-f30a158264d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:18.319532 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-1081112d-1e6e-4d5f-97b8-f30a158264d7 None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:52:18.320726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-1081112d-1e6e-4d5f-97b8-f30a158264d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:18.387255 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1426/2863] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:52:18.395433 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae476dd7-2244-4d29-96bd-c6dde65efb6d None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:18.395800 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae476dd7-2244-4d29-96bd-c6dde65efb6d None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:18.396168 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae476dd7-2244-4d29-96bd-c6dde65efb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:18.418657 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-ae476dd7-2244-4d29-96bd-c6dde65efb6d None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:52:18.419914 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ae476dd7-2244-4d29-96bd-c6dde65efb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:18.428349 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1438/2864] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:52:18.433185 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081112d-1e6e-4d5f-97b8-f30a158264d7 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:18.442568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081112d-1e6e-4d5f-97b8-f30a158264d7 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:18.447894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49702451-cf14-4c33-a695-e05f194503f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:18.448584 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49702451-cf14-4c33-a695-e05f194503f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:18.448867 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49702451-cf14-4c33-a695-e05f194503f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:18.449138 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49702451-cf14-4c33-a695-e05f194503f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:18.449870 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49702451-cf14-4c33-a695-e05f194503f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80137) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:52:18.450174 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49702451-cf14-4c33-a695-e05f194503f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:18.451798 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49702451-cf14-4c33-a695-e05f194503f5 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:18.463809 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1427/2865] 10.222.0.76 () {58 vars in 1152 bytes} [Thu May 12 17:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:52:18.468087 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae476dd7-2244-4d29-96bd-c6dde65efb6d None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:18.476971 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae476dd7-2244-4d29-96bd-c6dde65efb6d None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:18.481706 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f04e16-3bc0-4312-aaed-48a584a05e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:18.482353 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f04e16-3bc0-4312-aaed-48a584a05e82 admin admin] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:18.482636 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f04e16-3bc0-4312-aaed-48a584a05e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:18.482939 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f04e16-3bc0-4312-aaed-48a584a05e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:18.483621 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f04e16-3bc0-4312-aaed-48a584a05e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:18.485534 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f04e16-3bc0-4312-aaed-48a584a05e82 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:18.511538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1439/2866] 10.222.0.76 () {60 vars in 1152 bytes} [Thu May 12 17:52:18 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:52:18.515691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49702451-cf14-4c33-a695-e05f194503f5 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:18.526479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49702451-cf14-4c33-a695-e05f194503f5 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:18.581933 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd09379-05f6-4964-8ec8-562a5cc3112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:18.582612 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd09379-05f6-4964-8ec8-562a5cc3112b admin admin] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:18.582967 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd09379-05f6-4964-8ec8-562a5cc3112b admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:18.583243 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd09379-05f6-4964-8ec8-562a5cc3112b admin admin] PATH_INFO: `/v3/users` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:18.583943 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd09379-05f6-4964-8ec8-562a5cc3112b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:18.585860 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd09379-05f6-4964-8ec8-562a5cc3112b admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:18.610773 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1428/2867] 10.222.0.76 () {60 vars in 1143 bytes} [Thu May 12 17:52:18 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:52:18.612148 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f04e16-3bc0-4312-aaed-48a584a05e82 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:18.623416 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f04e16-3bc0-4312-aaed-48a584a05e82 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:18.628548 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b704f-196b-435e-8876-cc3e6f777f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:18.629215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b704f-196b-435e-8876-cc3e6f777f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:18.629527 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b704f-196b-435e-8876-cc3e6f777f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:18.629807 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b704f-196b-435e-8876-cc3e6f777f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:18.630544 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b704f-196b-435e-8876-cc3e6f777f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:18.632189 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b704f-196b-435e-8876-cc3e6f777f22 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:18.643693 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1440/2868] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:52:18.648119 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd09379-05f6-4964-8ec8-562a5cc3112b admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:18.658696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd09379-05f6-4964-8ec8-562a5cc3112b admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:18.663475 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55bfda-8a17-4648-8d3f-829bba52bf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:18.664134 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55bfda-8a17-4648-8d3f-829bba52bf7e admin admin] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:18.664419 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55bfda-8a17-4648-8d3f-829bba52bf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:18.664696 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55bfda-8a17-4648-8d3f-829bba52bf7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:18.665420 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55bfda-8a17-4648-8d3f-829bba52bf7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:18.667128 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55bfda-8a17-4648-8d3f-829bba52bf7e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:18.677162 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1429/2869] 10.222.0.76 () {58 vars in 1121 bytes} [Thu May 12 17:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:52:18.682038 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b704f-196b-435e-8876-cc3e6f777f22 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:18.692001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b704f-196b-435e-8876-cc3e6f777f22 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:18.696618 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f0309-7cbf-4aac-937e-71f5f7fd2f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:18.698117 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f0309-7cbf-4aac-937e-71f5f7fd2f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:18.698398 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f0309-7cbf-4aac-937e-71f5f7fd2f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:18.698687 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f0309-7cbf-4aac-937e-71f5f7fd2f5e admin admin] PATH_INFO: `/v3/projects/7fffabfd353d40f9b22f295e5a4c2eee/users/ed40b664eb4c4f2cb02651e54aa9f554/roles/aac74c237ff74c5199b863b81ced5058` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:18.713398 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f0309-7cbf-4aac-937e-71f5f7fd2f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fffabfd353d40f9b22f295e5a4c2eee, user_id=ed40b664eb4c4f2cb02651e54aa9f554, role_id=aac74c237ff74c5199b863b81ced5058)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:18.716100 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f0309-7cbf-4aac-937e-71f5f7fd2f5e admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:18.729966 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1441/2870] 10.222.0.76 () {60 vars in 1482 bytes} [Thu May 12 17:52:18 2022] PUT /identity/v3/projects/7fffabfd353d40f9b22f295e5a4c2eee/users/ed40b664eb4c4f2cb02651e54aa9f554/roles/aac74c237ff74c5199b863b81ced5058 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:52:18.740328 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8c65-5cc7-4895-926e-7ec63a2d6b92 None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:18.740616 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8c65-5cc7-4895-926e-7ec63a2d6b92 None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:18.740915 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8c65-5cc7-4895-926e-7ec63a2d6b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:18.769598 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-044c8c65-5cc7-4895-926e-7ec63a2d6b92 None None] MFA Rules not processed for user `ed40b664eb4c4f2cb02651e54aa9f554`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:52:18.770322 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-044c8c65-5cc7-4895-926e-7ec63a2d6b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:18.836751 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1430/2871] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:52:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:52:18.847501 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f0309-7cbf-4aac-937e-71f5f7fd2f5e admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:18.849501 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-4f1f0309-7cbf-4aac-937e-71f5f7fd2f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:18.905891 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f0309-7cbf-4aac-937e-71f5f7fd2f5e admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:18.909538 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc683850-f0ce-4d68-8bf8-99ee6c623883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ffc2e3a517e48c4bf368bdc0dd18ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:18.910175 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc683850-f0ce-4d68-8bf8-99ee6c623883 service cinder] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:18.910451 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc683850-f0ce-4d68-8bf8-99ee6c623883 service cinder] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:18.910742 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc683850-f0ce-4d68-8bf8-99ee6c623883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:18.920263 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc683850-f0ce-4d68-8bf8-99ee6c623883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:18.921691 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc683850-f0ce-4d68-8bf8-99ee6c623883 service cinder] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:18.930761 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1442/2872] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:52:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:52:38.352291 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c8c65-5cc7-4895-926e-7ec63a2d6b92 None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:38.415803 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c8c65-5cc7-4895-926e-7ec63a2d6b92 None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:38.420335 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a417772-8239-442d-b4b1-a8dec1059659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:38.421196 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a417772-8239-442d-b4b1-a8dec1059659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:38.421477 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a417772-8239-442d-b4b1-a8dec1059659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:38.421753 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a417772-8239-442d-b4b1-a8dec1059659 admin admin] PATH_INFO: `/v3/users/ed40b664eb4c4f2cb02651e54aa9f554` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:38.422986 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a417772-8239-442d-b4b1-a8dec1059659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed40b664eb4c4f2cb02651e54aa9f554)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:38.424964 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a417772-8239-442d-b4b1-a8dec1059659 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:38.470309 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0a417772-8239-442d-b4b1-a8dec1059659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed40b664eb4c4f2cb02651e54aa9f554'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:38.470984 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0a417772-8239-442d-b4b1-a8dec1059659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed40b664eb4c4f2cb02651e54aa9f554'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:38.471594 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0a417772-8239-442d-b4b1-a8dec1059659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed40b664eb4c4f2cb02651e54aa9f554'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:38.484568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0a417772-8239-442d-b4b1-a8dec1059659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed40b664eb4c4f2cb02651e54aa9f554'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:38.491916 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0a417772-8239-442d-b4b1-a8dec1059659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed40b664eb4c4f2cb02651e54aa9f554'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:38.504297 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1431/2873] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:52:38 2022] DELETE /identity/v3/users/ed40b664eb4c4f2cb02651e54aa9f554 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:52:38.508923 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012aa37-4e96-4ef0-85b6-45fedc3010fb None None] REQUEST_METHOD: `POST` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:38.509457 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012aa37-4e96-4ef0-85b6-45fedc3010fb None None] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:38.509561 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012aa37-4e96-4ef0-85b6-45fedc3010fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:38.527118 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.auth.core [None req-d012aa37-4e96-4ef0-85b6-45fedc3010fb None None] MFA Rules not processed for user `fcec6386453a4aeb83b0960ebf40f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80138) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:52:38.529215 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d012aa37-4e96-4ef0-85b6-45fedc3010fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:38.613648 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1443/2874] 10.222.0.76 () {58 vars in 957 bytes} [Thu May 12 17:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:52:38.626286 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a417772-8239-442d-b4b1-a8dec1059659 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:38.627956 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0a417772-8239-442d-b4b1-a8dec1059659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:38.689464 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a417772-8239-442d-b4b1-a8dec1059659 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:38.693269 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156666b-b237-448b-9bbc-f738949601fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:38.693920 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156666b-b237-448b-9bbc-f738949601fe service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:38.694204 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156666b-b237-448b-9bbc-f738949601fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:38.694607 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156666b-b237-448b-9bbc-f738949601fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:38.704585 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156666b-b237-448b-9bbc-f738949601fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:38.706042 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156666b-b237-448b-9bbc-f738949601fe service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:38.715390 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1432/2875] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:52:38.984758 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012aa37-4e96-4ef0-85b6-45fedc3010fb None None] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:38.986207 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-d012aa37-4e96-4ef0-85b6-45fedc3010fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:38.999399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012aa37-4e96-4ef0-85b6-45fedc3010fb None None] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:39.004020 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:39.005913 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:39.006248 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:39.006454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] PATH_INFO: `/v3/projects/7fffabfd353d40f9b22f295e5a4c2eee` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:39.007699 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fffabfd353d40f9b22f295e5a4c2eee)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:39.009613 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:39.056897 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fffabfd353d40f9b22f295e5a4c2eee', 'request_id': 'req-8d45d229-7698-4ee8-b813-ba7737a8b741'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:39.065356 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fffabfd353d40f9b22f295e5a4c2eee', 'request_id': 'req-8d45d229-7698-4ee8-b813-ba7737a8b741'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:39.070742 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fffabfd353d40f9b22f295e5a4c2eee', 'request_id': 'req-8d45d229-7698-4ee8-b813-ba7737a8b741'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:39.083112 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] The token cache is being invalidate because project 7fffabfd353d40f9b22f295e5a4c2eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:52:39.083394 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:39.084029 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:39.085599 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1444/2876] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:52:38 2022] DELETE /identity/v3/projects/7fffabfd353d40f9b22f295e5a4c2eee => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:52:39.627436 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156666b-b237-448b-9bbc-f738949601fe service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:39.628895 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-c156666b-b237-448b-9bbc-f738949601fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:39.641063 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156666b-b237-448b-9bbc-f738949601fe service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:39.690026 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bf7b4-494c-495a-bf4f-0e1dfa059119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:39.690694 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bf7b4-494c-495a-bf4f-0e1dfa059119 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:39.690992 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bf7b4-494c-495a-bf4f-0e1dfa059119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:39.691268 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bf7b4-494c-495a-bf4f-0e1dfa059119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:39.693179 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0b7bf7b4-494c-495a-bf4f-0e1dfa059119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:39.755932 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bf7b4-494c-495a-bf4f-0e1dfa059119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:39.757282 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bf7b4-494c-495a-bf4f-0e1dfa059119 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:39.767261 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1433/2877] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:52:46.265454 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:46.267698 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:46.283153 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45d229-7698-4ee8-b813-ba7737a8b741 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:46.288413 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203cf6d-5a36-48ee-8a6a-eb85e35e2425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:46.289370 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203cf6d-5a36-48ee-8a6a-eb85e35e2425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:46.289717 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203cf6d-5a36-48ee-8a6a-eb85e35e2425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:46.290062 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203cf6d-5a36-48ee-8a6a-eb85e35e2425 admin admin] PATH_INFO: `/v3/users/7802c329d4ca4eccb28fdec9f8082cc1` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:46.291397 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203cf6d-5a36-48ee-8a6a-eb85e35e2425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7802c329d4ca4eccb28fdec9f8082cc1)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:46.294002 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203cf6d-5a36-48ee-8a6a-eb85e35e2425 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:46.344482 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8203cf6d-5a36-48ee-8a6a-eb85e35e2425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7802c329d4ca4eccb28fdec9f8082cc1'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.345124 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8203cf6d-5a36-48ee-8a6a-eb85e35e2425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7802c329d4ca4eccb28fdec9f8082cc1'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.357786 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8203cf6d-5a36-48ee-8a6a-eb85e35e2425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7802c329d4ca4eccb28fdec9f8082cc1'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.358482 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8203cf6d-5a36-48ee-8a6a-eb85e35e2425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7802c329d4ca4eccb28fdec9f8082cc1'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.365428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-8203cf6d-5a36-48ee-8a6a-eb85e35e2425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7802c329d4ca4eccb28fdec9f8082cc1'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.377817 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1445/2878] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:52:46 2022] DELETE /identity/v3/users/7802c329d4ca4eccb28fdec9f8082cc1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:52:46.548287 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bf7b4-494c-495a-bf4f-0e1dfa059119 service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:46.558718 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bf7b4-494c-495a-bf4f-0e1dfa059119 service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:46.615396 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:46.616249 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:46.616531 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:46.616807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] PATH_INFO: `/v3/projects/4e9154d1a4c44c6b8a42001c659d069b` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:46.617997 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9154d1a4c44c6b8a42001c659d069b)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:46.619985 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:46.664326 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9154d1a4c44c6b8a42001c659d069b', 'request_id': 'req-9cd1c292-b849-48ee-bc8e-87d3647092b0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.671194 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9154d1a4c44c6b8a42001c659d069b', 'request_id': 'req-9cd1c292-b849-48ee-bc8e-87d3647092b0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.676640 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9154d1a4c44c6b8a42001c659d069b', 'request_id': 'req-9cd1c292-b849-48ee-bc8e-87d3647092b0'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.688032 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] The token cache is being invalidate because project 4e9154d1a4c44c6b8a42001c659d069b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:52:46.688317 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.688945 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.690476 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1434/2879] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:52:46 2022] DELETE /identity/v3/projects/4e9154d1a4c44c6b8a42001c659d069b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:52:46.694688 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203cf6d-5a36-48ee-8a6a-eb85e35e2425 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:46.696090 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-8203cf6d-5a36-48ee-8a6a-eb85e35e2425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:46.709791 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203cf6d-5a36-48ee-8a6a-eb85e35e2425 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:46.764917 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dd247-98f2-4052-8b75-38702e0f04fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:46.765735 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dd247-98f2-4052-8b75-38702e0f04fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:46.766010 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dd247-98f2-4052-8b75-38702e0f04fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:46.766278 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dd247-98f2-4052-8b75-38702e0f04fd admin admin] PATH_INFO: `/v3/users/d41e016e2e7e4caaab8fdef9a1f6bc66` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:46.767488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dd247-98f2-4052-8b75-38702e0f04fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41e016e2e7e4caaab8fdef9a1f6bc66)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:46.769399 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dd247-98f2-4052-8b75-38702e0f04fd admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:46.815654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f46dd247-98f2-4052-8b75-38702e0f04fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41e016e2e7e4caaab8fdef9a1f6bc66'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.816300 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f46dd247-98f2-4052-8b75-38702e0f04fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41e016e2e7e4caaab8fdef9a1f6bc66'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.828459 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f46dd247-98f2-4052-8b75-38702e0f04fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41e016e2e7e4caaab8fdef9a1f6bc66'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.829115 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f46dd247-98f2-4052-8b75-38702e0f04fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41e016e2e7e4caaab8fdef9a1f6bc66'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.835764 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-f46dd247-98f2-4052-8b75-38702e0f04fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41e016e2e7e4caaab8fdef9a1f6bc66'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:46.849194 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1446/2880] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:52:46 2022] DELETE /identity/v3/users/d41e016e2e7e4caaab8fdef9a1f6bc66 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:52:47.018639 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:47.020222 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:47.033537 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1c292-b849-48ee-bc8e-87d3647092b0 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:47.092678 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:47.093596 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:47.093875 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:47.094147 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] PATH_INFO: `/v3/projects/224cb7122bad49d89bd72e8250e2d8f6` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:47.095365 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] RBAC: Authorizing `identity:delete_project(project_id=224cb7122bad49d89bd72e8250e2d8f6)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:47.097386 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:47.142455 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224cb7122bad49d89bd72e8250e2d8f6', 'request_id': 'req-ee9542c3-a561-4f1f-bebb-ed6f206f037e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:47.149043 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224cb7122bad49d89bd72e8250e2d8f6', 'request_id': 'req-ee9542c3-a561-4f1f-bebb-ed6f206f037e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:47.154765 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224cb7122bad49d89bd72e8250e2d8f6', 'request_id': 'req-ee9542c3-a561-4f1f-bebb-ed6f206f037e'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:47.165366 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] The token cache is being invalidate because project 224cb7122bad49d89bd72e8250e2d8f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80137) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:52:47.165656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:47.166289 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:52:47.167856 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1435/2881] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:52:47 2022] DELETE /identity/v3/projects/224cb7122bad49d89bd72e8250e2d8f6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:52:47.687845 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dd247-98f2-4052-8b75-38702e0f04fd admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:47.689305 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-f46dd247-98f2-4052-8b75-38702e0f04fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:47.748607 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dd247-98f2-4052-8b75-38702e0f04fd admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:47.796814 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900f513-3c13-489d-8085-5133975ece21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:47.797514 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900f513-3c13-489d-8085-5133975ece21 service neutron] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:47.797731 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900f513-3c13-489d-8085-5133975ece21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:47.798001 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900f513-3c13-489d-8085-5133975ece21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:47.799795 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b900f513-3c13-489d-8085-5133975ece21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:47.872402 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900f513-3c13-489d-8085-5133975ece21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:47.873882 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900f513-3c13-489d-8085-5133975ece21 service neutron] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:47.884986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1447/2882] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:52:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:52:49.073340 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:52:49.074965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:49.087656 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9542c3-a561-4f1f-bebb-ed6f206f037e admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:52:49.092931 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ad7a1-bced-4a3e-8947-658b1d0199c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:52:49.093582 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ad7a1-bced-4a3e-8947-658b1d0199c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:52:49.093863 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ad7a1-bced-4a3e-8947-658b1d0199c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:52:49.094139 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ad7a1-bced-4a3e-8947-658b1d0199c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:52:49.095945 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-ab9ad7a1-bced-4a3e-8947-658b1d0199c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:52:49.110737 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ad7a1-bced-4a3e-8947-658b1d0199c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:52:49.112176 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ad7a1-bced-4a3e-8947-658b1d0199c8 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:52:49.123476 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1436/2883] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:52:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:53:32.858871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900f513-3c13-489d-8085-5133975ece21 service neutron] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:53:32.858871 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-b900f513-3c13-489d-8085-5133975ece21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:53:32.876312 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900f513-3c13-489d-8085-5133975ece21 service neutron] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:53:32.884718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1fafa-743c-40ad-8190-9cd64b9686af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:53:32.885690 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1fafa-743c-40ad-8190-9cd64b9686af service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:53:32.886073 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1fafa-743c-40ad-8190-9cd64b9686af service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:53:32.886445 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1fafa-743c-40ad-8190-9cd64b9686af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:53:32.889253 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-fab1fafa-743c-40ad-8190-9cd64b9686af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:53:32.906593 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1fafa-743c-40ad-8190-9cd64b9686af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:53:32.908241 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1fafa-743c-40ad-8190-9cd64b9686af service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:53:32.921525 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1448/2884] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:53:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:53:33.007379 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ad7a1-bced-4a3e-8947-658b1d0199c8 service neutron] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:53:33.016947 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ad7a1-bced-4a3e-8947-658b1d0199c8 service neutron] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:53:33.020777 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef42331-2d1e-4cc7-baa9-90e2bcdc2f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731d9124a2294b95a7cf1127e5362b66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:53:33.021712 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef42331-2d1e-4cc7-baa9-90e2bcdc2f98 service neutron] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:53:33.022512 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef42331-2d1e-4cc7-baa9-90e2bcdc2f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:53:33.022804 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef42331-2d1e-4cc7-baa9-90e2bcdc2f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:53:33.024930 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-aef42331-2d1e-4cc7-baa9-90e2bcdc2f98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:53:33.036492 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef42331-2d1e-4cc7-baa9-90e2bcdc2f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:53:33.038353 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef42331-2d1e-4cc7-baa9-90e2bcdc2f98 service neutron] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:53:33.047568 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1437/2885] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:53:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:53:33.978488 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1fafa-743c-40ad-8190-9cd64b9686af service nova] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:53:33.990452 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1fafa-743c-40ad-8190-9cd64b9686af service nova] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:53:33.996964 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01f8de-63fb-4f63-b15e-5b835ed50a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad234318ad47589b844351cd3bb3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:53:33.998151 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01f8de-63fb-4f63-b15e-5b835ed50a08 service nova] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:53:33.998428 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01f8de-63fb-4f63-b15e-5b835ed50a08 service nova] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:53:33.998718 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01f8de-63fb-4f63-b15e-5b835ed50a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:53:34.000921 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ea01f8de-63fb-4f63-b15e-5b835ed50a08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:53:34.014067 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01f8de-63fb-4f63-b15e-5b835ed50a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:53:34.015795 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01f8de-63fb-4f63-b15e-5b835ed50a08 service nova] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:53:34.027743 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1449/2886] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:53:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:53:40.150859 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da2855-a8db-475a-ae8a-29d52508753a None None] REQUEST_METHOD: `POST` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:53:40.151354 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da2855-a8db-475a-ae8a-29d52508753a None None] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:53:40.151479 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da2855-a8db-475a-ae8a-29d52508753a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:53:40.170018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.auth.core [None req-54da2855-a8db-475a-ae8a-29d52508753a None None] MFA Rules not processed for user `a74c44dd215a4f318baf6768c2b3d932`. Rule list: `[]` (Enabled: `True`). {{(pid=80137) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:53:40.171246 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-54da2855-a8db-475a-ae8a-29d52508753a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:53:40.223894 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1438/2887] 10.222.0.76 () {58 vars in 967 bytes} [Thu May 12 17:53:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:53:40.264910 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01f8de-63fb-4f63-b15e-5b835ed50a08 service nova] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:53:40.266301 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ea01f8de-63fb-4f63-b15e-5b835ed50a08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:53:40.335245 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01f8de-63fb-4f63-b15e-5b835ed50a08 service nova] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:53:40.340550 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2730cb-3d89-4a41-9cbc-2ea38f63457f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e679573cc984993b98e416fabd586d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:53:40.341325 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2730cb-3d89-4a41-9cbc-2ea38f63457f service swift] REQUEST_METHOD: `GET` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:53:40.341613 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2730cb-3d89-4a41-9cbc-2ea38f63457f service swift] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:53:40.341889 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2730cb-3d89-4a41-9cbc-2ea38f63457f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:53:40.349900 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2730cb-3d89-4a41-9cbc-2ea38f63457f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:53:40.351533 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2730cb-3d89-4a41-9cbc-2ea38f63457f service swift] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:53:40.359952 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1450/2888] 10.222.0.76 () {60 vars in 1384 bytes} [Thu May 12 17:53:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 17:53:46.895978 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da2855-a8db-475a-ae8a-29d52508753a None None] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:53:46.897711 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-54da2855-a8db-475a-ae8a-29d52508753a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:53:46.967430 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da2855-a8db-475a-ae8a-29d52508753a None None] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:53:46.973691 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60d58a-dd1b-45b1-a3fd-7e8ab8f63741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:53:46.974634 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60d58a-dd1b-45b1-a3fd-7e8ab8f63741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:53:46.975018 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60d58a-dd1b-45b1-a3fd-7e8ab8f63741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:53:46.975357 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60d58a-dd1b-45b1-a3fd-7e8ab8f63741 admin admin] PATH_INFO: `/v3/users/6ebf6077df894158babed9db4682d730` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:53:46.976637 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60d58a-dd1b-45b1-a3fd-7e8ab8f63741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebf6077df894158babed9db4682d730)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:53:46.978583 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60d58a-dd1b-45b1-a3fd-7e8ab8f63741 admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:53:47.028965 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0f60d58a-dd1b-45b1-a3fd-7e8ab8f63741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebf6077df894158babed9db4682d730'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.029884 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0f60d58a-dd1b-45b1-a3fd-7e8ab8f63741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebf6077df894158babed9db4682d730'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.030569 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0f60d58a-dd1b-45b1-a3fd-7e8ab8f63741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebf6077df894158babed9db4682d730'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.043189 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0f60d58a-dd1b-45b1-a3fd-7e8ab8f63741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebf6077df894158babed9db4682d730'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.050270 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-0f60d58a-dd1b-45b1-a3fd-7e8ab8f63741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebf6077df894158babed9db4682d730'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.062537 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1439/2889] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:53:46 2022] DELETE /identity/v3/users/6ebf6077df894158babed9db4682d730 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:53:47.231069 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2730cb-3d89-4a41-9cbc-2ea38f63457f service swift] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:53:47.243372 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2730cb-3d89-4a41-9cbc-2ea38f63457f service swift] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:53:47.298865 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:53:47.299654 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:53:47.299931 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:53:47.300211 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] PATH_INFO: `/v3/projects/c3403873c6404cd1a227b411c653126f` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:53:47.301384 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3403873c6404cd1a227b411c653126f)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:53:47.303327 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:53:47.346664 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3403873c6404cd1a227b411c653126f', 'request_id': 'req-ad18a913-558f-4387-a29d-7b0fcc476e33'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.353757 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3403873c6404cd1a227b411c653126f', 'request_id': 'req-ad18a913-558f-4387-a29d-7b0fcc476e33'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.359816 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3403873c6404cd1a227b411c653126f', 'request_id': 'req-ad18a913-558f-4387-a29d-7b0fcc476e33'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.370588 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] The token cache is being invalidate because project c3403873c6404cd1a227b411c653126f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:53:47.370887 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.371515 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.373057 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1451/2890] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:53:47 2022] DELETE /identity/v3/projects/c3403873c6404cd1a227b411c653126f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:53:47.377263 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60d58a-dd1b-45b1-a3fd-7e8ab8f63741 admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:53:47.378726 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-0f60d58a-dd1b-45b1-a3fd-7e8ab8f63741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:53:47.392152 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60d58a-dd1b-45b1-a3fd-7e8ab8f63741 admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:53:47.447216 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad560da-2078-4ffa-a271-7b6408e6fe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:53:47.448012 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad560da-2078-4ffa-a271-7b6408e6fe8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:53:47.448295 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad560da-2078-4ffa-a271-7b6408e6fe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:53:47.448567 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad560da-2078-4ffa-a271-7b6408e6fe8a admin admin] PATH_INFO: `/v3/users/72ba8ca07ba54553ab8265b9b336b612` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:53:47.449807 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad560da-2078-4ffa-a271-7b6408e6fe8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ba8ca07ba54553ab8265b9b336b612)` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:53:47.452273 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad560da-2078-4ffa-a271-7b6408e6fe8a admin admin] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:53:47.496253 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-5ad560da-2078-4ffa-a271-7b6408e6fe8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ba8ca07ba54553ab8265b9b336b612'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.496885 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-5ad560da-2078-4ffa-a271-7b6408e6fe8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ba8ca07ba54553ab8265b9b336b612'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.498170 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-5ad560da-2078-4ffa-a271-7b6408e6fe8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ba8ca07ba54553ab8265b9b336b612'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.509530 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-5ad560da-2078-4ffa-a271-7b6408e6fe8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ba8ca07ba54553ab8265b9b336b612'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.516735 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.notifications [None req-5ad560da-2078-4ffa-a271-7b6408e6fe8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ba8ca07ba54553ab8265b9b336b612'} {{(pid=80137) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.529578 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1440/2891] 10.222.0.76 () {58 vars in 1223 bytes} [Thu May 12 17:53:47 2022] DELETE /identity/v3/users/72ba8ca07ba54553ab8265b9b336b612 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:53:47.697545 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] Authenticating user token {{(pid=80138) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:53:47.698959 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.fernet_utils [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80138) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:53:47.712048 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18a913-558f-4387-a29d-7b0fcc476e33 admin admin] Validating token access rules against request {{(pid=80138) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:53:47.771986 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcec6386453a4aeb83b0960ebf40f96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ec5d27c457b4e7d87f61efe4927f51d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80138) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:53:47.773216 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:53:47.773498 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:53:47.773879 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972 admin admin] PATH_INFO: `/v3/projects/6e1b536bd26f4425b004bc7cab993e70` {{(pid=80138) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:53:47.775086 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e1b536bd26f4425b004bc7cab993e70)` {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:53:47.777005 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972 admin admin] RBAC: Authorization granted {{(pid=80138) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:53:47.826574 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e1b536bd26f4425b004bc7cab993e70', 'request_id': 'req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.834053 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e1b536bd26f4425b004bc7cab993e70', 'request_id': 'req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.839366 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e1b536bd26f4425b004bc7cab993e70', 'request_id': 'req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972'} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.850420 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972 admin admin] The token cache is being invalidate because project 6e1b536bd26f4425b004bc7cab993e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80138) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:53:47.850578 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.851230 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: DEBUG keystone.notifications [None req-0c45a9ec-b6c2-4c36-891c-e3fe883f8972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80138) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:53:47.857453 dv-cinder-839793-10-iscsi devstack@keystone.service[80138]: [pid: 80138|app: 0|req: 1452/2892] 10.222.0.76 () {58 vars in 1232 bytes} [Thu May 12 17:53:47 2022] DELETE /identity/v3/projects/6e1b536bd26f4425b004bc7cab993e70 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:55:52.110636 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad560da-2078-4ffa-a271-7b6408e6fe8a admin admin] Authenticating user token {{(pid=80137) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:55:52.112171 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-5ad560da-2078-4ffa-a271-7b6408e6fe8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:55:52.248544 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad560da-2078-4ffa-a271-7b6408e6fe8a admin admin] Validating token access rules against request {{(pid=80137) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:55:52.306082 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7f6e2-5717-49bd-bad4-ba47741f10ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01fa037b14c456eb533b5a86da0a370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '745af7d676704a179668d6685724ed78', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80137) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:55:52.306770 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7f6e2-5717-49bd-bad4-ba47741f10ee service placement] REQUEST_METHOD: `GET` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:55:52.307054 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7f6e2-5717-49bd-bad4-ba47741f10ee service placement] SCRIPT_NAME: `/identity` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:55:52.307331 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7f6e2-5717-49bd-bad4-ba47741f10ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80137) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:55:52.309105 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.fernet_utils [None req-3bd7f6e2-5717-49bd-bad4-ba47741f10ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80137) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:55:52.320203 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7f6e2-5717-49bd-bad4-ba47741f10ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:55:52.321778 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7f6e2-5717-49bd-bad4-ba47741f10ee service placement] RBAC: Authorization granted {{(pid=80137) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:55:52.332989 dv-cinder-839793-10-iscsi devstack@keystone.service[80137]: [pid: 80137|app: 0|req: 1441/2893] 10.222.0.76 () {60 vars in 1365 bytes} [Thu May 12 17:55:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)